Bert Instance

Amjad Masad

youtube · 2025-11-07

Recommended

“I saw another thing on hacker news the other day where um you know uh text diffusion \nuh where someone made a text diffusion model by instead of doing go saying dnoising he would take like a single BERT instance and like try to you know mask different words and uh and just predict like these different tokens and um and so we have a lot of components like I don't think people think a lot about that you know we have now the you know base pre-trained models. We have the all these RL reasoning mode”