Bert

“Finally, we extend the BERT architecture to incorporate multi-dimensional information, particularly user historical behavior, enabling the model to capture dynamic linguistic patterns and uncover implicit sarcastic cues in comments.”

Yann LeCun

youtube · 2026-03-02

Recommended

“and then after that came BERT that also came out of Google which was this idea of using self-supervised learning where I take a sequence of words corrupt it remove some of the words and then train this big neural net to reconstruct the words that I'm missing predict the words that I'm missing”