absorb.md

Resnet

2 mentions across 1 person

Visit ↗
Yann LeCun
youtube · 2026-03-02
Loved

one big revolution I forgot which actually I I can't believe I forgot in 2015 is the residual network architecture ResNet. Okay, that was in 2015 which is a very simple idea but it solved a huge problem which is that when you stack multiple layers of a of a neural net and you train it with backdrop you get some issue that the the gradients can become mushy or they die or they explode and you have a hard time kind of training the system.

Yann LeCun's Journey Through AI and the Future of Machine Intelligence