Resnet

Yann LeCun

youtube · 2026-03-02

Loved

“one big revolution I forgot which actually I I can't believe I forgot in 2015 is the residual network architecture ResNet. Okay, that was in 2015 which is a very simple idea but it solved a huge problem which is that when you stack multiple layers of a of a neural net and you train it with backdrop you get some issue that the the gradients can become mushy or they die or they explode and you have a hard time kind of training the system.”

Yann LeCun

youtube · 2025-03-18

Recommended

“One story that a lot of people should know is that if you ask yourself what is the paper in all of science that has gathered the largest number of citations over the last 10 years, that paper was published in 2015, exactly 10 years ago. It was about a particular neural net architecture called ResNet, or residual networks, which came out of Microsoft Research in Beijing by a bunch of Chinese scientists. The lead author was Kaiming He.”