Resnet
2 mentions across 1 person
Visit ↗All mentions
“one big revolution I forgot which actually I I can't believe I forgot in 2015 is the residual network architecture ResNet. Okay, that was in 2015 which is a very simple idea but it solved a huge problem which is that when you stack multiple layers of a of a neural net and you train it with backdrop you get some issue that the the gradients can become mushy or they die or they explode and you have a hard time kind of training the system.”
Yann LeCun's Journey Through AI and the Future of Machine Intelligence ↗