VGG: Stacks of Small Filters
Depth from simple 3x3 blocks.
One Filter Size to Rule
VGG made a bold bet: use only tiny 3x3 convolutions everywhere, and just stack a lot of them.
Why Small Wins
Two stacked 3x3 layers see the same area as one 5x5, but with fewer parameters and an extra nonlinearity in between.
All lessons in this course
- LeNet & AlexNet: The First Wins
- VGG: Stacks of Small Filters
- ResNet: Skip Connections Go Deep
- Load torchvision Models