Dropout: Randomly Drop Neurons

Dropout randomly turns off some neurons during each training step, so the network cannot lean on any single unit too heavily. 🎲

By dropping neurons at random, dropout forces the network to build redundant paths, which spreads knowledge and improves generalization.