Dropout Regularization
Visualize how randomly disabling neurons during training prevents neural network overfitting.
Free theory articleVisualize how randomly disabling neurons during training prevents neural network overfitting.
Concept & interpretation
Dropout is a powerful regularization technique used to prevent overfitting in deep neural networks. During training, a fraction of neurons (determined by the dropout rate, p) is randomly ignored or "dropped out" during each iteration. By temporarily disabling these units and their connections, the network is forced to learn more robust features that are useful in conjunction with many different random subsets of neurons. This prevents complex co-adaptations where neurons rely too heavily on specific other neurons.