• max pooling downsamples a feature map by keeping only the largest value in each small window, sitting between convolution layers in CNNs
    • keeps “did this feature fire somewhere around here”, throws away exactly where
    • shrinks width and height, so later layers cost less and each unit sees a bigger receptive field
    • has no parameters of its own, any overfitting help comes from making the downstream layers smaller
  • example: 2x2 window, stride 2, a 4x4 map becomes 2x2
1324
5678
9843
2157
68
97
  • gives a bit of local translation invariance: shift the input a pixel and the max of a window often stays the same ( approximate, and only within the window )
  • in backprop the gradient goes only to the argmax of each window, everything else gets zero
  • variants
    • average pooling: mean instead of max
    • global max / average pooling: one value per channel over the whole map, how ResNet style nets collapse to a vector before the classifier
  • settings: 2x2 or 3x3 windows, stride 2 by default, padding to control the output size
  • used in AlexNet and VGG ( LeNet used a trainable average subsampling ); newer nets often swap it for strided convolutions, and vision transformers drop it
  • neuro side: the max is the “complex cell” operation in HMAX style ventral stream models, and pooled hierarchical CNNs are what predict responses in higher visual cortex