Experiments

V28: Bottleneck Width Sweep

V28: Bottleneck Width Sweep

Period: 2026-02-19. Design: 3 conditions x 3 seeds. Tests whether the V27 mechanism is bottleneck width, nonlinearity, or 2-layer gradient coupling.

ConditionActivationWidthMean Φ\intinfo
A: linear_w8Identity80.074
B: tanh_w4Tanh40.069
C: tanh_w16Tanh160.084

The mechanism is 2-layer gradient coupling (W2W1W_2^\top W_1^\top in the gradient), not bottleneck width or nonlinearity. Any 2-layer head couples all hidden units during SGD. This is the decomposability wall: the second architectural barrier (after the ρ\rho wall).

Source code