CBP & SWR Plasticity Correlates Dashboard

Examine the 4 physical correlates of loss of plasticity live across tasks: Dead Unit %, Weight Magnitude, Gradient Magnitude, and Representation Stable Rank.

modular-rl GitHub All Labs

Task Timeline Scrubber (Task 50 of 50)

Drag scrubber to inspect physical network correlates at any exact task index.

1. Dead Units Proportion (%)

ReLU neurons outputting 0 for entire batches

Base: 63.0%SWR: 7.2%CBP: 5.1%

2. Average Weight Magnitude ||W||

Mean absolute weight across layers

Base: 1.84SWR: 0.12CBP: 0.11

3. Average Gradient Magnitude ||∇L||

Mean absolute gradient magnitude

Base: 0.001SWR: 0.041CBP: 0.044

4. Representation Stable Rank

Effective feature matrix dimensionality ||A||_F² / ||A||₂²

Base: 3.0SWR: 33.8CBP: 35.6