Support simple-stories lms#3

Merged

danbraunai-apollo merged 76 commits intodevfrom

Apr 22, 2025

Commits on Feb 12, 2025

Rename some topk_mask vars to mask
danbraunai-apollo
committed

Commits on Feb 14, 2025

Commits on Feb 15, 2025

Don't copy biases in init_spd_model_from_target_model
danbraunai-apollo
committed

Commits on Feb 16, 2025

Fix resid_mlp init_from_target test
danbraunai-apollo
committed

Commits on Feb 20, 2025

Add randrecon to run label
danbraunai-apollo
committed

Commits on Feb 24, 2025

Permute to identity for plotting mask_vals
danbraunai-apollo
committed

Commits on Feb 27, 2025

Commits on Mar 3, 2025

Commits on Mar 4, 2025

Allow for detached inputs to gates and use target_out in random_mask_recon
danbraunai-apollo
committed

Commits on Mar 5, 2025

Add GateMLP
danbraunai-apollo
committed

Commits on Mar 6, 2025

Commits on Mar 17, 2025

Load env vars when running sweeps too
danbraunai-apollo
committed

Commits on Mar 25, 2025

Set bias to zero in GateMLP mlp_out
danbraunai-apollo
committed

Commits on Apr 1, 2025

WIP: Swap components with Llama nn.Linear modules
danbraunai-apollo
committed

Commits on Apr 3, 2025

Commits on Apr 4, 2025

WIP: Add param_match_loss
danbraunai-apollo
committed

Commits on Apr 8, 2025

Commits on Apr 10, 2025

Commits on Apr 16, 2025

Merge branch 'feature/lm' into feature/lm-temp
danbraunai-apollo
committed

Commits on Apr 17, 2025

Commits on Apr 22, 2025