Proposal
Support training, loading, and inference of MLP transcoders.
Motivation
MLP transcoders were trained by Jacob Dunefsky and Philippe Chlenski and have been shown to be useful.
Pitch
- Implement a
HookedTranscoder class analogous to HookedSAE and using similar functionality.
- Implement a transcoder training runner.
- Support loading pre-trained transcoder checkpoints.
Checklist
Proposal
Support training, loading, and inference of MLP transcoders.
Motivation
MLP transcoders were trained by Jacob Dunefsky and Philippe Chlenski and have been shown to be useful.
Pitch
HookedTranscoderclass analogous toHookedSAEand using similar functionality.Checklist