v2.18.0
What's Changed
- Isolate demo dependencies and pin orjson for CVE-2025-67221 mitigation by @evcyen in #1173
- feat: Add LIT integration for interactive model analysis (#121) by @HetanshWaghela in #1163
- fix: set n_ctx=512 for TinyStories models by @puranikyashaswin in #1162
- Fix/tokenize and concatenate invalid token by @evcyen in #1179
- Remove spurious warning for tokenize_and_concatenate by @evcyen in #1177
- Add MMLU benchmark evaluation to evals by @CarlG0123 in #1183
- Fix/1076 logit lens layer norm by @evcyen in #1180
- Updating Interactive Neuroscope, CI to properly install demo by @jlarson4 in #1205
- Fix tokenize_and_concatenate splitting tokens across chunk boundaries by @brainsnog in #1201
- Fix deprecated IPython magic() calls in demo notebooks (issue #1036) by @brainsnog in #1203
- Expose n_ctx override in HookedTransformer.from_pretrained (issue #1006) by @brainsnog in #1204
- Added warning flags for usages of MPS by @jlarson4 in #1182
- Add GPT-OSS-20B model support by @CarlG0123 in #1195
- fixed the logit lens implementation inside ActivationCache.accumulated_resid to match the standard definition in literature and the expected and defined behavior as per the documentation in the docstring and in the docs by @hartigel in #1077
- Add Apertus model support with XIeLU activation by @sinievanderben in #1197
- Fix attention calculation on mps for torch 2.8.0 by @BrownianNotion in #1068
- HuBERT support rollout by @david-wei-01001 in #1111
- Pre-release testing by @jlarson4 in #1210
- Fix backward hooks Runtime Error by @evcyen in #1175
- Release v2.18.0 by @jlarson4 in #1211
New Contributors
- @evcyen made their first contribution in #1173
- @HetanshWaghela made their first contribution in #1163
- @puranikyashaswin made their first contribution in #1162
- @CarlG0123 made their first contribution in #1183
- @brainsnog made their first contribution in #1201
- @hartigel made their first contribution in #1077
- @sinievanderben made their first contribution in #1197
- @BrownianNotion made their first contribution in #1068
- @david-wei-01001 made their first contribution in #1111
Full Changelog: v2.17.0...v2.18.0