Skip to content

OLMo Family – Repairing TransformerLens residual Identities - #1657

Merged
jlarson4 merged 3 commits into
devfrom
bug/olmo-family-incorrect-attributes
Aug 12, 2026
Merged

OLMo Family – Repairing TransformerLens residual Identities#1657
jlarson4 merged 3 commits into
devfrom
bug/olmo-family-incorrect-attributes

Conversation

@jlarson4

Copy link
Copy Markdown
Collaborator

Description

The following blocks now correctly correspond to HookedTransformer

blocks.N.hook_attn_out
blocks.N.hook_mlp_out

Fixes #1648 – OLMo portion

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • This change requires a documentation update

Checklist:

  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I have not rewritten tests relating to key interfaces which would affect backward compatibility

@jlarson4 jlarson4 changed the title OLMo Family – Repairing TransformerLens residual Identieies OLMo Family – Repairing TransformerLens residual Identities Aug 12, 2026
@jlarson4
jlarson4 merged commit 6a5fa95 into dev Aug 12, 2026
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant