interpretability-experiments

Here are 4 public repositories matching this topic...

dpatz46-ui / scheduled-transformer-hypothesis

A hypothesis of depth-indexed state regimes in pre-RMSNorm language models.

machine-learning deep-learning transformers neural-networks deep-learning-papers interpretability ai-research activation-analysis deep-learning-projects llm llms mechanistic-interpretability rmsnorm transformers-architecture residual-stream interpretability-research interpretability-experiments residual-streams scheduled-transformer

Updated Sep 22, 2026
HTML

msmichellesamson / induction-head-universality

Star

Probing whether induction head universality is truly architecture-agnostic or whether model family leaves a structural fingerprint on the circuits that enable in-context learning.

python numpy pytorch matplotlib transformerlens interpretability-experiments

Updated Jul 6, 2026
Python

msmichellesamson / residual-stream-sycophancy

Star

Probing where in Pythia's residual stream the decision to be sycophantic is already 'decided', using linear classifiers on per-layer activations against a small labeled sycophancy dataset.

python scikit-learn pytorch matplotlib transformerlens interpretability-experiments