Artificial Intelligence · 04.08.2026, 07:03 UTC
Function-Vector Heads Are Two Populations: Writers and Cancellers in In-Context Learning
| Schweregrad | info |
|---|---|
| Kategorie | Artificial Intelligence |
| Quelle | arXiv cs.CL ↗ |
| Veröffentlicht | 04.08.2026 UTC |
Sicherheitsmeldung mit Schweregrad noch nicht bewertet. Technische Details im Tab „Originaltext“; empfohlene Schritte in der Checkliste.
arXiv:2606.07560v3 Announce Type: replace Abstract: Function-vector (FV) heads (Todd et al., ICLR 2024) are identified by the magnitude of their causal contribution to in-context rule tasks, and the resulting top set is treated as a single functional class. We show that it holds two. Under a sign-preserving criterion (refined direct logit attribution, validated head by head with path patching) the FV population splits into writers, which push the rule-correct logit up, and cancellers, which push it down. The two groups are mechanistically distinct: writers place a third to a half of their attention on the demonstration labels, cancellers shift 9 to 17 points of that mass off the labels and mostly onto the format tokens, and the two groups' write directions are more anti-aligned than same-layer controls. Their oppositely signed effects combine additively at the readout, so they partly cancel and the FV set understates what its writers do. Magnitude-only ranking surfaces whichever group locally dominates and misses the other, so any function vector or ablation built that way averages a promoting and a suppressing mechanism. The signed split holds in all fifteen (model, task) cells we test, spanning six Pythia scales and three architectures, and a sign-shuffle null rejects a chance split in five of the six cells that carry the full statistical pipeline. Zero-ablating the cancellers recovers +0.13 to +0.29 nats on the correct label in all six and shifts accuracy by +2 to +7 pp.