Induction heads implement smoothed n-gram estimators
Produced by Induction Heads Interpolate N-Grams
Mechanistic characterization
A scientific account that identifies an internal component, computation, or circuit responsible for observed behavior.
A scientific account that identifies an internal component, computation, or circuit responsible for observed behavior.
It relates an observed behavior to a proposed internal mechanism and states the conditions under which that account applies.