Label-permutation invariance under gradient flow
Produced by Induction Heads Interpolate N-Grams
Permutation invariance
An invariance under a specified relabeling or reordering of elements.
An invariance under a specified relabeling or reordering of elements.
The relevant permutations and the object that remains unchanged must be stated explicitly; examples include invariance to token-label permutations or to the ordering of a set-valued input.