One-step adaptation in the intrinsic dimension
Produced by First-order ANIL provably learns representations despite overparametrization
Theoretical guarantee
A formally stated and justified claim about the behavior of a system under explicit assumptions.
A formally stated and justified claim about the behavior of a system under explicit assumptions.
It may bound error, data requirements, convergence, or another property that can be established mathematically.
Connections
Has specialization
Out-of-domain generalization from rephrasability and stability
Produced by Generalization Bounds for Autoregressive Processes and In-Context Learning
Representation recovery by first-order ANIL
Produced by First-order ANIL provably learns representations despite overparametrization
Sample-complexity bound for high-order linear systems
Produced by Long-Context Linear System Identification
Sample-complexity bounds for next-token prediction
Produced by On the Sample Complexity of Next-Token Prediction
Stage-wise convergence guarantee for sparse-attention learning
Produced by Incremental Learning of Sparse Attention Patterns in Transformers