Generalization Bounds for Autoregressive Processes and In-Context Learning
2025
The mathematical study of what can be learned from finite data and how performance depends on data, model classes, objectives, and algorithms.
It includes questions of generalization, sample complexity, robustness, dependence, and fundamental limits.