Sample-complexity bounds for next-token prediction
Produced by On the Sample Complexity of Next-Token Prediction
Markov chain
A stochastic process whose next-state distribution depends on the past only through a specified current state.
A stochastic process whose next-state distribution depends on the past only through a specified current state.
Higher-order chains can be represented by taking the current state to contain a finite window of preceding observations.