Language model
A probability model over sequences of tokens, used to score or generate text and other sequential data.
A probability model over sequences of tokens, used to score or generate text and other sequential data.
Many modern language models factor a sequence probability into conditional predictions of each token given a preceding context.