Training dynamics

The study of how a model’s parameters, representations, and computations evolve during learning.

The study of how a model's parameters, representations, and computations evolve during learning.

is aResearch area All entries Open in graph

It treats the route taken through parameter space as an object of study rather than considering only the final model.

Connections

has subarea
Developmental interpretability
studies
Pretraining Transformer

Related publications