Topic: Models

A model trained to work through a problem internally before committing to an answer.

Training a model toward responses humans rate highly, rather than toward text that merely looks likely.

The total amount of text a model can consider at once — its entire working memory.

The smaller training phase that shapes a model’s behaviour rather than its knowledge.

The first and largest training phase, where a model learns from raw text by predicting what comes next.

A single learned number inside a model. Collectively, what the model knows.

Running a trained model to produce output, as opposed to training it.

A model trained to predict the next piece of text, at a scale where doing so requires learning much of what language…