Glossary
Pretraining
The first, large training stage: next-token prediction over a huge text corpus. Most language ability and world knowledge come from it.
Where it is explained
See also
Terms explained in the same lessons.
Glossary
The first, large training stage: next-token prediction over a huge text corpus. Most language ability and world knowledge come from it.
Terms explained in the same lessons.