Index Ai Academy
Glossary · Phase 6 · Modern LLM engineering

Safetensors

A common file format for model weights: a short header listing each array's name, shape and position, then the raw numbers. Loading one can't run code, unlike older pickled files.

Try it now

Every tensor of the tiny GPT, as a picture. Pick one from the menu. The line under the picture gives its shape and size, and the bars at the bottom are its singular values, which the lesson on reading weights uses.

Learn it properly

Anatomy of a checkpoint · A model file is a set of named tensors: count them, find the ones that write to the residual stream, and save one to bytes and back. About 35 minutes.

Keep learning

More in plain English.

1286 terms in the glossary, each with the lesson that teaches it.

1286 terms

The glossary

Every word you'll meet in AI and machine learning, explained in everyday language.

Phase 6 · lesson 35 min

Anatomy of a checkpoint

A model file is a set of named tensors: count them, find the ones that write to the residual stream, and save one to bytes and back.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write