Index Ai Academy
Free course · 6 lessons · about 3 hours

Why Models Do That: six behaviors, traced to the mechanism

Confident wrong answers, miscounted letters, copying from the prompt, temperature, long prompts that dilute, and a model that never says "I don't know": each behavior reproduced on a tiny GPT with every number printed by code, then the mechanism behind it and the Phase 1 technique it justifies.

Already have an account? Sign in

What you'll learn

What you'll be able to do.

Hallucination, tokens and letters, in-context learning and induction heads, temperature, attention dilution and lost-in-the-middle, compliance and sycophancy.

In order

The 6 lessons.

A free account opens them all.

  1. Confident and wrongWhy a model answers with the same assurance whether it is right, wrong or asked about something that does not exist.30 min
  2. Why it can't spell or count lettersThe model sees token IDs, and an embedding learned from usage carries nothing about spelling.25 min
  3. Copying from the promptIn-context learning as a two-head copying circuit: the base tiny GPT cannot copy a repeated pattern, a model trained on repeats grows an induction head and can.30 min
  4. Why temperature changes the answerThe same prompt at 0, 0.7 and 1.5: deterministic loops, plausible variety, broken grammar, measured on a real model.25 min
  5. Why long prompts diluteAttention is a budget shared by every token, so a fact far from the question loses its share; measured, with the cliff beyond the trained window.25 min
  6. Why it never says "I don't know"A chat model answers every request because its fine-tuning data always did; preference training adds flattery; how to build abstention in.25 min
Before and after

Where it starts, and what you earn.

When you finish

Finish every lesson and you earn a self-paced certificate of completion, "Why Models Do That course", with its own link you can share or add to LinkedIn. Lessons you skip in the placement test count once you pass their phase's checkpoint.

Questions

Before you sign up.

Is it really free?

Yes. There's nothing to pay, here or anywhere in the academy. A free account saves your progress and issues your certificate.

Do I need to install anything?

No. The Python in these lessons runs in your browser.

How long does it take?

About 3 hours in all, at your own pace. Your progress stays where you left it.

What does the certificate show?

That your account recorded every lesson as finished. A self-paced certificate of completion rests on the progress your own devices record as you study. Pass a phase's checkpoint, 12 questions that the academy's server draws and marks itself, and the certificate becomes a verified one that names the checkpoint behind it. Lessons you skip in the placement test count toward a certificate once you pass that checkpoint. There is no proctored exam, and neither kind is an accredited qualification.

Keep learning

Other free courses.

Or take the whole course: 575 lessons, from your first line of Python to production AI.

32 lessons about 21.5 hours

Free Python for AI course

Learn Python from your first line of code to your first call to a language model, with nothing to install.

15 lessons about 9.5 hours

Free prompt engineering course

Learn to write prompts that work reliably, then test them like an engineer: clear instructions, examples, structured output, chains, evals and defenses against prompt injection.

14 lessons about 9 hours

Free RAG course

Build retrieval-augmented generation step by step: embeddings, chunking, vector search, grounded answers with sources, and the measurements that tell you whether it works.

29 lessons about 22.5 hours

Free AI agents course

Learn how to build AI agents by building one: tools, the agent loop, MCP, permissions, context management and evals, ending with a coding agent that stops when its tests pass.

22 lessons about 16 hours

Build an LLM from scratch: a free course

Go from counting letter pairs to a small GPT you train yourself: tokenizers, attention, transformer blocks and the GPT architecture, written line by line.

127 lessons about 101.5 hours

Free Python developer course

Go from your first line of code to working as a Python developer: projects, testing, data, databases, web apps and APIs, all in your browser.

5 lessons about 3.5 hours

How Transformers Think: an interactive inference walkthrough

Follow one prompt, "The cat sat", through a language model with every number shown: tokens to IDs, embeddings and positional waves, the attention matrix, the feed-forward layer, and the probability over the next word.

17 lessons about 13.5 hours

Creating Custom LLMs: Editing Open Weights Using Weight-Space Programming

Read a model's weights, change them by hand and judge an edit someone else made: deltas, merging, low-rank edits, directions and fact edits on a tiny GPT in your browser. Then replay recorded sessions of an LLM reading, fixing and writing weights, check the published edit of a real open model, and ship a model of your own with its patch, verdict and card. Every number is printed by the lesson's own code, and the method's limits are taught with it.

11 lessons about 9 hours

Free MLOps course: running machine learning in production

Take a model from a notebook to a system that stays right: track and reproduce every run, search settings honestly, version data and models, promote through gates, keep training and serving in step, choose batch or online, catch drift, and retrain through a pipeline. Every number is measured by the lesson's own code.

118 lessons about 95.5 hours

The Foundation Math For Ai & ML: from arithmetic to attention

Learn the math behind AI from arithmetic up: numbers, algebra, vectors and matrices, calculus, probability and statistics, each shown as numbers moving and checked in Python, ending with a network you build and train from the formulas.

19 lessons about 15 hours

Transposition of Formulas: algebraic manipulation in every topic

Learn to make any letter of any formula the subject: layers undone in reverse order, fractions, a letter that appears twice, powers, roots, quadratics, logs, inequalities, trigonometry, vectors, matrices, calculus, probability, statistics and the formulas inside AI models, each checked in Python.

Never trained an AI? Teach a small one to write, right in your browser. It takes about 20 seconds and needs no account. Teach it to write

Free, with a certificate

Start the course.

A free account saves your progress across devices and issues your certificate when you finish.