How a transformer works, with a real GPT

Name: How a transformer works, with a real GPT
Uploaded: 2026-11-05
Duration: 21 s
Description: A real trained GPT predicts the next word, running in your browser.

A real trained GPT predicts the next word, running in your browser.

Try it yourself

What it shows

A real trained GPT predicts the next word of a sentence, one press at a time, and then shows where one of its attention heads is looking. All of it runs in the browser.

This video has no sound.