How a transformer works, with a real GPT you can run
Type a sentence and watch a real trained GPT predict the next word and show where each of its attention heads is looking.
Each of these takes one idea and lets you change it and watch what happens. They run in your browser, with no account and nothing to install.
Type a sentence and watch a real trained GPT predict the next word and show where each of its attention heads is looking.
Pick a dataset and a network shape, press Train, and watch a real neural network learn to separate two classes, right on this page.
Pick a word and see how it shares its attention across a sentence, then see what multiple heads and the causal mask add.
Three settings decide how a language model turns probabilities into words. Move them, watch the odds change, then sample.
Step down a curve yourself and see why the learning rate matters, how valleys trap you, and why plain gradient descent zig-zags.
Run a tiny network forward, then watch blame flow backward through it, one multiplication at a time.
Slide a classifier's threshold and watch precision, recall and the ROC curve respond, then see why accuracy can tell you nothing.
Raise a model's complexity and watch training error keep falling while error on new data turns back up. Then see bias, variance and regularization at work.