AIMaks Playgrounds

Attention Lens

Attention is the mechanism that lets a transformer decide which words matter to which. This is a real model — a 2-layer transformer we trained on our own course text — running its full forward pass in your browser. Type a sentence, watch it look.

Downloading the mini-transformer (…) — trained on our own courses, runs entirely in your browser.

0%

Browse the course libraryAIMaks · Playgrounds