AIMaks Playgrounds

GridWorld

Reinforcement learning in its purest form: paint walls and rewards on a grid, then watch value ripple outward from the goal one Bellman sweep at a time. Drag a wall mid-run and the whole value field — arrows and all — bends around your edit, live. Or freeze a cell and open the backup inspector to unfold the single number into its whole equation: four candidate actions, their slip-weighted outcomes, and the max that wins.

0.000.000.000.000.000.000.000.00+10.000.000.000.000.000.000.00−10.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.000.00
values zeroed — run value iteration
wallgoal +1trap −1V(s) > 0V(s) < 0→ greedy action● agent
Paint

click or drag on the grid to paint

Inspect

open the inspector to unfold how each cell's V(s) is computed from its four actions

Dynamics
Solve

edit anything mid-run — values reset and the sweep keeps going, so you can watch the field reroute live

slippery floor: 1 move in 5 slips sideways, so values sag next to the trap — the agent prices in its own clumsiness.

Bellman backups computed live in your browser — the numbers in each cell are V(s) from value iteration.

Browse the course libraryAIMaks · Playgrounds