Animationsoptimization

Gradient Descent Visualization

Watch how gradient descent iteratively finds the minimum of a loss function by following the steepest downhill direction.

beginner45s7 frames · step through
Gradient DescentFinding the minimum step by stepClick next to see the algorithm in action
Frame 1 of 7
w_{t+1} = w_t - \alpha \cdot \nabla L(w_t)

Gradient Descent: The Core Optimization Algorithm