↓Skip to main content

Gradient Descent

2026

Gradient descent, Newton's method, and BFGS following different trajectories toward the minimum of an elliptical quadratic objective.

What Are Machine Learning Models Really Optimizing? From Gradient Descent to Large Language Models

7 October 2026·Updated: 11 October 2026·7808 words·37 mins