↓Skip to main content

XGBoost

2026

An illustration depicting a progression from a simple, isolated decision tree to a dense, interconnected forest of trees, symbolizing the evolution and complexity of ensemble tree models in machine learning.

From a Single Tree to a Forest: Mathematical Principles, Algorithmic Evolution, and Engineering Practices of Tree Models

17 October 2026·18578 words·38 mins

Gradient descent, Newton's method, and BFGS following different trajectories toward the minimum of an elliptical quadratic objective.

What Are Machine Learning Models Really Optimizing? From Gradient Descent to Large Language Models

7 October 2026·Updated: 11 October 2026·7808 words·37 mins