https://cuicaihao.github.io/tags/machine-learning-optimization/Recent content in Machine Learning Optimization on C.CUI's LogHugoen-AUTue, 25 Aug 2026 07:00:00 +1000https://cuicaihao.github.io/posts/2026-08-25-mathematical-and-algorithmic-ideas-that-changed-ai-over-the-last-decade-from-scaling-bottlenecks-to-foundation-models/Tue, 25 Aug 2026 07:00:00 +1000https://cuicaihao.github.io/posts/2026-08-25-mathematical-and-algorithmic-ideas-that-changed-ai-over-the-last-decade-from-scaling-bottlenecks-to-foundation-models/Over the past decade, foundation models have advanced through more than additional data, parameters, and compute. Researchers have also identified useful structure in hard problems and redesigned parameter representations, computation order, resource allocation, generative paths, training objectives, and runtime state so that previously intractable problems can be solved at scale.