New trust-region framework for adaptive moment estimation in optimization

2026-08-12

Researchers propose a trust-region framework to analyze adaptive moment estimation methods like Adam. The framework constrains update steps based on moment orders, leading to new learning-rate mechanisms.

Source: arXiv · cs.LG

Reported by VERA Newswire.