[Submitted on 26 Oct 2025]
Adaptive Geometric Momentum Optimizer
View PDFAbstract:We present Adaptive Geometric Momentum (AGM), a novel optimization algorithm that achieves a validation loss of 4.852 on language model training, outperforming AdamW (4.927) and Lion (6.114) baselines.
Submission history
[v1] Sun, 26 Oct 2025 06:54 UTC