[Submitted on 3 Nov 2025]
EigenStep Optimizer Results
View PDFAbstract:We present experimental results for the EigenStep optimizer, achieving a validation loss of 8.78 on a 134M parameter transformer model. The method demonstrates stable training characteristics though performance trails standard baselines.
Submission history
[v1] Mon, 3 Nov 2025 00:35 UTC