Added Adam optimizer implementation#150

Merged

milancurcic merged 16 commits intomodern-fortran:mainfrom

Jul 26, 2023

Commits on Jul 18, 2023

Added Adam optimizer implementation
Spnetic-5
committed
called rms from optimizers module
Spnetic-5
committed
Minor fixes to improve adam performance
Spnetic-5
committed

Commits on Jul 19, 2023

Commits on Jul 22, 2023

Added convergency test for Adam
Spnetic-5
committed

Commits on Jul 24, 2023

AdamW: Adam with decay weights modification
Spnetic-5
committed
AdamW Modifications
Spnetic-5
committed
Fixed failing test
Spnetic-5
committed

Commits on Jul 26, 2023

Add notes; clean up; make more internal parameters private
milancurcic
committed
AdamW changes
Spnetic-5
committed
AdamW changes2
Spnetic-5
committed
flexible weight decay regularization
Spnetic-5
committed
Formatting
milancurcic
committed
Bump version
milancurcic
committed