This is where all optimizers reside: https://github.com/apache/incubator-mxnet/blob/master/python/mxnet/optimizer.py
Fork, modify, push, create Pull Request! If you’re not sure of these steps, I’d be happy to help.
1 Like