I’m writing my thesis using Pyro and have so far used the AdagradRMSProp
optimizer. Now in the writing process I was trying to find some literature or explanation on how the ‘mash-up’ of Adagrad
and RMSProp
looks, but I can’t find any. Would be great to have something.
Here’s the Pyro doc in which AdagradRMSProp
is mentioned.
http://docs.pyro.ai/en/0.2.1-release/optimization.html