Radam_step

Step for RAdam with `lr` on `p`

radam_step(p, lr, mom, step, sqr_mom, grad_avg, sqr_avg, eps, beta, ...)

Arguments

p

p

lr

learning rate

mom

momentum

step

step

sqr_mom

sqr momentum

grad_avg

grad average

sqr_avg

sqr average

eps

epsilon

beta

beta

...

additional arguments to pass

Value

None