Lamb_step

Step for LAMB with `lr` on `p`

lamb_step(p, lr, mom, step, sqr_mom, grad_avg, sqr_avg, eps, ...)

Arguments

p

p

lr

learning rate

mom

momentum

step

step

sqr_mom

sqr momentum

grad_avg

gradient average

sqr_avg

sqr average

eps

epsilon

...

additional arguments to pass

Value

None