Set the learning rate of each parameter group using a cosine annealing schedule
lr_cosine_annealing(
optimizer,
T_max,
eta_min = 0,
last_epoch = -1,
verbose = FALSE
)
(Optimizer): Wrapped optimizer.
Maximum number of iterations
Minimum learning rate. Default: 0.
The index of the last epoch
(bool): If TRUE
, prints a message to stdout for
each update. Default: FALSE
.