Create a schedule with constant learning rate `start_lr` for `pct` proportion of the training, and a `curve_type` learning rate (till `end_lr`) for remaining portion of training.

combined_flat_anneal(pct, start_lr, end_lr = 0, curve_type = "linear")

Arguments

pct

Proportion of training with a constant learning rate.

start_lr

Desired starting learning rate, used for beginnning pct of training.

end_lr

Desired end learning rate, training will conclude at this learning rate.

curve_type

Curve type for learning rate annealing. Options are 'linear', 'cosine', and 'exponential'.