Properly using a Scheduler with an optimizer

[jpchen]

Is the proper way too update the scheduler in Pyro to call scheduler.set_epoch(INT) ?

yes

note that ReduceLROnPlateau is the only scheduler not supported.