Try to build a scheduler

I tried to use the scheduler, and it was mentioned in this link that I could specify schedule (but the link was removed). I wonder if my manual scheduler method is recommended?

lr=[1,2,3,4,5]
for epoch in epochs:
    optim = Adam({"lr": lr[epoch]})
    svi = SVI(model, guide, optim, loss=elbo)
    for x,y in dataloader:
        loss = svi.step(x, y)

you can use optax see e.g. here

1 Like