Memory usage grows with iterations in svi.step()

[fritzo]

Hmm, does it help to call gc.collect() between steps? You could get an idea of which tensors are leaking by using this trick.