I am struggling to make a guide that doesn’t lead to posterior collapse. Here are the ELBO terms over iterations for each of my guide’s points. It should be evident that there is very little improvement.
I should note that despite this, the parameters themselves are learning. I just don’t know if they are actually meaningful.