Dear Pyro Team,
I’ve recently started following Pyro tutorials and learning the language. When I apply SVI and MCMC to my own data sets, I notice the following: MCMC always comes close to the ‘true’ values of the inferred model parameters, and SVI may come close but is sometimes way off. As I have understood, SVI is to mitigate the computational expenses of doing MCMC.
Can you help me with a systematic way of finding the right priors and other settings for SVI, so that the inference comes close to the ‘true’ values of parameters without MCMC. In certain situations, especially with large models, I do not have the luxury of being able to check whether I am close to the ‘true’ values.
It seems strange to me if I would always need MCMC to make reasonably accurate inference.
How can I post an example code with two small csv-files with some data?