My Question would be the following:
In my current work I would like to choose a categorical distribution with its parameters as the variational distribution. Addtionally, I would like to use stochastic variational inference in pyro. This would result in updating the variational parameters. Now since we know that for a categorical distrbution, the parameters are probabilities. Updating the parameters naively might result in the values spilling out of the range [0,1]. Does the SVI internally take this factor into account thereby being mindful of the spill over during the parameter updates?