Hi, check out our Bayesian regression tutorial (part 1, part 2) and this forum post about pyro.contrib.bnn.HiddenLayer.
pyro.contrib.bnn.HiddenLayer