I am looking for regressions and classification examples for simple Bayesian (Probabilistic) Neural Network. Simple means neural networks that are shallow (not-deep, one hidden layers and similar).

Can you point me to these sources?

# Simple Bayesian Neural Network examples

Hi, check out our Bayesian regression tutorial (part 1, part 2) and this forum post about `pyro.contrib.bnn.HiddenLayer`

.

There is also a bayesian neural network example in NumPyro that makes use of HMC for inference: https://github.com/pyro-ppl/numpyro/blob/master/examples/bnn.py