Implementation of Bayesian Deep Learning by weight perturbation in Adam

I don’t pretend to fully understand this paper https://arxiv.org/pdf/1806.04854.pdf, but I am wondering if anyone has tried to implement it in Pyro. My overly simplified take on the paper is that it is a technique to get uncertainties out of a model as in Bayesian methods, but with less computation.

1 Like