Does pyro support torch.distributed for automatic differentiation?

Tutorials
1

As described in the example in the torch documentation

2

Hi @marty0801, I would also be interested in answers to this question.

Pyro does integrate with Horovod via the HorovodOptimizer, as demonstrated in this example.