Does pyro support torch.distributed for automatic differentiation?

[marty0801]

As described in the example in the torch documentation

[fritzo]

Hi @marty0801, I would also be interested in answers to this question.

Pyro does integrate with Horovod via the HorovodOptimizer, as demonstrated in this example.