Pyro for next video frame predictions example?


#1

Hi there! I’m new to Pyro and I’m trying to get ‘uncertainty’ for the next RGB frame in video frame sequence. Like, we get 5 frames, do some convolutions + deconvolutions and trying to predict next (6th) frame we know from clip. How should i write distribution in final ‘observation’ pyro.sample(…) in the Pyro model (when data (Y) is 3xHxW RGB frame)?

Any hints or URL to examples for such cases?
At least, any examples where Y data is RGB image could be helpful (I hope).
Thnx in advance.


#2

[update:] Well, thanks to ’ Suggested Topics’ machine in the forum, this topic could be useful (b/w images, but worth a try).