To better understand the emerging capabilities of GAIA-1, it is helpful to see it in action. When we prompt GAIA-1 with a few seconds of starting context, it can imagine several possible futures. This shows that based on the same video prompt, GAIA-1 understands that many different things can happen in the future.
The video below shows that GAIA-1 can be prompted with a couple of seconds of the same starting context. Then it can unroll multiple possible futures. For example, turning left at the intersection (top left frame) or continuing straight (top right frame). Or even continuing straight along a different imagined road (bottom left frame). It can also imagine a pedestrian crossing the road ahead of us (bottom right frame).


GIPHY App Key not set. Please check settings