MIRA World Model

We trained a multiplayer world model for 2v2 Rocket League games.

Joint project between Kyutai and General Intuition, in collaboration with Epic Games.

Try it here or check out the blog post (written by yours truly) here.

This is the video from the world model and at first glance, it looks like it's simply Rocket League gameplay - it's that good! The model runs on a single (beefy - B200) GPU, producing 576p video at 20fps that's controllable in real time.

This is the main project I've been working on at Kyutai since the start of the year so I'm happy it's finally out. I won't write about the technical aspect here - go check out the blog post!

A question worth answering here is why? What's the point of simulating Rocket League instead of just playing it directly? Indeed, the project is not useful in and of itself. It's research on a more controlled environment that should help with doing world models for physical AI later - think self-driving and robots. More details in this section of the blog.

I couldn't resist sneaking in an animation in Canvas Commons* into the blog post:

* Canvas Commons is the community-maintained fork of Motion Canvas, created after the creator of MC disappeared in last February. He only added one commit a week ago that changed the domain from https://motioncanvas.io/ to https://motion-canvas.io/ after someone apparently sniped it after it expired.