Mirage 2, an AI that can generate a mobile 3D world like a game in real time



Mirage 2 is an AI model developed by AI development company

Dynamics Lab that can generate freely navigable 3D spaces in real time based on a single image and description. Dynamics Lab calls Mirage 2 an 'AI native game engine' and 'world generation engine,' and is developing it with the goal of making it usable for game production in the future.

Mirage: AI UGC game engine
https://blog.dynamicslab.ai/

Below is an example of Mirage 2 generation. By entering the image on the left and adding explanatory text, you can generate the interactive world on the right.



You can move freely within the generated world using the WASD keys, and the screen is generated in real time according to your movement.




It is also possible to generate worlds based on children's drawings or famous paintings.



Google has also released '

Genie 3 ' with a similar concept, but Mirage 2 has advantages such as 'capable of continuous generation for more than 10 minutes,' 'latency of 200 milliseconds,' 'ability to run on a single GPU,' and 'ability to actually try it out online.'



The online demo of Mirage 2 is available at the link below, so I'll try it out.

Mirage 2

https://demo.dynamicslab.ai/chaos

In the demo, you can upload your own images or use pre-prepared images and descriptions. Click 'Start' to generate the world.



The waiting time will then be displayed on the screen.



After waiting for a while, the world was generated. You can move forward, backward, left, and right by holding down the Shift key and pressing the WASD keys, but it doesn't move smoothly like in the actual game. Instead, the character moves forward without any operation, and pressing the D key moves it slightly to the right.



Add a description of the world on the right side of the screen, and it will be reflected immediately. Try entering 'Set the season to winter' and then click 'Send.'



Snow piled up on the ground.



The development team is aware of problems with Mirage 2, such as 'poor response to character control' and 'occasionally sudden scene changes,' and is committed to developing the game to address these issues.

Related Posts:

in Software,   Game, Posted by log1o_hf