Gemini 3.0 spotted in action during A/B testing



Several Gemini users have reported being able to get hands-on with the unreleased ' Gemini 3.0 ,' which Google is running on a trial basis.

Gemini 3.0 Spotted in the Wild Through A/B Testing | Rick Lamers' blog

https://ricklamers.io/posts/gemini-3-spotted-in-the-wild/

X user @chetaslua shared some artifacts he claims to have produced with the Gemini 3.0 Pro.

Below is the output from the prompt: 'Design and create colorful voxel art of Minions. Make it super detailed with perfect lighting and animated backgrounds.'




Below is a game simulator generated by the prompt 'Design and create a fully functional PlayStation 2 simulator.' You can actually click around and play the game.




These are said to be available experimentally in Google AI Studio , a free development environment for AI models.

Google's next-generation AI chatbot 'Gemini 3 Pro (tentative)' is being tested in Google AI Studio, and the output looks like this - GIGAZINE



According to machine learning engineer Rick Lammers, the 'accuracy of SVG file generation' can be used as an indicator of model quality. The fact that 'current AI is not good at outputting SVG files' was revealed by engineer Simon Willison's original benchmark, 'outputting an SVG file of a pelican riding a bicycle.' In fact, even excellent models have remarkably low accuracy in the pelican's SVG file, as can be seen in the article below.

When you try benchmarking GPT-4o and Google Gemini to draw a 'pelican on a bicycle' in SVG format, it looks like this - GIGAZINE



Lamaze also heard rumors that Gemini 3.0 was available, so he tried it out in Google AI Studio, and the A/B testing screen appeared.

Then, Lammers compared the SVG files of the Xbox 360 controller by outputting them to each model. Although he couldn't determine whether the model he used was Gemini 3.0 or Gemini 3.0 Pro, it seemed to have higher accuracy than other mainstream models.



Results comparing with the existing Gemini model are also shared.



@chetaslua also created an Xbox controller.




'The model ID used was 'ecpt50a2y6mpgkcn,' but this alone doesn't tell us what version of the vehicle it is,' Lammers said.

Related Posts:

in AI,   Software, Posted by log1p_kr