Google announces Gemma 3, the largest language model ever to run on a single GPU

On March 12, 2025, Google announced Gemma 3 , an open source,
Gemma 3: Google's new open model based on Gemini 2.0
https://blog.google/technology/developers/gemma-3/
Gemma 3 model overview | Google AI for Developers
https://ai.google.dev/gemma/docs/core
Gemma3Report.pdf
(PDF file) https://storage.googleapis.com/deepmind-media/gemma/Gemma3Report.pdf
Google has released ' Gemma ' as an open source large-scale language model that utilizes Gemini's research resources, and in May 2024 released 'Gemma 2,' a large-scale language model that can deliver performance comparable to Llama 3 70B, which has 70 billion parameters.
Google releases open source visual language model 'PaliGemma' and announces large-scale language model 'Gemma 2' with performance equivalent to Llama 3 - GIGAZINE

Now, Google has announced Gemma 3, an enhanced version of Gemma 2. Built using the same research and technology as Google's large-scale language model Gemini 2.0 , Gemma 3 is said to be 'the most advanced, portable, and responsibly developed open source model to date.'
Gemma 3 has four models with 1 billion, 4 billion, 12 billion, and 27 billion parameters, allowing users to choose the best model for their specific hardware and performance needs. In addition, Google says, 'Gemma 3 is designed to run fast on any device, including smartphones, laptops, and workstations, so developers can create AI applications wherever they want.'
One of the features of Gemma 3 is that it can run on a single GPU or TPU. In the ' Chatbot Arena ,' which is used to measure the relative capabilities of large-scale language models, it has been reported that the Gemma 3 27B, which uses a single NVIDIA H100, can outperform DeepSeek v3 and Llama 3 405B, which use multiple H100s.

Gemma 3 is also pre-trained in over 140 languages, allowing users to build applications that are tailored to their language needs, and has a context window of 128,000 tokens, allowing it to handle complex tasks.
'In developing Gemma 3, we made some fine-tuning changes to ensure it is aligned with our broader data governance and safety policies. As we develop more powerful models, it is important that the industry collaborates to develop an approach to safety that is proportionate to the risks. We will continue to learn and improve safety measures over time in open source models like Gemma 3,' Google said.
Gemma 3 is available on
Gemma 3 Release - a google Collection
https://huggingface.co/collections/google/gemma-3-release-67c6c6f89c4f76621268bb6d

Gemma 3 can also be run on
gemma3
https://ollama.com/library/gemma3

Related Posts:
in Software, Posted by log1r_ut