Google says it's found a sweet spot between power and efficiency by employing the 'distillation' of neural nets.

Dubbed the “world’s best single-accelerator model” to date, Gemma 3 joins the Gemmaverse as Google’s latest open model to be released to the public.

Google claims Gemma 3 will be able to tackle more challenging tasks compared to the older open source Google models. The context window, a measure of how much data you can input, has been expanded to 128,