research
Google DeepMind Converts Gemma 4 Into a Diffusion Model, Hits 1,500 Tokens/Sec
Google DeepMind published a technical report on DiffusionGemma, a text diffusion model built by retrofitting Gemma-4-26B-A4B rather than training from scratch. The model generates 256-token blocks in parallel, reaches about 1,500 tokens per second on an Nvidia H100, and uses less than 10% of the original training budget.