Gemma 4 12B IT: Encoder-Free Omni Model

Gemma 4 is Google DeepMind's family of open multimodal models. The 12B "Unified" variant is an encoder-free omni model that natively handles text, image, audio, and video input and generates text output. It brings audio and vision understanding directly into a single decoder-only transformer, with no separate encoders, making it well suited to local and on-device deployment. It supports a 256K token context window and multilingual coverage across 140+ languages.

Key Features

• Encoder-Free Unified Multimodality - Raw image patches and audio waveforms are projected directly into the model's embedding space through lightweight linear layers, so all modalities flow into one decoder-only transformer with no dedicated vision or audio encoders.
• Native Audio Understanding - Automatic speech recognition (ASR) and speech-to-translated-text across multiple languages, built into the model.
• Native Vision - Image understanding with variable aspect ratio and resolution support, plus video analysis via frame sequences.
• Hybrid Attention - Interleaves local sliding-window attention with full global attention and always ends on a global layer; global layers use unified Keys and Values with Proportional RoPE (p-RoPE) for efficient long-context processing.
• Long Context - 256K token context window for long documents, long-form reasoning, and multi-turn multimodal sessions.
• Multilingual - Pre-trained across 140+ languages.
• Dense Architecture - A dense transformer sized for laptops, workstations, and consumer GPUs.

Use Cases

• On-device and local multimodal assistants combining text, image, and audio
• Automatic speech recognition and speech-to-translated-text translation
• Visual question answering and image analysis
• Document, chart, and screen understanding
• Long-context reasoning and summarization
• Multilingual chat and translation
• Code generation and completion

Architecture

The "Unified" designation refers to the encoder-free design. Where other Gemma 4 models use dedicated encoders to pre-process multimodal inputs, the 12B model eliminates them entirely, projecting raw image patches and audio waveforms straight into the decoder's embedding space. All modalities are processed by a single decoder-only transformer, reducing multimodal latency and allowing the whole model to be fine-tuned in one pass. The hybrid attention stack interleaves sliding-window local layers with global layers, keeping the memory footprint low while preserving deep long-context awareness.

Benchmarks

Google DeepMind reports instruction-tuned results across reasoning, coding, multilingual, vision, audio, and long-context suites, including MATH-Vision for visual math and MRCR v2 for long-context retrieval. For the full benchmark tables and family comparisons, see the model card on HuggingFace.