Gemma 4 E4B IT: Efficient Omni Model

Gemma 4 is Google DeepMind's family of open multimodal models. The E4B variant is one of the family's small, efficient omni models, designed to run on laptops and high-end phones. It natively handles text, image, and audio input and generates text output, pairing a lightweight vision encoder with a dedicated audio encoder. It supports a 128K token context window and multilingual coverage across 140+ languages.

Key Features

• Omni Multimodality - Native understanding of text, image, and audio, with a compact vision encoder and a dedicated audio encoder for on-device multimodal workloads.
• Native Audio Understanding - Automatic speech recognition (ASR) and speech-to-translated-text across multiple languages.
• Native Vision - Image understanding with variable aspect ratio and resolution support.
• Hybrid Attention - Interleaves local sliding-window attention with full global attention and always ends on a global layer; global layers use unified Keys and Values with Proportional RoPE (p-RoPE) for efficient long-context processing.
• Long Context - 128K token context window for long documents and multi-turn multimodal sessions.
• Multilingual - Pre-trained across 140+ languages.
• Efficient by Design - A small dense model targeting on-device and edge deployment.

Use Cases

• On-device and edge multimodal assistants
• Automatic speech recognition and speech-to-translated-text translation
• Visual question answering and image analysis
• Document and image understanding
• Multilingual chat and translation
• Lightweight reasoning and coding assistance

Architecture

Gemma 4 E4B processes multimodal inputs through dedicated lightweight encoders: a compact vision encoder handles images and video frames, and an audio encoder handles speech, both feeding a dense decoder-only transformer. The hybrid attention stack interleaves sliding-window local layers with global layers and ends on a global layer, so the model keeps a small memory footprint while retaining long-context awareness. Its size makes it deployable in environments ranging from high-end phones to laptops.

Benchmarks

Google DeepMind reports instruction-tuned results across reasoning, coding, multilingual, vision, audio, and long-context suites, including MATH-Vision for visual math and MRCR v2 for long-context retrieval. For the full benchmark tables and family comparisons, see the model card on HuggingFace.