0
MODEL SIGNAL · ALIBABA

Qwen3.5-9B

An open‑weights 9‑billion‑parameter **dense** multimodal model from Alibaba’s Qwen team, featuring **native multimodal vision support for images and video**, a **262,144‑token native context window extensible to ~1,010,000 tokens**, and a hybrid **Gated DeltaNet + Gated Attention** architecture optimized for efficient local and cloud deployment.

CATEGORYMultimodal
CONTEXT262144
RELEASEDMarch 2, 2026
Key Features
  • 9‑billion‑parameter **dense** (non‑MoE) transformer decoder model
  • Hybrid **Gated DeltaNet + Gated Attention** architecture (8 × (3 × DeltaNet → FFN) → 1 × Attention → FFN)
  • **Causal language model with vision encoder**: unified vision‑language backbone
  • **Native multimodal** support with early fusion for **text, images, and video** input
  • **Text‑only output** (image/text/video‑to‑text tasks)
  • Native **262,144‑token** context window, **extensible to ~1,010,000 tokens** via RoPE/Yarn scaling
  • Open weights distributed via Hugging Face; widely hosted by third‑party platforms and APIs
  • Vocabulary size 248,320 tokens; 32 layers, 4,096 hidden dimension, 12,288 FFN intermediate

Provider announcement →

Read the Model Signal report →

MODEL SIGNAL

Qwen3.5-9B

Alibaba scales native multimodal vision and a massive 262k context window in a 9B dense footprint

Bottom line

Alibaba’s Qwen team has officially released Qwen3.5-9B, an open-weights 9-billion-parameter dense model. Featuring a hybrid architecture and native vision capabilities for both images and video, the model aggressively pushes the boundaries of sub-10B parameter footprints by combining early-fusion multimodality with a 262,144-token native context window.

Signal

Released on March 2, 2026, Qwen3.5-9B is a dense (non-MoE) causal language model built on a unified vision-language backbone. Primary provider facts confirm a hybrid Gated DeltaNet and Gated Attention architecture, specifically structured as 8 × (3 × DeltaNet → FFN) → 1 × Attention → FFN. The model is trained with multi-token prediction (MTP) to maximize generation efficiency.

Crucially, the verified profile confirms native early-fusion multimodal support for text, images, and video inputs, outputting strictly text. It features a massive 262,144-token native context window, which is extensible to roughly 1,010,000 tokens via RoPE/Yarn scaling. The open-weights model is actively propagating across Hugging Face and ecosystem routers, optimized for both local and cloud deployment.

Noise

The primary noise lies in misinterpreting the model's multimodal classification. While Qwen3.5-9B ingests text, images, and video, it is strictly a text-output model designed for image/video-to-text tasks, not a multimodal generator. Additionally, while the 1-million-token extended context is a verified architectural capability, operators should not assume lossless retrieval across that entire extended span without workload-specific validation.

Where it fits

Qwen3.5-9B is designed for local and edge environments that require heavy vision-language processing and extreme long-context reasoning, but lack the VRAM to host massive Mixture-of-Experts (MoE) routing layers or >30B parameter models. It fits cleanly into pipelines requiring unified ingestion of video and dense documents for summarization, extraction, and conversational QA.

Operator implications

The operator read here is a structural shift in mid-tier model design. By mixing Gated DeltaNet with standard attention and leveraging multi-token prediction, Alibaba is optimizing a dense footprint for extreme long-context processing and generation speed. The directional implication is that sub-10B parameter models are increasingly viable as unified, early-fusion backbones for complex multimodal pipelines. For teams building on-device applications or looking to repatriate cloud-based vision tasks to local infrastructure, this hybrid architecture represents a highly capable, efficient new baseline.

Model Signal · Signal + Noise · Isaiah Steinfeld