GLM-5.3-Flash vs Qwen3.8-Flash-Next: Two Chinese AI Labs Independently Converge on the Same Model Architecture
Two frontier open-weight models shipped within a day of each other this week.

Two frontier open-weight models shipped within a day of each other this week. Z.ai released GLM-5.3-Flash , a 320B-parameter multimodal MoE model with 18B active parameters. Alibaba’s Qwen team released Qwen3.8-Flash-Next , a 125B model with 6B active parameters that previews the Qwen4 architecture.
The two teams designed these systems independently. Yet their configs read like near-copies of each other. Both use a 3:1 hybrid of linear and full attention. Both select context with a compressed indexer capped at 2048 tokens. Both widen the residual stream into 4 gated branches. Both train with the Muon optimizer, with fused parameter matrices split before orthogonalization. This article walks through the shared recipe, the one point of disagreement, and the one lab that dissents.
GLM-5.3-Flash is the first natively multimodal model in the GLM-5 series, released under the MIT license on Hugging Face . Z.ai tested it anonymously as Ox Alpha on OpenRouter, where it became the most popular model of the week. It was trained on a 30T-token multimodal corpus and serves a 1M-token context window. Z.ai says it outperforms GLM-5.2 across benchmarks at one-tenth the price, while approaching Claude Opus 4.8 on coding and agentic benchmarks . List pricing is $0.15 per million input tokens and $0.50 per million output tokens.
Qwen3.8-Flash-Next plays the role Qwen3-Next played for Qwen3.5: an early public preview of the next architecture family. The model card lists a 125B main model plus an additional 51B n-gram embedding table, with 6B parameters activated per token. Native context is 262,144 tokens, extensible to 1M with YaRN. The Qwen team reports that training required only about one-ninth the compute of Qwen3.7-Plus. The accompanying technical report is titled “On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability.”
GLM-5.3-Flash stacks 45 layers: 34 linear-attention layers and 11 full-attention layers, per the shipped config . Qwen3.8-Flash-Next stacks 48 layers in a repeating block of 3 Gated DeltaNet layers plus 1 Qwen Sparse Attention layer, per the vLLM recipe . Both land on the same 3:1 ratio.
The linear layers are the cheap layers. Instead of a KV cache that grows with the text, they compress all history into a fixed-size recurrent state. Compute per token stays constant regardless of context length. GLM uses Kimi Delta Attention (KDA), the linear-attention design introduced by Moonshot AI’s Kimi Linear, which applies a fine-grained per-channel decay gate. Qwen uses its own Gated DeltaNet (GDN), which gates at the per-head level. Different gating granularity, same delta-rule family, same job.
Source: MarkTechPost