
MiniMax's M2 Series: The clearest public blueprints for agent-native LLMs
Not just another MoE release: M2, M2.5, and M2.7 combine mini activations, long-context full attention, verifiable agentdata, and an RL stack built for tools, code, browsers, and office work.
~230B total params ~10B active params Forge RL M2 → M2.5 → M2.7
Core idea: MiniMax is arguing that frontier agentic performance does not require frontier dense activation cost. The series uses a sparse MoE design with only about 9.8B active parameters per token, then compounds that efficiency with agent-native data pipelines, speculative decoding, long-context training, and a reinforcement-learning system optimized for multi-step trajectories.
1. Why this paper matters
Most model papers still read like “here is the base model, here are the benchmark tables.” The M2 series paper is more interesting because it treats the model, the agent harness, the data flywheel, and the RL system as one stack.That matters because agent performance is usually bottlenecked less by raw next-token quality and more by whether the model can plan over long horizons, recover from mistakes, use tools in sequence, and stay coherent across many intermediate steps.MiniMax positions M2 as an end-to-end agent system: executable workspaces, artifact-aligned rewards, agent-native RL, and then self-evolution in M2.7.
2. The architecture thesis
The flagship M2 model is a 62-layer decoder-only Transformer with a sparse Mixture-of-Experts feed-forward stack. Total capacity is roughly 229.9B parameters, but only around 9.8B are activated per token. 256 fine-grained experts, with 8 experts active per token.
Sigmoid gating with learnable expert biases, which helps load balancing without relying as heavily on standard auxiliary routing losses.
Full attention + RoPE + grouped-query attention, not a shortcut long-context attention scheme.
Multi-token prediction used both during training and as a speculative decoding path at inference.
The strongest architectural signal from the paper: MiniMax explicitly says hybrid sliding-window attention looked cheaper on paper but hurt long-context agent reliability in practice, so they kept full attention.
3. The real differentiator is the data engine
MiniMax does not present post-training as generic chat finetuning. Instead, it builds several domain-specific, verifiable pipelines: SWE-style repository tasks: mined from GitHub PRs, wrapped in runnable Docker environments, scored with test-based rewards.
AppDev trajectories: realistic full-stack tasks generated from expert seed patterns and verified in browser-like environments.
Terminal-Gym: system-operation tasks synthesized from terminal problems and evaluated against real execution.
Agentic cowork: deep search, spreadsheets, Word/PPT, financial modeling, and office artifacts scored against output quality.
That is important because it shifts training from “be a good assistant” toward “successfully complete work inside a workspace.”
4. Forge is the hidden story
The paper’s most valuable contribution may actually be Forge, MiniMax’s agent-native RL system. It treats the model as a policy over long, messy, tool-heavy trajectories instead of isolated responses. Training view Process rewards + terminal rewards + efficiency pressure not just “did the answer look good,” but “did the agent complete the task correctly, with reasonable intermediate behavior and cost?”Systems view Windowed FIFO + prefix-tree merging + optimized inference scheduling Those details matter because agent RL trajectories are highly variable and otherwise waste enormous amounts of compute.
5. M2.7 points toward self-improving agent systems
M2.7 adds what MiniMax calls an early self-evolution loop: the model analyzes failed training runs, modifies its own scaffold, evaluates changes, and can decide whether to keep or revert them.This is the most forward-looking part of the release. It suggests a future where top-tier models are not only trained for external tasks, but are actively used inside the model-development loop itself.
6. Benchmarks are strong, but the bigger lesson is design
Yes, the reported scores are impressive: strong results on SWE-Pro, SWE Multilingual, Multi-SWE, Terminal Bench 2, MM Claw, BrowseComp, Toolathlon, AIME 2026, GPQA-Diamond, and MLE Bench Lite. But the bigger takeaway is not any single number.The bigger takeaway is the recipe:Use sparse MoE to keep activation cost low.
Train long-context behavior with full attention if you care about reliable agents.
Ground post-training in executable environments and artifact-level rewards.
Build RL infrastructure around trajectories, not prompts.
Preserve interleaved reasoning across steps instead of restarting cognition every turn.
7. Why builders should pay attention
If you build coding agents, deep-research systems, browser agents, or office copilots, the M2 paper is one of the best public references for what a production agent stack now looks like.The model architecture matters. But the stronger lesson is that real-world agent quality is increasingly a compound of architecture + data + scaffolding + RL infrastructure + inference engineering. MiniMax makes that stack unusually visible.
If you have read till here, Follow me: @Shreyas_Pandeyy
Originally published on X →