Model guide · Dracon Bench
minimax-m3.1-flash
Tested
MiniMax M3.1 Flash on NIM lands at 50.0 overall across five suites, rank 19. JSON is the bright spot: all five briefs conform. IFEval-50 50%, IFBench 20%, MMLU-Pro 2/10, GSM8K 60%; all five SVG briefs timed out, so this row has no SVG column. Several text prompts also needed timed-out retries before an answer landed; the final not_delivered count is 0. Pilot depth: 10 prompts per text suite and the 5 SVG briefs; every suite prints its own n and not_delivered.
- Rank
- #19
- Overall
- 50.0
- Suites
- 5 of 6
- Ranked
- #19 of 21
When the world heard about it
Timeline
- First reachable for us 2026-11-18 our first probe
- First tested by us 2026-11-18 Dracon Bench
- Officially announced 2026-10-19 llm-stats
- First official benchmark 2026-11-19 llm-stats: a public score existed by then — the first day we saw one
- Reachable before we scored it same day
- Announced before it reached the lane we served 30 days
- A public score existed within 1 day
Track A · script-scored subsets
Scores
| Suite | Score | Sample | Precision |
|---|---|---|---|
| IFEval-50 prompt-strict | 50.0% | 5/10 prompts | 23.7%–76.3% |
| IFEval-50 instruction-strict | 52.9% | 9/17 constraints | 31.0%–73.8% |
| IFBench-50 prompt-strict | 20.0% | 2/10 prompts | 5.7%–51.0% |
| IFBench-50 instruction-strict | 18.2% | 2/11 constraints | 5.1%–47.7% |
| MMLU-Pro-50 | 20.0% | 2/10 served | 5.7%–51.0% |
| JSON briefs conformance | 100.0% | 5/5 served | 56.6%–100.0% |
| GSM8K-50 | 60.0% | 6/10 served | 31.3%–83.2% |
The range beside a script-scored figure is a 95% interval over that figure's own sample: the prompts it followed, the constraints it met, or the items it answered. The instruction-strict figures are measured over CONSTRAINTS, which is why their sample line counts constraints rather than prompts. The judged total is not a proportion, so it has no interval: it carries the measured judge band instead: how far a re-judging of the same artifacts moved them, which is a different kind of number. The method page says what each one covers and what it does not.
Track A · per-type breakdown
What it failed
The instruction types these two suites check, and the checks the model missed. A type is checked once per prompt that carries it, so a type with seven checks was asked for seven times. The counts beside a type are that type's own; the suite's totals are in the scores table above. These are the failures behind the instruction-strict figure, which is the sum of them.
IFEval-50
Missed at least one check in 7 of the 15 instruction types checked.
| Instruction type | Checks | Missed |
|---|---|---|
| startend · quotation | 2 | 2 |
| change case · capital word frequency | 1 | 1 |
| detectable format · json format | 1 | 1 |
| detectable format · number highlighted sections | 1 | 1 |
| length constraints · number paragraphs | 1 | 1 |
| length constraints · number words | 1 | 1 |
| punctuation · no comma | 2 | 1 |
IFBench-50
Missed at least one check in 7 of the 8 verifiers checked.
| Verifier | Checks | Missed |
|---|---|---|
| count · unique word count | 3 | 3 |
| count · conjunctions | 1 | 1 |
| count · person names | 1 | 1 |
| count · word count range | 1 | 1 |
| format · list | 1 | 1 |
| words · keywords specific position | 1 | 1 |
| words · words position | 1 | 1 |
Provider-reported usage
Thinking cost
What the run cost the model in thinking: provider-reported completion tokens per prompt, the thinking share, and the cost per correct answer. Reasoning-heavy models can exhaust fixed budgets before answering.
| Suite | Cost | Reading |
|---|---|---|
| IFEval-50 | 1,116/prompt | 76% thinking· 1,339/correct |
| GSM8K-50 | 220/prompt | 64% thinking· 366/correct |
Head to head
Compare with
- ernie-5.5-flash-preview
- north-mini-code
- dots-3-note-preview
- gemma-4-31b-it
- lfm-2.5-2.6b
- lfm-3-1.7b
- muse-glimmer-30b
- nemotron-3.5-bolt-e4b
- nemotron-3.5-lightning-30b-a3b
- nemotron-3.5-lightning
- nemotron-3.5-super-vl-120b-a12b
- nemotron-3.5-super-vl
- nemotron-3-nano-omni-30b-a3b-reasoning
- nemotron-3-nano-omni-30b-a3b-reasoning
- nemotron-3-ultra-550b-a55b
- nemotron-3-ultra-550b-a55b
- hy4-flash
- particle-1
- laguna-xs-2.1
- flint-v1.0
Run record
Evidence and notes
- NVIDIA NIM free endpoint (integrate.api.nvidia.com/v1), same key and base as every NIM row
- JSON 5/5 is the strongest suite on this row
- No SVG score: all five briefs timed out, so the overall covers five suites