Skip to main content

← Dracon Bench leaderboard

Model guide · Dracon Bench

nemotron-3-nano-omni-30b-a3b-reasoning

Tested First seen 2026-11-18 (first probed by us) · First tested 2026-11-18 · NVIDIA NIM free endpoint (integrate.api.nvidia.com/v1)

Nemotron 3 Nano Omni on NIM: IFEval-50 90%, IFBench 60%, GSM8K 80%, JSON 5/5, MMLU-Pro 2/10, and SVG 66/200 from four admissible artifacts. Overall 63.8 across six suites, rank 12. The OpenRouter free row for the same model is a separate serving lane and its numbers differ. Pilot depth: 10 prompts per text suite and the 5 SVG briefs; every suite prints its own n and not_delivered.

Rank
#12
Overall
63.8
Suites
6 of 6
Ranked
#12 of 21

When the world heard about it

Timeline

  1. First reachable for us 2026-11-18 our first probe
  2. First tested by us 2026-11-18 Dracon Bench
  3. Officially announced 2026-04-28 models.dev
  4. First official benchmark not recorded no source lists it
  • Reachable before we scored it same day
  • Announced before it reached the lane we served 204 days

Track A · script-scored subsets

Scores

Subset scores for nemotron-3-nano-omni-30b-a3b-reasoning.
SuiteScoreSamplePrecision
IFEval-50 prompt-strict90.0%9/10 prompts59.6%–98.2%
IFEval-50 instruction-strict82.3%14/17 constraints59.0%–93.8%
IFBench-50 prompt-strict60.0%6/10 prompts31.3%–83.2%
IFBench-50 instruction-strict63.6%7/11 constraints35.4%–84.8%
MMLU-Pro-5020.0%2/10 served5.7%–51.0%
JSON briefs conformance100.0%5/5 served56.6%–100.0%
GSM8K-5080.0%8/10 served49.0%–94.3%
SVG blind rubric66/200blind rubricjudge band ±8.3 pts

The range beside a script-scored figure is a 95% interval over that figure's own sample: the prompts it followed, the constraints it met, or the items it answered. The instruction-strict figures are measured over CONSTRAINTS, which is why their sample line counts constraints rather than prompts. The judged total is not a proportion, so it has no interval: it carries the measured judge band instead: how far a re-judging of the same artifacts moved them, which is a different kind of number. The method page says what each one covers and what it does not.

Track A · per-type breakdown

What it failed

The instruction types these two suites check, and the checks the model missed. A type is checked once per prompt that carries it, so a type with seven checks was asked for seven times. The counts beside a type are that type's own; the suite's totals are in the scores table above. These are the failures behind the instruction-strict figure, which is the sum of them.

IFEval-50

Missed at least one check in 2 of the 15 instruction types checked.

The instruction types 2 of 15 the IFEval-50 suite checked that nvidia/nemotron-3-nano-omni-30b-a3b-reasoning missed, most missed first.
Instruction typeChecksMissed
startend · quotation22
length constraints · number words11

IFBench-50

Missed at least one check in 2 of the 8 verifiers checked.

The verifiers 2 of 8 the IFBench-50 suite checked that nvidia/nemotron-3-nano-omni-30b-a3b-reasoning missed, most missed first.
VerifierChecksMissed
count · unique word count33
words · keywords specific position11

Provider-reported usage

Thinking cost

What the run cost the model in thinking: provider-reported completion tokens per prompt, the thinking share, and the cost per correct answer. Reasoning-heavy models can exhaust fixed budgets before answering.

Thinking cost for nemotron-3-nano-omni-30b-a3b-reasoning.
SuiteCostReading
IFEval-501,035/prompt64% thinking· 1,035/correct
GSM8K-50393/prompt69% thinking· 491/correct

Track B · blind-judged

Artifacts

Blind-judged by nvidia/nemotron-3.5-super-vl:free: the judge saw the brief and the rendered image only, never the model name. Briefs are frozen; expand one to read it.

beach

18/50
Judge reasoning
Brief fidelity (3/10)
The sun, sea, sand, sailboat, birds, and a palm-like silhouette are present, but the two dolphins are entirely missing and the shimmering reflection path is reduced to a single vertical streak, so headline elements are absent and the score is capped.
Construction (4/10)
All visible objects are simple geometric silhouettes with no melted or duplicated parts, but they are highly abstract and lack anatomical or structural detail.
Composition (4/10)
The layout places the sun centrally, the tree on the left, and the boat on the right with a clear horizon and sandy foreground, yet the scene is flat with no atmospheric perspective or sense of depth.
Detail finish (3/10)
There are no textures, shimmering water details, dolphin forms, or distinct starfish features; the finish is minimal and the shapes are cut off at the frame edges in places.
Visual appeal (4/10)
The warm-to-teal gradient is coherent and the minimalist style has some charm, but it does not read as a beautiful, finished sunset beach scene.
Brief

Draw a beautiful sunset beach scene: a large sun sitting low over the sea with a shimmering reflection path on the water, a leaning palm tree silhouette on the left, two dolphins arcing out of the waves, a small sailboat on the right, birds in the sky, sandy foreground with a starfish. Warm oranges and pinks fading to teal. Coherent perspective: distant objects smaller and hazier than near ones. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

clock

unjudged

no svg

Brief

Draw a round wall clock face showing exactly 10:10: a circular dial with all 12 hour numerals in the correct positions, minute tick marks, an hour hand pointing just past 10, a minute hand pointing exactly at 2, and a thin second hand pointing at 6. The word DRACON in small capitals under the center. Dark rim, light face, flat vector style, centered composition. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

duo

17/50
Judge reasoning
Brief fidelity (3/10)
The raccoon, handlebars, driving pose, leaning turn, and second character acting are missing; only a single brown figure sits on a cyan jet-ski shape, so headline elements are absent and this criterion is capped.
Construction (3/10)
Bodies are primitive blobs and stick legs with no faces, paws, or handlebars; the jet ski is a flat rectangle and no raccoon is visible, so assembly is extremely rudimentary.
Composition (4/10)
Subjects are tiny and clustered at the bottom center with vast empty sky above; the layout is balanced but lacks perspective, scale, and dynamic framing for a speeding turn.
Detail finish (3/10)
Flat colors with no shading or texture; only minimal spray lines are present, and key brief details like handlebars, facial features, and the raccoon are absent.
Visual appeal (4/10)
The bright, coherent cartoon palette and simple outlines have a naive charm, but the scene is static, underpopulated, and fails to convey the requested comical energy.
Brief

Draw a comical scene: a dog driving a jet ski at speed, paws on the handlebars, with a raccoon riding behind holding on, both leaning into a turn. Sea spray behind the jet ski, sun and clouds in the sky, a distant shoreline. Both characters must be clearly doing something, not just posed side by side. Bright cartoon vector style. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

monalisa

14/50
Judge reasoning
Brief fidelity (2/10)
The image lacks nearly all requested elements: no three-quarter view, no detailed dress or neckline, no folded hands, no parted hair, and only a suggestion of landscape rather than a hazy scene with bridge and blue mountains.
Construction (3/10)
The figure is assembled from a circle head and rectangular body with no anatomical hands, facial structure, or dress details; shapes are primitive rather than constructed.
Composition (4/10)
The subject is centered with layered background mountains and a foreground river, but proportions are poor (oversized head, tiny body) and the frame feels empty.
Detail finish (2/10)
There is no shading, texture, neckline detail, or small touches from the brief; the artwork is extremely minimal with clean but bare markup.
Visual appeal (3/10)
The muted green, brown, and blue palette is coherent, but the illustration is too abstract and simplistic to read as a Mona Lisa portrait or hold visual charm.
Brief

Redraw the Mona Lisa as a flat vector portrait, bust composition: a seated woman in three-quarter view facing the viewer, dark dress with neckline detail, hands folded at the bottom edge, soft enigmatic smile, hair parted in the middle. Behind her a hazy landscape with a winding river, a bridge on the right, and blue mountains. Muted greens, browns, and smoky blues. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

pelican

17/50
Judge reasoning
Brief fidelity (3/10)
The sky, sea horizon, and flat ground match the brief, but the pelican itself is an unrecognizable brown blob with no clear side profile, long neck, throat pouch, or webbed feet, so the headline subject is effectively missing.
Construction (2/10)
The bird is assembled from abstract, melted polygons rather than coherent anatomical parts; there is no distinct head, neck, body, wing, or feet.
Composition (4/10)
The horizon and ground bands are sensibly placed in the lower third, but the subject is tiny, centrally lost, and lacks clear perspective or focal presence.
Detail finish (4/10)
The flat vector style and limited palette are clean with no cut-off edges, but the brief's required details, pouch, webbed feet, folded wing, are absent.
Visual appeal (4/10)
The color palette is coherent and calm, but the unrecognizable subject and lack of confident linework or charm keep it from being appealing.
Brief

Draw a brown pelican standing in side profile, facing left, full body visible: large beak with throat pouch, long neck, folded wing, webbed feet on flat ground. Simple sky background with a hint of sea on the horizon. Flat vector style, clean shapes, limited palette. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

Head to head

Compare with

Run record

Evidence and notes

  • NVIDIA NIM free endpoint (integrate.api.nvidia.com/v1); distinct from the OpenRouter free row
  • GSM8K 80% is the strongest text suite on this row
  • MMLU-Pro 2/10 and one non-admissible SVG brief pull the overall down