TestedFirst seen 2026-10-15 (listed on the provider) · First tested 2026-11-17 · OpenRouter free lane
Nemotron 3.5 Super VL is seventh on the board (66.1 overall) after the NIM additions and also serves as the frozen benchmark’s pinned SVG judge. IFEval and IFBench both land at 80.0% (n=10); its 113/200 SVG total is self-judged and should be read as a sanity check, not an independent verdict.
Rank
#7
Overall
66.1
Suites
6 of 6
Ranked
#7 of 21
When the world heard about it
Timeline
First seen on the provider2026-10-15the provider's own catalogue
First tested by us2026-11-17Dracon Bench
Officially announced2026-10-15models.dev
First official benchmark2026-11-19the provider's benchmarks block: a public score existed by then — the first day we saw one
Reachable before we scored it33 days
Reachable before the vendor announced itsame day
A public score existed within35 days
Track A · script-scored subsets
Scores
Subset scores for nemotron-3.5-super-vl.
Suite
Score
Sample
Precision
IFEval-50 prompt-strict
80.0%
8/10 prompts
49.0%–94.3%
IFEval-50 instruction-strict
70.6%
12/17 constraints
46.9%–86.7%
IFBench-50 prompt-strict
80.0%
8/10 prompts
49.0%–94.3%
IFBench-50 instruction-strict
81.8%
9/11 constraints
52.3%–94.9%
MMLU-Pro-50
20.0%
2/10 served
5.7%–51.0%
JSON briefs conformance
100.0%
5/5 served
56.6%–100.0%
GSM8K-50
60.0%
6/10 served
31.3%–83.2%
SVG blind rubric
113/200
blind rubric
judge band ±8.3 pts
The range beside a script-scored figure is a 95% interval over that
figure's own sample: the prompts it followed, the constraints it
met, or the items it answered. The instruction-strict figures are
measured over CONSTRAINTS, which is why their sample line counts
constraints rather than prompts. The judged total is not a
proportion, so it has no interval: it carries the measured judge
band instead: how far a re-judging of the same artifacts moved
them, which is a different kind of number. The method page says
what each one covers and what it does not.
Track A · per-type breakdown
What it failed
The instruction types these two suites check, and the checks the model
missed. A type is checked once per prompt that carries it, so a type
with seven checks was asked for seven times. The counts beside a type
are that type's own; the suite's totals are in the scores table above.
These are the failures behind the instruction-strict figure, which is
the sum of them.
IFEval-50
Missed at least one check in 4 of the 15
instruction types checked.
The instruction types 4 of 15 the
IFEval-50 suite checked that nvidia/nemotron-3.5-super-vl:free missed, most missed first.
Instruction type
Checks
Missed
startend · quotation
2
2
change case · capital word frequency
1
1
length constraints · number words
1
1
punctuation · no comma
2
1
IFBench-50
Missed at least one check in 2 of the 8
verifiers checked.
The verifiers 2 of 8 the
IFBench-50 suite checked that nvidia/nemotron-3.5-super-vl:free missed, most missed first.
Verifier
Checks
Missed
count · unique word count
3
1
words · words position
1
1
Provider-reported usage
Thinking cost
What the run cost the model in thinking: provider-reported completion
tokens per prompt, the thinking share, and the cost per correct answer.
Reasoning-heavy models can exhaust fixed budgets before answering.
Thinking cost for nemotron-3.5-super-vl.
Suite
Cost
Reading
IFEval-50
1,329/prompt
57%
thinking· 1,329/correct
GSM8K-50
510/prompt
75%
thinking· 850/correct
Track B · blind-judged
Artifacts
Blind-judged by nvidia/nemotron-3.5-super-vl:free: the judge saw
the brief and the rendered image only, never the model name. Briefs
are frozen; expand one to read it.
beach
20/50Judge reasoning
Brief fidelity (4/10)
Sun, sailboat, birds, starfish, and gradient sky appear, but the two dolphins are entirely absent and the left silhouette is a spiky pole rather than a leaning palm tree, triggering the missing-headline-elements cap.
Construction (4/10)
Objects are simple flat shapes that read as assembled rather than melted, but the palm silhouette is anatomically nonsensical and the central water mounds are amorphous blobs with no defined form.
Composition (5/10)
The frame divides into sky, sea, and sand with a centered sun and right-placed sailboat, yet the oversized left pole and central black mounds create an awkward layout with weak atmospheric perspective.
Detail finish (3/10)
The image relies on flat fills with minimal shading, a basic gradient reflection path, and a simple diamond starfish, lacking textures, small touches, or refined finishing.
Visual appeal (4/10)
The warm-to-cool palette is coherent and the bold silhouettes are confident, but the scene feels sparse, crude, and underdeveloped relative to the rich brief.
Brief
Draw a beautiful sunset beach scene: a large sun sitting low over the sea
with a shimmering reflection path on the water, a leaning palm tree
silhouette on the left, two dolphins arcing out of the waves, a small
sailboat on the right, birds in the sky, sandy foreground with a starfish.
Warm oranges and pinks fading to teal. Coherent perspective: distant
objects smaller and hazier than near ones.
Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external
references) inside a single ```svg fenced block. Short prose outside the
fence is allowed.
clock
48/50Judge reasoning
Brief fidelity (9/10)
All requested elements are present: 12 numerals, tick marks, hands at 10:10 with second hand at 6, and DRACON text, though the hour hand points exactly at 10 rather than just past it.
Construction (10/10)
The clock face, numerals, hands, and tick marks are cleanly assembled with no melted, duplicated, or misaligned parts.
Composition (10/10)
The clock is perfectly centered with balanced proportions and appropriate use of the 800x600 frame.
Detail finish (10/10)
Clean flat vector execution with sharp linework, legible small capitals, and no broken markup or cut-off edges.
Visual appeal (9/10)
High-contrast black-and-white palette is coherent and confident, though the stark minimalism offers limited charm.
Brief
Draw a round wall clock face showing exactly 10:10: a circular dial with
all 12 hour numerals in the correct positions, minute tick marks, an hour
hand pointing just past 10, a minute hand pointing exactly at 2, and a thin
second hand pointing at 6. The word DRACON in small capitals under the
center. Dark rim, light face, flat vector style, centered composition.
Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external
references) inside a single ```svg fenced block. Short prose outside the
fence is allowed.
duo
unjudged
no svg
Brief
Draw a comical scene: a dog driving a jet ski at speed, paws on the
handlebars, with a raccoon riding behind holding on, both leaning into a
turn. Sea spray behind the jet ski, sun and clouds in the sky, a distant
shoreline. Both characters must be clearly doing something, not just
posed side by side. Bright cartoon vector style.
Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external
references) inside a single ```svg fenced block. Short prose outside the
fence is allowed.
monalisa
15/50Judge reasoning
Brief fidelity (2/10)
The image lacks a recognizable seated woman, three-quarter face, folded hands, parted hair, or winding river, containing only abstract geometric shapes that barely suggest the requested portrait.
Construction (2/10)
Anatomy is reduced to a brown blob with a triangle nose and two ovals, with no assembled body, face, or hand structure visible.
Composition (4/10)
The layout centers a large head above a small body on a green field, using the frame but with distorted relative sizes and flat perspective.
Detail finish (3/10)
The artwork is flat with minimal detail, no shading or textures, and no evident broken markup or cut-off edges.
Visual appeal (4/10)
The muted green, brown, and blue palette is coherent, but the extreme abstraction and lack of likeness limit its charm and appeal.
Brief
Redraw the Mona Lisa as a flat vector portrait, bust composition: a seated
woman in three-quarter view facing the viewer, dark dress with neckline
detail, hands folded at the bottom edge, soft enigmatic smile, hair parted
in the middle. Behind her a hazy landscape with a winding river, a bridge
on the right, and blue mountains. Muted greens, browns, and smoky blues.
Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external
references) inside a single ```svg fenced block. Short prose outside the
fence is allowed.
pelican
30/50Judge reasoning
Brief fidelity (7/10)
The pelican, beak with pouch, long neck, folded wing shape, and horizon are present, but the feet are simple flat stumps rather than clearly webbed as requested.
Construction (6/10)
The figure is assembled from clean geometric primitives without melting or duplication, though proportions are stylized and the neck-to-body connection is simplistic.
Composition (6/10)
The pelican sits low in the frame facing left with a centered horizon and ample sky, using the frame adequately but with large empty areas.
Detail finish (5/10)
The artwork uses flat colors with a single darker wing shape and an eye dot, lacking shading, texture, or additional finishing touches.
Visual appeal (6/10)
The limited earthy and sky-blue palette is coherent and the clean vector style has modest charm, though the minimalism feels somewhat bare.
Brief
Draw a brown pelican standing in side profile, facing left, full body visible:
large beak with throat pouch, long neck, folded wing, webbed feet on flat
ground. Simple sky background with a hint of sea on the horizon. Flat vector
style, clean shapes, limited palette.
Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external
references) inside a single ```svg fenced block. Short prose outside the
fence is allowed.