nvidia/nemotron-3-ultra-550b-a55b:free

Tested First tested 2026-11-09 · OpenRouter free lane

NVIDIA's 550B-class Ultra is the spike's reference model: the established name tested alongside the lesser-known ones. SVG total 150/250 leads the board. GSM8K-50 78.0% zero-shot against 88.1% vendor eight-shot chain-of-thought on the base model, lower as expected for zero-shot.

Scores

Suite	Score
IFEval-50 prompt-strict	85.7% (n=42)
IFEval-50 instruction-strict	90.8% (n=42)
GSM8K-50	78.0% (39/50)
SVG blind rubric	150/250

Artifacts

Blind-judged by nvidia/nemotron-3.5-super-vl:free: the judge saw the brief and the rendered image only, never the model name. Briefs are frozen; expand one to read it.

beach · 19/50

Brief fidelity (4/10): Sun, sailboat, birds, sand, and starfish are present, but the leaning palm tree, shimmering reflection path, and two arcing dolphins are missing or unrecognizable, triggering the headline-element cap.
Construction (3/10): Objects are crude geometric blobs; the left silhouette does not read as a palm tree, the two dark crescents do not read as dolphins, and the sailboat is a simple triangle with no assembled detail.
Composition (5/10): The frame is horizontally divided with a centered sun and left/right accents, but there is no atmospheric perspective, size scaling, or depth to suggest distant versus near objects.
Detail finish (3/10): The sky gradient is smooth, but there are no textures, shading beyond the sun's glow, or small finishing touches; edges are simple and unrefined.
Visual appeal (4/10): The warm orange-pink-teal palette is pleasant, but the confusing left silhouette, empty water, and minimalist execution keep it from being charming or confident.

Brief

Draw a beautiful sunset beach scene: a large sun sitting low over the sea with a shimmering reflection path on the water, a leaning palm tree silhouette on the left, two dolphins arcing out of the waves, a small sailboat on the right, birds in the sky, sandy foreground with a starfish. Warm oranges and pinks fading to teal. Coherent perspective: distant objects smaller and hazier than near ones. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

clock · 26/50

Brief fidelity (3/10): Missing the required thin second hand at 6, and the center word reads 'DRAG ON' rather than 'DRACON', with several numerals garbled, so key headline elements are absent or incorrect.
Construction (5/10): The circular dial and two main hands are assembled cleanly, but duplicated or malformed glyphs such as '612', '62', and '∞' indicate flawed text construction.
Composition (8/10): The clock is well-centered with a dark rim and light face that fill the frame appropriately in a balanced, symmetrical layout.
Detail finish (4/10): Minute tick marks are present, but the missing second hand, stray red dot at 12 o'clock, and misspelled brand word leave the finish incomplete.
Visual appeal (6/10): The high-contrast flat vector style is coherent and confident, but the text errors and missing hand reduce its overall charm.

Brief

Draw a round wall clock face showing exactly 10:10: a circular dial with all 12 hour numerals in the correct positions, minute tick marks, an hour hand pointing just past 10, a minute hand pointing exactly at 2, and a thin second hand pointing at 6. The word DRACON in small capitals under the center. Dark rim, light face, flat vector style, centered composition. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

duo · 31/50

Brief fidelity (4/10): The dog, raccoon, sun, clouds, shoreline, and spray are present, but the vehicle is a surfboard-like shape with no handlebars and no visible paws on controls, so headline elements are missing and this criterion is capped at 4.
Construction (7/10): Both characters have recognizable, assembled cartoon anatomy with ears, eyes, snouts, and a tail; the red craft is a simple but coherent shape with no melted or duplicated parts.
Composition (7/10): The horizon and sky/water split frame the scene effectively, with the duo placed low-center for readability, though the composition is somewhat flat and the characters are small relative to the frame.
Detail finish (6/10): The image includes small touches like spray dots, clouds, and a distant shore, but relies mostly on flat color with minimal shading or texture, and no broken or cut-off elements are visible.
Visual appeal (7/10): The palette is coherent and cheerful, the linework is clean and confident, and the dog-and-raccoon pairing has clear charm despite the simplicity.

Brief

Draw a comical scene: a dog driving a jet ski at speed, paws on the handlebars, with a raccoon riding behind holding on, both leaning into a turn. Sea spray behind the jet ski, sun and clouds in the sky, a distant shoreline. Both characters must be clearly doing something, not just posed side by side. Bright cartoon vector style. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

monalisa · 34/50

Brief fidelity (7/10): All headline subjects from the brief are present, the seated woman, dark dress, enigmatic smile, middle-parted hair, and background landscape with river, bridge, and mountains, though details like neckline trim and folded hands are minimally rendered.
Construction (6/10): The figure is constructed from clean geometric primitives rather than realistic anatomy, appearing intentionally stylized and assembled without melted or duplicated parts.
Composition (8/10): The bust is centered and occupies the frame effectively, with the winding river and bridge on the right balancing the composition against the hazy blue mountains.
Detail finish (6/10): The SVG uses flat colors and clean vector edges with no visible broken markup, but it lacks shading, textures, or fine finishing touches beyond the basic shapes.
Visual appeal (7/10): The coherent muted palette of greens, browns, and smoky blues combined with confident minimalist linework creates a charming and visually cohesive flat portrait.

Brief

Redraw the Mona Lisa as a flat vector portrait, bust composition: a seated woman in three-quarter view facing the viewer, dark dress with neckline detail, hands folded at the bottom edge, soft enigmatic smile, hair parted in the middle. Behind her a hazy landscape with a winding river, a bridge on the right, and blue mountains. Muted greens, browns, and smoky blues. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

pelican · 40/50

Brief fidelity (9/10): All requested headline elements are present: brown pelican in left-facing side profile, full body, large beak with visible throat pouch, long neck, folded wing shape, webbed feet on flat ground, and a simple sky/sea/horizon background in flat vector style.
Construction (8/10): The bird is assembled from clean, distinct shapes, head, neck, body, wing, beak, pouch, eye, and feet, with no melted, duplicated, or broken anatomy.
Composition (8/10): The pelican is well-placed within the 800x600 frame with a clear horizon dividing sky, sea, and ground; relative sizes are appropriate for a flat side-profile illustration.
Detail finish (7/10): Small finishing touches include the eye, colored beak, pink pouch, and splayed webbed toes, though shading and texture are minimal by design; no cut-off edges or stray shapes are visible.
Visual appeal (8/10): The limited palette of brown, tan, blue, yellow, and pink is coherent and charming, with confident flat vector linework that reads clearly as a stylized pelican.

Brief

Draw a brown pelican standing in side profile, facing left, full body visible: large beak with throat pouch, long neck, folded wing, webbed feet on flat ground. Simple sky background with a hint of sea on the horizon. Flat vector style, clean shapes, limited palette. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

Compare with

Evidence and notes

Vendor GSM8K 88.10 (eight-shot chain-of-thought, base model card, Hugging Face)
8 IFEval prompts unrecoverable under the token budget, counted as failures