Skip to main content

Dracon Bench

Our own competence probes for free AI models, run 2026-11-11 (suite 1.0, seed 20261109). Track A runs established subsets, script-scored. Track B collects SVG art from five frozen briefs, scored blind by a pinned judge with every artifact stored next to its score so you can audit each one.

Leaderboard

ModelIFEval-50 promptIFEval-50 instrGSM8K-50SVG total
cohere/north-mini-code:free91.8% (n=49)93.7% (n=49)80.0% (40/50)98/250
dots-studio/dots-3-note-preview:free86.1% (n=36)88.5% (n=36)92.0% (46/50)126/250
kilo-auto/free87.8% (n=49)91.0% (n=49)92.0% (46/50)145/250
liquid/lfm-2.5-2.6b:free87.8% (n=49)87.0% (n=49)74.0% (37/50)68/200
liquid/lfm-3-1.7b:free83.7% (n=49)89.6% (n=49)84.0% (42/50)10/50
nvidia/nemotron-3.5-lightning:free89.8% (n=49)93.7% (n=49)70.0% (35/50)55/250
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free89.8% (n=49)90.9% (n=49)78.0% (39/50)104/250
nvidia/nemotron-3-ultra-550b-a55b:free85.7% (n=42)90.8% (n=42)78.0% (39/50)150/250
opencode-go/beam-freen/an/a84.0% (42/50)pending
opencode-go/iceman-contributor-freen/an/a80.0% (40/50)pending
opencode-go/longcat-2.5-freen/an/a78.0% (39/50)pending
recursive/flint-v1.0:free93.3% (n=45)92.9% (n=45)88.1% (37/42)144/250
stealth/crouton-alpha83.3% (n=6)87.5% (n=6)n/apending

Method

Every model answers the same frozen prompts at temperature 0 with one fixed system prompt. IFEval-50 and GSM8K-50 are true subsets: sampled IDs and seed are published with the data, and subset scores are never presented as official full-dataset scores. Empty and refused responses count as failures, not retries.

The five art briefs are frozen text. The judge sees the brief and the rendered SVG only, never the model name, and runs at temperature 0 against a published 5-criterion rubric (brief fidelity, construction, composition, detail and finish, visual appeal). Judge for this run: nvidia/nemotron-3.5-super-vl:free, rubric 1.0.

Calibration: our IFEval-50 prompt-strict score for Flint (93.3%) lands within 2 points of the vendor-published full IFEval figure (95.1%), which is what a correct harness should do on a 50-prompt sample. Re-judging the same artifact moves ±5 points, so treat close SVG totals as ties and judge the images with your own eyes.

Efficiency

Completion tokens per prompt as reported by the provider, with the thinking share and the cost per correct answer. Reasoning-heavy models can exhaust fixed budgets before answering (see notes).

ModelIFEval-50 thinking costGSM8K-50 thinking cost
cohere/north-mini-code:free1,170/prompt (74% thinking) · 1,274/correct343/prompt (57% thinking) · 429/correct
dots-studio/dots-3-note-preview:free2,382/prompt (108% thinking) · 2,766/correct584/prompt (63% thinking) · 635/correct
kilo-auto/free4,131/prompt (103% thinking) · 4,707/correct511/prompt (56% thinking) · 556/correct
liquid/lfm-2.5-2.6b:free1,499/prompt (82% thinking) · 1,708/correct471/prompt (58% thinking) · 637/correct
liquid/lfm-3-1.7b:free2,667/prompt (89% thinking) · 3,188/correct687/prompt (77% thinking) · 818/correct
nvidia/nemotron-3.5-lightning:free2,453/prompt (84% thinking) · 2,732/correct680/prompt (79% thinking) · 972/correct
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free1,338/prompt (81% thinking) · 1,490/correct366/prompt (72% thinking) · 469/correct
nvidia/nemotron-3-ultra-550b-a55b:free1,741/prompt (84% thinking) · 2,031/correct408/prompt (63% thinking) · 523/correct
opencode-go/beam-freen/an/a
opencode-go/iceman-contributor-freen/an/a
opencode-go/longcat-2.5-freen/an/a
recursive/flint-v1.0:free1,164/prompt (88% thinking) · 1,247/correct565/prompt (82% thinking) · 641/correct
stealth/crouton-alpha313/prompt (9% thinking) · 375/correctn/a

Bench notes

  1. 2026-11-10 Spike run complete: 3 models, 2 suites, 15 SVG artifacts Flint, Dots 3 note preview, and Nemotron 3 Ultra finished IFEval-50, GSM8K-50, and the five SVG briefs. Verdicts by pinned judge nvidia/nemotron-3.5-super-vl:free, blind. Re-judging the same artifact moves about 5 points, so close SVG totals are ties.
  2. 2026-11-10 Crouton Alpha lane vanished mid-run OpenRouter started returning 404 (no provider serves this model anymore) four prompts in. 6 IFEval prompts banked at 83.3%, kept as partial results, never extrapolated. Later revealed as an early Muse Ember.
  3. 2026-11-10 Reasoning traces exhausted token budgets Free reasoning models burned 4k+ tokens in thinking traces before answering, returning empty content with finish_reason=length. Budgets raised (IFEval 4096, GSM8K 2048, SVG 16384) and failures retried; unrecoverable empties count as failures. See the efficiency table for per-model thinking cost.
  4. 2026-11-10 Longcat via OpenCode Go paused on 429 cooldown Longcat 2.5 (OpenCode Go free previews) answers GSM8K cleanly but hit a 429 with a 6+ hour cooldown after 3 prompts. Run resumes automatically. IFEval and SVG are not run for it: the agent harness breaks their comparability.
  5. 2026-11-10 Inkling free lane is geo-blocked here thinkingmachines/inkling-2-small:free answers 403 (not available in region) on every prompt, so it cannot join the board from this runner. lfm-2.5-2.6b:free probed healthy and is running the full suite instead.
  6. 2026-11-10 Google free lanes reject bench traffic Both Gemma free routes returned upstream 400s (invalid provider key) for every prompt, so no Gemma model is in the spike. Recorded here so the gap reads as vendor-side, not as an omission.
  7. 2026-11-11 LFM 3 1.7B: strong reasoning scores, SVG mostly unrecoverable liquid/lfm-3-1.7b:free scored IFEval-50 83.7% and GSM8K-50 84.0% but its reasoning traces burned whole 32k budgets on 4 of 5 SVG briefs (empty content, finish_reason=length). Only the pelican artifact completed (10/50). Unrecoverable prompts count as failures, never silently dropped.
  8. 2026-11-11 Nemotron 3.5 Lightning clock scored 0: script-drawn SVG nvidia/nemotron-3.5-lightning:free drew its clock with JavaScript (document.createElementNS) instead of static SVG shapes. Shipped artifacts are sanitised (no scripts), so the rendered image is blank and the blind judge scored 0/50. An independent render of the raw output confirms the script draws a clock when executed. Static-SVG-only is now the documented rule.
  9. 2026-11-11 Nano Omni reasoning: best-balanced free lane (89.8 / 78.0 / 104) nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free tied Lightning on IFEval-50 (89.8%), beat it on GSM8K-50 (78.0% vs 70.0%) and SVG (104 vs 55). Fast lane, 1 unrecoverable prompt. Small reasoning models are overperforming their size class on this board.
  10. 2026-11-11 North Mini Code takes the IFEval lead (91.8%) cohere/north-mini-code:free scored IFEval-50 91.8% with GSM8K-50 80.0% and SVG 98/250, including the best single pelican (34/50) so far. The code model first answered the clock brief with 20k characters of Python instead of SVG; pruned and redone at 32k per precedent. 1 IFEval prompt unrecoverable, counted as failure.
  11. 2026-11-11 Kilo Auto anonymous limit stopped collection mid-run kilo-auto/free hit PROMOTION_MODEL_LIMIT_REACHED after GSM8K-50 (92.0%) and 34 IFEval prompts (91.2%): 16 IFEval + monalisa/pelican are outstanding. Published as partial per the crouton precedent. Resumes when the window resets; a free Kilo account would raise the ceiling.
  12. 2026-11-11 opencode-go exclusives join the board GSM8K-only (beam 84.0, iceman 80.0) opencode-go/beam-free scored GSM8K-50 84.0% and opencode-go/iceman-contributor-free 80.0%, both 50/50 with zero failures through the OpenCode agent harness. Harness numbers are not strictly comparable with direct-prompted lanes; IFEval and SVG stay unrunnable for these models by the documented harness policy.
  13. 2026-11-11 Kilo Auto completes: 87.8 / 92.0 / 145, best clock on the board kilo-auto/free finished all three suites after the anonymous window reset: IFEval-50 87.8% (1 AtlasCloud 400, counted as failure), GSM8K-50 92.0%, SVG 145/250 with the best clock (43/50) yet. Partial status lifted. The router answered probes via dots-3-note-preview on AtlasCloud.

beach

Sun low over water with a reflection path; distant objects smaller and hazier than near ones.

Brief

Draw a beautiful sunset beach scene: a large sun sitting low over the sea with a shimmering reflection path on the water, a leaning palm tree silhouette on the left, two dolphins arcing out of the waves, a small sailboat on the right, birds in the sky, sandy foreground with a starfish. Warm oranges and pinks fading to teal. Coherent perspective: distant objects smaller and hazier than near ones. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

cohere/north-mini-code:free

15/50

Brief fidelity (3/10)
Most requested subjects are missing or unrecognizable: no palm tree, dolphins, sailboat, birds, or starfish are clearly depicted; only the sun, sea, and sky are present.
Construction (3/10)
Objects are reduced to primitive geometric shapes (diamonds, circles, X, curves) with no anatomical assembly or recognizable object parts.
Composition (4/10)
The frame uses a clear horizon and places the sun low on the right, but perspective and relative sizes are not coherent and elements feel scattered.
Detail finish (2/10)
The image is extremely sparse with no shading, textures, or small finishing touches; it reads as an unfinished sketch rather than a detailed illustration.
Visual appeal (3/10)
The warm-to-teal gradient is pleasant, but the excessive abstraction and lack of detail keep it from being visually compelling or charming.

dots-studio/dots-3-note-preview:free

24/50

Brief fidelity (4/10)
Most requested elements are present (sun, reflection, palm, sailboat, birds, starfish, sand), but the two dolphins arcing from waves are missing, the black ovals do not read as dolphins, so the missing-headline-element cap applies.
Construction (5/10)
Shapes are simple silhouettes and primitives rather than assembled anatomy; the palm and boat read clearly, but the dolphin shapes are just featureless ovals and nothing appears melted or duplicated.
Composition (5/10)
The layout is balanced with the sun centered, palm left, and boat right, but perspective is flat with no atmospheric haze or size-based depth for distant objects.
Detail finish (4/10)
The sky gradient and solar glow are pleasant, but the water is flat teal, the reflection is a simple vertical gradient without shimmer texture, and small touches are minimal.
Visual appeal (6/10)
The warm orange-pink-to-teal palette is coherent and the minimalist style has some charm, but the overall image is quite basic and lacks confident detail.

kilo-auto/free

30/50

Brief fidelity (6/10)
All headline subjects are present, sun, reflection path, leaning palm, two dolphin shapes, sailboat, birds, starfish, and sand, but the dolphins are abstract ovals rather than arcing figures and the sailboat is minimal.
Construction (6/10)
Shapes are cleanly assembled vector forms with no melting or duplication, though the dolphins and sailboat lack anatomical or structural detail.
Composition (7/10)
Clear horizontal zones of sky, sea, and sand with the palm left, sun center, sailboat right, and starfish in the foreground; perspective is basic but coherent.
Detail finish (5/10)
The gradient sky and sun glow provide atmosphere, but there are no textures, wave details, or shimmering effects; no broken markup or cut-off edges are visible.
Visual appeal (6/10)
The warm-to-cool gradient palette is pleasing and the linework is confident, but extreme minimalism limits charm and visual impact.

liquid/lfm-2.5-2.6b:free

15/50

Brief fidelity (3/10)
Most headline elements are missing or unrecognizable, no dolphins, birds, clear sailboat, or starfish are visible, and the palm tree and reflection path are merely abstract blobs.
Construction (3/10)
The shapes are primitive and melted rather than assembled, with the palm tree resembling a green blob and the sailboat reduced to a black polygon.
Composition (4/10)
The layout places the sun and horizon acceptably but lacks coherent perspective, relative sizing, and clear foreground/midground separation.
Detail finish (2/10)
The image uses flat colors with no shading, textures, or small touches, and the elements appear unresolved at the edges.
Visual appeal (3/10)
While the warm palette is pleasant, the scene is too abstract and incomplete to read as a charming or confident beach illustration.

liquid/lfm-3-1.7b:free

unjudged

no svg

nvidia/nemotron-3.5-lightning:free

21/50

Brief fidelity (3/10)
Most headline elements are missing or unrecognizable: no dolphins, birds, clear sailboat, shimmering reflection path, or leaning palm silhouette, with only the sun and sandy foreground present.
Construction (6/10)
Shapes are simple geometric primitives (circular sun, rectangular trunk, semi-circle clouds) that are cleanly assembled without melting, duplication, or broken anatomy.
Composition (4/10)
The layout places the sun right and palm left with a flat horizon, but the frame feels empty and lacks convincing depth, relative scaling, or atmospheric perspective.
Detail finish (3/10)
The image is extremely minimal with no shading beyond the sky gradient, missing textures and small touches, and the palm trunk is cut off by the left edge.
Visual appeal (5/10)
The warm orange-to-teal palette is pleasant, but the sparse, abstract execution lacks charm and fails to evoke the requested sunset beach scene.

nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free

17/50

Brief fidelity (3/10)
Sun, reflection, sand, and gradient appear, but the palm tree, dolphins, birds, sailboat, and starfish are absent or illegible, missing multiple headline elements.
Construction (5/10)
Every element is a clean geometric primitive with no melted anatomy, duplicated parts, or assembly errors.
Composition (3/10)
The oversized centered sun overwhelms a nearly empty frame with scattered, undersized elements and no clear depth hierarchy.
Detail finish (2/10)
The image lacks textures, meaningful shading, and brief-specific small touches, and contains stray dark square artifacts in the sky.
Visual appeal (4/10)
The smooth warm-to-cool sky gradient is attractive, but the extreme minimalism and missing subjects prevent it from satisfying as a beach scene.

nvidia/nemotron-3-ultra-550b-a55b:free

19/50

Brief fidelity (4/10)
Sun, sailboat, birds, sand, and starfish are present, but the leaning palm tree, shimmering reflection path, and two arcing dolphins are missing or unrecognizable, triggering the headline-element cap.
Construction (3/10)
Objects are crude geometric blobs; the left silhouette does not read as a palm tree, the two dark crescents do not read as dolphins, and the sailboat is a simple triangle with no assembled detail.
Composition (5/10)
The frame is horizontally divided with a centered sun and left/right accents, but there is no atmospheric perspective, size scaling, or depth to suggest distant versus near objects.
Detail finish (3/10)
The sky gradient is smooth, but there are no textures, shading beyond the sun's glow, or small finishing touches; edges are simple and unrefined.
Visual appeal (4/10)
The warm orange-pink-teal palette is pleasant, but the confusing left silhouette, empty water, and minimalist execution keep it from being charming or confident.

opencode-go/beam-free

unjudged

no svg

opencode-go/iceman-contributor-free

unjudged

no svg

opencode-go/longcat-2.5-free

unjudged

no svg

recursive/flint-v1.0:free

31/50

Brief fidelity (4/10)
Missing the two dolphins entirely and the starfish is only a tiny abstract mark, so headline elements are absent, capping fidelity at 4.
Construction (7/10)
All visible objects are simple geometric or silhouette shapes that are cleanly assembled with no anatomical errors or melted forms.
Composition (8/10)
The palm anchors the left, the sun centers the horizon, the boat balances the right, and atmospheric perspective is respected with distant haze and near foreground.
Detail finish (5/10)
The scene is flat and minimal with a reflection path and birds, but lacks textures, shading, and a recognizable starfish.
Visual appeal (7/10)
The warm-to-teal gradient and confident silhouettes create a pleasant, if simple, postcard-like charm.

stealth/crouton-alpha

unjudged

no svg

clock

A clock is checkable to the minute: 10:10 means the hour hand just past 10, the minute hand on 2.

Brief

Draw a round wall clock face showing exactly 10:10: a circular dial with all 12 hour numerals in the correct positions, minute tick marks, an hour hand pointing just past 10, a minute hand pointing exactly at 2, and a thin second hand pointing at 6. The word DRACON in small capitals under the center. Dark rim, light face, flat vector style, centered composition. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

cohere/north-mini-code:free

19/50

12 1 . . . (continue for all 12 numerals, minute tick marks, hands, and DRACON text as described)
Brief fidelity (2/10)
Only the circular rim and two numerals (12 and 1) are present; all hands, most numerals, tick marks, and the DRACON text are missing.
Construction (5/10)
The visible circle and numerals are geometrically simple and intact, but the drawing is skeletal with no hands or additional parts to assemble.
Composition (5/10)
The dial is roughly centered but sits high in the frame with large empty space below, and the missing elements leave the composition unbalanced.
Detail finish (3/10)
No broken markup is evident, but the brief's required details, hands, ticks, and branding, are entirely absent.
Visual appeal (4/10)
The stark black-and-white palette is coherent, but the near-empty clock face lacks charm or visual interest.

dots-studio/dots-3-note-preview:free

43/50

12 1 2 3 4 5 6 7 8 9 10 11 DRACON
Brief fidelity (9/10)
All requested elements are present: 12 ordered numerals, minute tick marks, hour hand near 10, minute hand at 2, red second hand at 6, and DRACON text under the center, though the hour hand is not distinctly 'just past' 10.
Construction (9/10)
The clock face, hands, and numerals are cleanly assembled vector shapes with no melting, duplication, or structural errors.
Composition (9/10)
The clock is perfectly centered within the 800x600 frame with balanced proportions between the dark rim, light face, and internal elements.
Detail finish (8/10)
Flat vector execution includes a dotted minute track, contrasting red second hand, and legible DRACON lettering with no broken edges or stray shapes.
Visual appeal (8/10)
The minimal black, off-white, and red palette is coherent and confident, producing a clean, functional, and charming clock illustration.

kilo-auto/free

43/50

12 1 2 3 4 5 6 7 8 9 10 11 DRACON
Brief fidelity (9/10)
All requested elements are present: 12 ordered numerals, minute tick marks, hour hand near 10, minute hand at 2, thin red second hand at 6, DRACON text under center, dark rim, light face, and centered composition.
Construction (9/10)
Geometric shapes are clean and assembled correctly; hands meet at a single center point, numerals are legible, and nothing appears melted, melted, or duplicated.
Composition (9/10)
The clock is centered with balanced proportions; the dark rim frames the face well and numerals are evenly spaced around the dial within the 800x600 frame.
Detail finish (8/10)
Flat vector style is consistent with the brief; the red second hand and small-capitals text add finishing touches, with no visible broken markup or cut-off edges.
Visual appeal (8/10)
The palette of dark gray, off-white, black, and red accent is coherent and confident; the minimalist design is clean and effective.

liquid/lfm-2.5-2.6b:free

unjudged

no svg

liquid/lfm-3-1.7b:free

unjudged

no svg

nvidia/nemotron-3.5-lightning:free

0/50

Brief fidelity (0/10)
The rendered image is completely blank; none of the requested clock face, numerals, hands, or DRACON text are present.
Construction (0/10)
There are no assembled shapes, hands, or object parts visible in the empty frame.
Composition (0/10)
The composition is an empty white canvas with no layout, framing, or centered elements.
Detail finish (0/10)
No detail, shading, or finish is present; the image contains no visible SVG content at all.
Visual appeal (0/10)
A blank white image has no coherent palette, linework, or charm and would not be considered good.

nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free

31/50

12 1 2 3 4 5 6 7 8 9 10 11 DRACON
Brief fidelity (4/10)
The clock shows 10:10 with correct hand positions and a dark rim on a light face, but all 12 numerals are missing and DRACON is placed at the center rather than under it, capping fidelity at 4.
Construction (7/10)
The circular dial, three hands, and rim are cleanly assembled as vector shapes with no melted or duplicated parts, though the center text overlaps the pivot.
Composition (8/10)
The clock is centered and fills the frame well with balanced negative space around the dial.
Detail finish (5/10)
Minute tick marks and a thin second hand are present, but the absence of numerals, missing shading, and misplaced center text leave the finish sparse.
Visual appeal (7/10)
The minimal black-and-gray palette and confident linework give it a clean, flat-vector charm despite its simplicity.

nvidia/nemotron-3-ultra-550b-a55b:free

26/50

12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 drac on
Brief fidelity (3/10)
Missing the required thin second hand at 6, and the center word reads 'DRAG ON' rather than 'DRACON', with several numerals garbled, so key headline elements are absent or incorrect.
Construction (5/10)
The circular dial and two main hands are assembled cleanly, but duplicated or malformed glyphs such as '612', '62', and '∞' indicate flawed text construction.
Composition (8/10)
The clock is well-centered with a dark rim and light face that fill the frame appropriately in a balanced, symmetrical layout.
Detail finish (4/10)
Minute tick marks are present, but the missing second hand, stray red dot at 12 o'clock, and misspelled brand word leave the finish incomplete.
Visual appeal (6/10)
The high-contrast flat vector style is coherent and confident, but the text errors and missing hand reduce its overall charm.

opencode-go/beam-free

unjudged

no svg

opencode-go/iceman-contributor-free

unjudged

no svg

opencode-go/longcat-2.5-free

unjudged

no svg

recursive/flint-v1.0:free

37/50

12 1 2 3 4 5 6 7 8 9 10 11 DRACON
Brief fidelity (7/10)
The clock displays 10:10 with all 12 numerals correctly ordered and DRACON centered below, but the hour hand points directly at 10 rather than just past it, and the minute tick marks are rendered as an incomplete dotted pattern rather than clear marks around the dial.
Construction (9/10)
All clock components, the circular rim, face, numerals, and three hands, are cleanly assembled with no melted, duplicated, or malformed parts.
Composition (9/10)
The clock is perfectly centered within the 800x600 frame with balanced proportions between the dark rim, light face, and numeral placement.
Detail finish (5/10)
While the flat style is clean and the red second hand is a thoughtful accent, a stray dotted line extends beyond the clock face at bottom-right and the minute tick marks appear as an incomplete dotted arc rather than distinct marks around the full dial.
Visual appeal (7/10)
The dark rim, cream face, black numerals, and red accent create a coherent, confident palette, though the stray dotted line slightly undermines the polished look.

stealth/crouton-alpha

unjudged

no svg

duo

Two characters mid-action, not posed: a dog driving a jet ski, a raccoon holding on.

Brief

Draw a comical scene: a dog driving a jet ski at speed, paws on the handlebars, with a raccoon riding behind holding on, both leaning into a turn. Sea spray behind the jet ski, sun and clouds in the sky, a distant shoreline. Both characters must be clearly doing something, not just posed side by side. Bright cartoon vector style. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

cohere/north-mini-code:free

20/50

Brief fidelity (5/10)
The dog, raccoon, jet ski, sea spray, sun, clouds, and shoreline are present, but the paws-on-handlebars and leaning-into-a-turn poses are not clearly readable, and the figures are too small to register as actively driving or holding on.
Construction (4/10)
All shapes are assembled rather than melted or duplicated, but the anatomy is extremely reduced to simple blobs and the jet ski is a basic geometric form, so bodies and object parts lack convincing construction.
Composition (3/10)
The subjects are crowded into the bottom-left corner with a vast empty sky and flat horizontal bands, giving poor use of the frame and no meaningful perspective or relative scale.
Detail finish (4/10)
There is no shading or texture, and the scene is very sparse, though the markup appears clean with no cut-off edges or stray broken shapes.
Visual appeal (4/10)
The palette is coherent and the linework is clean, but the illustration is so minimal and empty that it lacks charm and would not strike most visitors as a finished, appealing cartoon.

dots-studio/dots-3-note-preview:free

16/50

Brief fidelity (3/10)
The image includes sun, clouds, water, a horizon line, and two figures on an orange craft, but the dog, raccoon, paws on handlebars, and leaning turn are unrecognizable or absent, so headline elements are missing.
Construction (2/10)
The characters are featureless brown blobs without faces, paws, or distinct anatomy, and the jet ski is a simple orange oval with no handlebars, so nothing looks assembled.
Composition (4/10)
The horizon divides the frame cleanly and the sun balances the upper right, but the subjects are small, flat, and lack clear perspective or dynamic placement.
Detail finish (3/10)
There is minimal shading or texture, no visible handlebars or facial features, and the sea spray is just a row of plain white circles with no broken markup evident.
Visual appeal (4/10)
The bright cartoon palette is cheerful, but the crude, unrecognizable figures and simplistic shapes reduce charm and confident linework.

kilo-auto/free

31/50

Brief fidelity (7/10)
All requested elements are present: dog driving, raccoon passenger behind, jet ski, sea spray dots, sun, clouds, and distant shoreline, with both characters actively engaged in the ride.
Construction (5/10)
Bodies and faces are recognizable but highly simplified geometric assemblies; paws are stick lines and bodies merge with the jet ski, though nothing is melted or duplicated.
Composition (7/10)
The frame uses clear horizontal bands for sky, shore, and water, with the angled jet ski and characters centered in the lower third for a readable side-profile action layout.
Detail finish (5/10)
The image uses flat cartoon colors with minimal shading and only basic spray dots as texture, but the markup appears clean with no cut-off edges or stray shapes.
Visual appeal (7/10)
A bright, coherent palette and confident black outlines give the comical scene charm, though the extreme simplicity limits visual sophistication.

liquid/lfm-2.5-2.6b:free

26/50

Brief fidelity (3/10)
The dog and raccoon appear on a water vehicle with sun, clouds, and shoreline, but the vehicle has a wheel instead of being a jet ski, the dog is standing rather than driving with paws on handlebars, the raccoon is not holding on, they are not leaning into a turn, and there is no clear sea spray, so headline elements are missing.
Construction (6/10)
The characters and vehicle are built from clean, assembled vector shapes without melted or duplicated parts, though the wheel on a boat is an odd construction choice.
Composition (6/10)
The layout centers the characters and vehicle on a clear horizon with sky above and water below, using speed lines to suggest motion, though the frame feels somewhat empty.
Detail finish (5/10)
The artwork uses flat colors with clean edges and small touches like clouds and speed lines, but lacks shading, textures, sea spray, and other brief-specified details.
Visual appeal (6/10)
The palette is coherent and bright with confident cartoon linework, giving the scene simple charm despite its minimalism.

liquid/lfm-3-1.7b:free

unjudged

no svg

nvidia/nemotron-3.5-lightning:free

21/50

Brief fidelity (4/10)
Headline elements are missing, no visible paws on handlebars, no raccoon holding on, no full bodies, and no clear leaning turn, so this is capped at 4 despite the sun, clouds, shoreline, and spray being present.
Construction (3/10)
The figures are reduced to floating heads with no bodies, paws, or coherent jet-ski anatomy, making them look assembled only in the most rudimentary sense.
Composition (5/10)
The characters sit low in the frame with a simple horizon and open sky, creating a readable but empty layout with minimal perspective.
Detail finish (4/10)
Flat colors with small touches like whiskers and a raccoon mask, but no shading, textures, or refined finishes, and the jet ski is just a curved red shape.
Visual appeal (5/10)
The palette is bright and coherent with confident simple linework, but the scene lacks the comical action and charm promised by the brief.

nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free

20/50

Brief fidelity (4/10)
The jet ski, two riders, sea spray, sun, clouds, and shoreline are present, but the dog and raccoon are unrecognizable blobs and the paws-on-handlebars detail is missing, leaving headline elements incomplete.
Construction (3/10)
Anatomy is reduced to a brown oval and gray circle with no clear heads, paws, or species features, so the figures look like assembled primitives rather than drawn bodies.
Composition (5/10)
The tilted jet ski in the lower right creates a turning dynamic, but the layout is weighed down by vast empty sky and water with flat, minimal perspective.
Detail finish (4/10)
Flat colors with simple white spray lines and cloud ovals deliver basic detail without shading, texture, or refined finishing, and no broken markup or cut-off edges are visible.
Visual appeal (4/10)
The bright, clean cartoon palette and confident simple lines offer modest charm, though the extreme abstraction of the characters holds the appeal back.

nvidia/nemotron-3-ultra-550b-a55b:free

31/50

Brief fidelity (4/10)
The dog, raccoon, sun, clouds, shoreline, and spray are present, but the vehicle is a surfboard-like shape with no handlebars and no visible paws on controls, so headline elements are missing and this criterion is capped at 4.
Construction (7/10)
Both characters have recognizable, assembled cartoon anatomy with ears, eyes, snouts, and a tail; the red craft is a simple but coherent shape with no melted or duplicated parts.
Composition (7/10)
The horizon and sky/water split frame the scene effectively, with the duo placed low-center for readability, though the composition is somewhat flat and the characters are small relative to the frame.
Detail finish (6/10)
The image includes small touches like spray dots, clouds, and a distant shore, but relies mostly on flat color with minimal shading or texture, and no broken or cut-off elements are visible.
Visual appeal (7/10)
The palette is coherent and cheerful, the linework is clean and confident, and the dog-and-raccoon pairing has clear charm despite the simplicity.

opencode-go/beam-free

unjudged

no svg

opencode-go/iceman-contributor-free

unjudged

no svg

opencode-go/longcat-2.5-free

unjudged

no svg

recursive/flint-v1.0:free

26/50

Brief fidelity (3/10)
The headline elements of a jet ski with handlebars are missing, the image shows a kayak with a paddle, so the score is capped and set at 3.
Construction (6/10)
All bodies and object parts are clearly assembled vector shapes without melted or duplicated anatomy, though rendered in a simple style.
Composition (6/10)
The horizon divides the frame, the boat is the clear focal point left of center, and the sun and clouds balance the upper space.
Detail finish (5/10)
Flat colors, black outlines, sea spray, sun rays, and clouds are present, but there is little shading, texture, or fine finishing.
Visual appeal (6/10)
The coherent blue-and-orange palette and confident outlines create simple charm, though the image is minimal and not especially polished.

stealth/crouton-alpha

unjudged

no svg

monalisa

Leonardo's portrait: three-quarter bust, folded hands, winding river landscape behind.

Brief

Redraw the Mona Lisa as a flat vector portrait, bust composition: a seated woman in three-quarter view facing the viewer, dark dress with neckline detail, hands folded at the bottom edge, soft enigmatic smile, hair parted in the middle. Behind her a hazy landscape with a winding river, a bridge on the right, and blue mountains. Muted greens, browns, and smoky blues. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

cohere/north-mini-code:free

10/50

Brief fidelity (1/10)
The image contains none of the requested portrait elements, no seated woman, three-quarter view, enigmatic smile, parted hair, river, bridge, or mountains, so it fails nearly every headline requirement.
Construction (2/10)
There is no recognizable anatomy, face, or hands; the figure is reduced to a circle, rectangle, and dot with no assembled body parts.
Composition (3/10)
The layout is centered and uses the frame, but it does not establish a bust portrait or hazy landscape background as requested.
Detail finish (2/10)
The artwork lacks shading, textures, neckline detail, facial features, or any small touches from the brief, presenting only flat geometric shapes.
Visual appeal (2/10)
The muted palette is coherent but the result is abstract and empty rather than charming or confident as a Mona Lisa reinterpretation.

dots-studio/dots-3-note-preview:free

12/50

Brief fidelity (3/10)
The figure, dark dress with neckline, and smile are present, but the view is frontal rather than three-quarter, the hands are an indistinct blob, and the background lacks a clear winding river and blue mountains.
Construction (2/10)
The head, neck, torso, and hands are assembled from simple geometric primitives, but anatomy is crude with no shoulders or arms and the hands are unrecognizable.
Composition (3/10)
The portrait is centered and fills the frame, but the head is oversized relative to the body and the background layers lack convincing perspective.
Detail finish (2/10)
The artwork is flat with no shading, textures, or refined small touches, and the bottom element appears cut off by the frame edge.
Visual appeal (2/10)
The muted palette is coherent, but the execution is so primitive and schematic that it lacks charm or confident linework.

kilo-auto/free

14/50

Brief fidelity (2/10)
The image includes the dark dress, neckline, smile, and blue mountains, but lacks the three-quarter view, winding river, distinct parted hair, and clearly folded hands, missing multiple headline elements.
Construction (4/10)
The figure is built from clean geometric shapes (circle head, rectangular neck, trapezoidal torso) but lacks a nose, ears, and realistic hands, appearing more like an abstract icon than an assembled portrait.
Composition (3/10)
The composition centers a disproportionately large head with a tiny neck and cuts the body at the frame bottom, using the space but with poor relative scale and perspective.
Detail finish (2/10)
The artwork is clean and unbroken but nearly devoid of shading, texture, or fine details beyond basic flat shapes.
Visual appeal (3/10)
The muted blue-brown-peach palette is coherent and the linework is confident, but the extreme abstraction limits charm and recognizability as the Mona Lisa.

liquid/lfm-2.5-2.6b:free

11/50

Brief fidelity (1/10)
The image lacks nearly every requested element: no seated woman, three-quarter portrait, dark dress, folded hands, enigmatic smile, parted hair, river, bridge, or mountains.
Construction (2/10)
The figure is reduced to a white circle with dot eyes and a triangle hat, with no anatomy, hands, or assembled body parts visible.
Composition (3/10)
A tiny abstract shape sits in the upper center above a large green field, with awkward cropping and no clear portrait framing.
Detail finish (2/10)
There is almost no detail, shading, or texture, and none of the small touches from the brief are present.
Visual appeal (3/10)
The muted palette is coherent but the result is too abstract and unfinished to read as a charming Mona Lisa portrait.

liquid/lfm-3-1.7b:free

unjudged

no svg

nvidia/nemotron-3.5-lightning:free

6/50

Brief fidelity (0/10)
None of the requested Mona Lisa elements are present: no seated woman, three-quarter view, dark dress, folded hands, enigmatic smile, parted hair, or background landscape with river and bridge.
Construction (1/10)
There are no bodies, faces, or hands; the image consists of abstract geometric blobs that do not assemble into recognizable anatomy or objects.
Composition (2/10)
The layout places random central shapes above green hills with no portrait composition, relative sizing, perspective, or use of the frame for a bust.
Detail finish (1/10)
No shading, textures, neckline details, or small touches from the brief appear; the artwork is effectively unfinished relative to the request.
Visual appeal (2/10)
The muted palette is coherent but the image lacks charm, confidence, and recognizability as a Mona Lisa portrait.

nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free

16/50

Brief fidelity (3/10)
The river, mountains, bridge suggestion, and muted palette are present, but the seated woman, three-quarter face, smile, parted hair, folded hands, and neckline detail are effectively missing, so headline elements are absent.
Construction (2/10)
The figure is reduced to a circle head, inverted-triangle dress, tiny neckline triangle, and rectangle hands; no recognizable anatomy, face, or hands are assembled.
Composition (4/10)
The layout fills the frame with a centered head, horizontal river, and right-side landscape, but proportions are extreme and the bottom figure is cut off by the frame edge.
Detail finish (3/10)
Flat vector shading is consistent, but none of the requested small touches (smile, hair part, folded hands, neckline detail) appear, and the bottom shape is cut off.
Visual appeal (4/10)
The muted blue-brown-beige palette is coherent and the minimalist geometry is clean, but it reads as abstract rather than an appealing portrait.

nvidia/nemotron-3-ultra-550b-a55b:free

34/50

after Leonardo
Brief fidelity (7/10)
All headline subjects from the brief are present, the seated woman, dark dress, enigmatic smile, middle-parted hair, and background landscape with river, bridge, and mountains, though details like neckline trim and folded hands are minimally rendered.
Construction (6/10)
The figure is constructed from clean geometric primitives rather than realistic anatomy, appearing intentionally stylized and assembled without melted or duplicated parts.
Composition (8/10)
The bust is centered and occupies the frame effectively, with the winding river and bridge on the right balancing the composition against the hazy blue mountains.
Detail finish (6/10)
The SVG uses flat colors and clean vector edges with no visible broken markup, but it lacks shading, textures, or fine finishing touches beyond the basic shapes.
Visual appeal (7/10)
The coherent muted palette of greens, browns, and smoky blues combined with confident minimalist linework creates a charming and visually cohesive flat portrait.

opencode-go/beam-free

unjudged

no svg

opencode-go/iceman-contributor-free

unjudged

no svg

opencode-go/longcat-2.5-free

unjudged

no svg

recursive/flint-v1.0:free

26/50

Brief fidelity (4/10)
The figure has a dark dress, middle-parted hair, smile, mountains, and river, but it is frontal rather than three-quarter, the hands are not clearly folded at the bottom edge, and the bridge is only an ambiguous brown rectangle, so headline elements are missing.
Construction (6/10)
The portrait is built from clean geometric shapes rather than melted forms, but the anatomy is highly stylized with an oversized head, no neck, and two floating circles for hands, making it only loosely assembled.
Composition (6/10)
The subject is centered against a layered background of mountains and river, using the frame effectively, though the disproportionately large head and flat perspective create an awkward visual hierarchy.
Detail finish (5/10)
The artwork uses flat muted colors with no shading or texture, includes a simple smile and hair part, and shows no broken markup or cut-off edges, but the two orange circles at the bottom are ambiguous and under-detailed.
Visual appeal (5/10)
The palette of muted greens, browns, and smoky blues is coherent and the linework is confident, but the naive abstraction lacks the charm or recognizability of a successful Mona Lisa reinterpretation.

stealth/crouton-alpha

unjudged

no svg

pelican

Everyone knows what a pelican looks like: large beak with throat pouch, long neck, webbed feet.

Brief

Draw a brown pelican standing in side profile, facing left, full body visible: large beak with throat pouch, long neck, folded wing, webbed feet on flat ground. Simple sky background with a hint of sea on the horizon. Flat vector style, clean shapes, limited palette. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

cohere/north-mini-code:free

34/50

Brief fidelity (8/10)
All requested elements are present in abstract form, including the beak with pouch, long neck, folded wing, webbed feet, and sky/sea horizon, though the pouch is minimally suggested.
Construction (6/10)
The bird is assembled from clean geometric shapes but the anatomy is highly stylized, with a blocky body and X-shaped feet that read more as symbols than realistic anatomy.
Composition (6/10)
The pelican sits left of center facing the frame edge with a simple two-tone horizon, leaving ample negative space but creating a slightly cramped profile.
Detail finish (7/10)
The flat vector style is executed cleanly with no broken edges or stray shapes, though detail is minimal beyond the white beak accent and X-foot markers.
Visual appeal (7/10)
The limited brown-orange-blue palette is coherent and the minimalist aesthetic has quiet charm, though the simplicity borders on plain.

dots-studio/dots-3-note-preview:free

31/50

Brief fidelity (4/10)
The pelican, profile pose, full body, neck, wing, and feet are present, but the throat pouch and sea horizon are missing headline elements, capping the score at 4.
Construction (7/10)
The bird is built from clean geometric shapes that look assembled rather than melted, with no duplicated or broken parts, though the anatomy is highly abstracted.
Composition (7/10)
The pelican is well-placed in the frame facing left with a clear ground line and sky, using the space effectively for a flat side-profile illustration.
Detail finish (6/10)
The artwork is clean with no stray shapes or cut-off edges, but it lacks the throat pouch, sea horizon, and any shading or textural details from the brief.
Visual appeal (7/10)
The limited blue-brown-orange palette is coherent and the confident flat shapes give the piece simple charm.

kilo-auto/free

27/50

Brief fidelity (4/10)
The pelican, beak, feet, and horizon are present, but the requested long neck is essentially absent and the throat pouch is only minimally suggested, capping fidelity at 4.
Construction (6/10)
Clean vector shapes assemble the bird without melting or duplication, though the neck-to-body connection is abrupt and the wing is just a flat color patch.
Composition (6/10)
The bird is centered with a clear horizon line, but the frame is dominated by empty sky and the head-to-body scale is stylized rather than naturalistic.
Detail finish (5/10)
The artwork uses flat fills with a simple eye and V-toed feet, but lacks shading, texture, or additional finishing touches beyond the basics.
Visual appeal (6/10)
The limited brown-and-blue palette is coherent and the linework is confident, but the extreme minimalism limits charm and visual interest.

liquid/lfm-2.5-2.6b:free

16/50

Brief fidelity (4/10)
The pelican, beak pouch, long neck, and horizon are present, but the folded wing and clearly webbed feet are missing or indistinct, capping fidelity.
Construction (3/10)
The body is an oversized oval with no discernible wing structure and a leg reduced to a sliver, so parts look assembled from primitives rather than anatomically coherent.
Composition (4/10)
The bird sits left of center with a centered horizon, but excessive negative space and distorted relative sizes weaken the frame use.
Detail finish (2/10)
Flat shapes are clean and unbroken, but there is almost no shading, texture, or finishing detail beyond a single highlight and a shadow blob.
Visual appeal (3/10)
The limited blue-and-brown palette is coherent, but the abstract proportions and missing features make it more odd than charming.

liquid/lfm-3-1.7b:free

10/50

Brief fidelity (1/10)
The image does not clearly depict a brown pelican; the requested side-profile stance, throat pouch, folded wing, and webbed feet are missing or unrecognizable.
Construction (2/10)
The body, neck, and head are crude abstract shapes that do not assemble into coherent pelican anatomy.
Composition (3/10)
A horizon and ground plane are present, but the subject is small, oddly placed, and fails to occupy the frame as a full-body standing bird.
Detail finish (2/10)
The artwork is extremely minimal with no shading, textures, or finishing touches beyond flat shapes.
Visual appeal (2/10)
The illustration lacks charm and does not read as a confident or appealing pelican depiction.

nvidia/nemotron-3.5-lightning:free

7/50

Brief fidelity (1/10)
The pelican is not recognizable; the beak with pouch, long neck, folded wing, and webbed feet are all missing, so headline elements are absent and this criterion is capped low.
Construction (1/10)
No assembled anatomy is present, only disconnected geometric blobs (a circle, a triangle, a cut-off oval) with no body, head, or limb structure.
Composition (2/10)
The sky/sea/ground bands occupy the frame, but the subject is cut off at the right edge and lacks placement or scale, making the composition incomplete.
Detail finish (1/10)
There is no shading, texture, or finish; the large brown shape is cut off by the frame edge and stray shapes (floating circle, triangle) appear unresolved.
Visual appeal (2/10)
The flat palette is coherent but the image reads as abstract fragments rather than a charming or confident pelican illustration.

nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free

20/50

Brief fidelity (4/10)
The pelican, beak, sky, sea horizon, and ground are present, but the long neck is missing and the feet are mere dots rather than webbed feet, so headline omissions cap this criterion at 4.
Construction (3/10)
The bird is assembled from a rectangular body, triangular head/wing, and dot feet with no visible neck connection, making it look geometric rather than anatomically assembled.
Composition (5/10)
The subject is centered with a clear horizon line and reasonable frame use, though the blocky proportions and oversized body relative to the head weaken the layout.
Detail finish (4/10)
Shapes are clean and unbroken with a limited flat palette, but there is no shading, texture, or meaningful detail beyond the bare silhouette.
Visual appeal (4/10)
The coherent brown-and-blue palette is pleasant, but the extreme abstraction gives the piece little charm or confidence, so it would unlikely be called good by a visitor.

nvidia/nemotron-3-ultra-550b-a55b:free

40/50

Brief fidelity (9/10)
All requested headline elements are present: brown pelican in left-facing side profile, full body, large beak with visible throat pouch, long neck, folded wing shape, webbed feet on flat ground, and a simple sky/sea/horizon background in flat vector style.
Construction (8/10)
The bird is assembled from clean, distinct shapes, head, neck, body, wing, beak, pouch, eye, and feet, with no melted, duplicated, or broken anatomy.
Composition (8/10)
The pelican is well-placed within the 800x600 frame with a clear horizon dividing sky, sea, and ground; relative sizes are appropriate for a flat side-profile illustration.
Detail finish (7/10)
Small finishing touches include the eye, colored beak, pink pouch, and splayed webbed toes, though shading and texture are minimal by design; no cut-off edges or stray shapes are visible.
Visual appeal (8/10)
The limited palette of brown, tan, blue, yellow, and pink is coherent and charming, with confident flat vector linework that reads clearly as a stylized pelican.

opencode-go/beam-free

unjudged

no svg

opencode-go/iceman-contributor-free

unjudged

no svg

opencode-go/longcat-2.5-free

unjudged

no svg

recursive/flint-v1.0:free

24/50

Brief fidelity (4/10)
The bird is brown, in left-facing side profile with a long neck and full body visible, but the throat pouch is only a detached dot and the webbed feet are missing/not grounded, so headline elements are absent and this is capped at 4.
Construction (5/10)
The body, neck, head, beak, wing shape, and tail are assembled from clean shapes, but the feet are floating unconnected ovals and the pouch appears as a stray circle rather than attached anatomy.
Composition (6/10)
The pelican occupies the center of the frame with a clear horizon dividing sky, sea, and ground, using the 800x600 space effectively without crowding.
Detail finish (4/10)
The style is flat and minimal with a limited palette, but there is no shading, texture, or finish beyond basic shapes, and the detached pouch/feet look unfinished.
Visual appeal (5/10)
The coherent brown-blue-tan palette is pleasant, but the illustration is crude and lacks charm or confident detail, making it only modestly appealing.

stealth/crouton-alpha

unjudged

no svg

Run info

Suite 1.0, generated 2026-11-11T13:26:04.385Z, seed 20261109, rubric 1.0. Frozen inputs are never edited in place: a new bench version supersedes them.