Skip to main content

← Dracon Bench leaderboard

Model guide · Dracon Bench

ernie-5.5-flash-preview

Tested First seen 2026-11-10 (listed on the provider) · First tested 2026-11-17 · OpenRouter free lane

Baidu Ernie 5.5 Flash Preview lands second on the pilot board at 74.8 overall across six suites. Instruction following is the strength: IFEval-50 scores 90.0% (n=10) and all five JSON briefs conform. SVG judging returned 158/200 over four admissible artifacts.

Rank
#2
Overall
74.8
Suites
6 of 6
Ranked
#2 of 21

When the world heard about it

Timeline

  1. First seen on the provider 2026-11-10 the provider's own catalogue
  2. First tested by us 2026-11-17 Dracon Bench
  3. Officially announced 2026-11-11 llm-stats
  4. First official benchmark 2026-11-19 llm-stats: a public score existed by then — the first day we saw one
  • Reachable before we scored it 7 days
  • Reachable before the vendor announced it 1 day
  • A public score existed within 9 days

Track A · script-scored subsets

Scores

Subset scores for ernie-5.5-flash-preview.
SuiteScoreSamplePrecision
IFEval-50 prompt-strict90.0%9/10 prompts59.6%–98.2%
IFEval-50 instruction-strict94.1%16/17 constraints73.0%–99.0%
IFBench-50 prompt-strict60.0%6/10 prompts31.3%–83.2%
IFBench-50 instruction-strict63.6%7/11 constraints35.4%–84.8%
MMLU-Pro-5050.0%5/10 served23.7%–76.3%
JSON briefs conformance100.0%5/5 served56.6%–100.0%
GSM8K-5070.0%7/10 served39.7%–89.2%
SVG blind rubric158/200blind rubricjudge band ±8.3 pts

The range beside a script-scored figure is a 95% interval over that figure's own sample: the prompts it followed, the constraints it met, or the items it answered. The instruction-strict figures are measured over CONSTRAINTS, which is why their sample line counts constraints rather than prompts. The judged total is not a proportion, so it has no interval: it carries the measured judge band instead: how far a re-judging of the same artifacts moved them, which is a different kind of number. The method page says what each one covers and what it does not.

Track A · per-type breakdown

What it failed

The instruction types these two suites check, and the checks the model missed. A type is checked once per prompt that carries it, so a type with seven checks was asked for seven times. The counts beside a type are that type's own; the suite's totals are in the scores table above. These are the failures behind the instruction-strict figure, which is the sum of them.

IFEval-50

Missed at least one check in 1 of the 15 instruction types checked.

The instruction types 1 of 15 the IFEval-50 suite checked that baidu/ernie-5.5-flash-preview:free missed, most missed first.
Instruction typeChecksMissed
detectable format · json format11

IFBench-50

Missed at least one check in 3 of the 8 verifiers checked.

The verifiers 3 of 8 the IFBench-50 suite checked that baidu/ernie-5.5-flash-preview:free missed, most missed first.
VerifierChecksMissed
count · unique word count32
count · conjunctions11
count · numbers21

Provider-reported usage

Thinking cost

What the run cost the model in thinking: provider-reported completion tokens per prompt, the thinking share, and the cost per correct answer. Reasoning-heavy models can exhaust fixed budgets before answering.

Thinking cost for ernie-5.5-flash-preview.
SuiteCostReading
IFEval-501,317/prompt58% thinking· 1,464/correct
GSM8K-50224/prompt62% thinking· 320/correct

Track B · blind-judged

Artifacts

Blind-judged by nvidia/nemotron-3.5-super-vl:free: the judge saw the brief and the rendered image only, never the model name. Briefs are frozen; expand one to read it.

beach

43/50
Judge reasoning
Brief fidelity (9/10)
All requested headline elements are present: the low sun, reflection path, leaning palm, two arcing dolphins, right-side sailboat, sky birds, sandy foreground, and starfish, rendered in the specified warm-to-cool palette.
Construction (8/10)
Shapes are clean silhouettes and simple geometric forms with no melted anatomy or duplicated parts, though the dolphins and boat are stylized rather than realistically detailed.
Composition (9/10)
The frame is well balanced with the palm anchoring the left, the sailboat on the right, the centered sun drawing the eye, and the reflection path creating clear depth from foreground to horizon.
Detail finish (8/10)
Finishing touches include the dotted starfish, layered sun glow, segmented reflection path, and distant bird silhouettes, with no visible broken markup or cut-off edges.
Visual appeal (9/10)
The cohesive sunset palette, confident silhouette linework, and charming scene make it visually appealing and suitable for a visitor-facing illustration.
Brief

Draw a beautiful sunset beach scene: a large sun sitting low over the sea with a shimmering reflection path on the water, a leaning palm tree silhouette on the left, two dolphins arcing out of the waves, a small sailboat on the right, birds in the sky, sandy foreground with a starfish. Warm oranges and pinks fading to teal. Coherent perspective: distant objects smaller and hazier than near ones. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

clock

47/50
DRACON wall clock showing 10:10 A round clock with a dark rim and light face, all twelve hour numerals, minute tick marks, an hour hand just past 10, a minute hand pointing exactly at 2, and a thin second hand pointing at 6. The word DRACON appears in small capitals below the center. 12 1 2 3 4 5 6 7 8 9 10 11 DRACON
Judge reasoning
Brief fidelity (9/10)
All requested elements are present including 12 numerals, tick marks, hands at 10:10 with second hand at 6, and the DRACON wordmark, though the hour hand sits essentially on 10 rather than visibly just past it.
Construction (10/10)
The clock face, hands, numerals, and ticks are cleanly assembled with no melted, duplicated, or misaligned parts.
Composition (10/10)
The dial is perfectly centered with balanced proportions and effective use of the circular frame within the rectangular canvas.
Detail finish (9/10)
Flat vector execution is crisp with a red second hand and center dot, though minimal shading is consistent with the brief and no markup errors are visible.
Visual appeal (9/10)
The dark rim, cream face, black numerals, and red accent create a coherent, confident, and charming minimalist design.
Brief

Draw a round wall clock face showing exactly 10:10: a circular dial with all 12 hour numerals in the correct positions, minute tick marks, an hour hand pointing just past 10, a minute hand pointing exactly at 2, and a thin second hand pointing at 6. The word DRACON in small capitals under the center. Dark rim, light face, flat vector style, centered composition. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

duo

unjudged

no svg

Brief

Draw a comical scene: a dog driving a jet ski at speed, paws on the handlebars, with a raccoon riding behind holding on, both leaning into a turn. Sea spray behind the jet ski, sun and clouds in the sky, a distant shoreline. Both characters must be clearly doing something, not just posed side by side. Bright cartoon vector style. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

monalisa

28/50
Judge reasoning
Brief fidelity (6/10)
Most requested elements are present including the dark dress, neckline, folded hands, smile, middle-parted hair, river, mountains, and muted palette, but the figure is frontal rather than three-quarter and the bridge is only a vague block.
Construction (4/10)
The figure is assembled from distinct parts but the face is elongated with dot eyes and a line nose, and the hands are merged beige blobs without clear fingers, giving a simplified rather than anatomically convincing look.
Composition (7/10)
The bust is centered and fills the frame with the river entering from the left and a rectangular bridge mass on the right, creating a balanced if flat layout that uses the 800x600 frame effectively.
Detail finish (5/10)
The artwork is clean vector geometry with a visible hair part, neckline detail, and smile, but it lacks shading, texture, and refined finishing, appearing more like a blocky study than a finished illustration.
Visual appeal (6/10)
The muted green-brown-blue palette is coherent and the flat linework is confident, but the elongated face and blobby hands reduce charm and make the portrait feel slightly uncanny rather than appealing.
Brief

Redraw the Mona Lisa as a flat vector portrait, bust composition: a seated woman in three-quarter view facing the viewer, dark dress with neckline detail, hands folded at the bottom edge, soft enigmatic smile, hair parted in the middle. Behind her a hazy landscape with a winding river, a bridge on the right, and blue mountains. Muted greens, browns, and smoky blues. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.

pelican

40/50
Judge reasoning
Brief fidelity (9/10)
All requested elements are present: a brown pelican in left-facing side profile with a large beak and throat pouch, long neck, folded wing, webbed feet, flat ground, sky, and sea horizon in a flat vector style.
Construction (8/10)
The pelican is built from clean, non-overlapping geometric shapes that read as assembled body parts rather than melted or duplicated forms.
Composition (8/10)
The bird is centered with strong leftward facing, balanced by the sun in the upper right, and the horizon line divides the frame effectively.
Detail finish (7/10)
Minimal flat shading and small touches like the eye, wing lines, and ground shadow are present with no broken markup or cut-off edges visible.
Visual appeal (8/10)
The limited earthy and blue palette with confident vector linework creates a coherent, charming, and visitor-friendly illustration.
Brief

Draw a brown pelican standing in side profile, facing left, full body visible: large beak with throat pouch, long neck, folded wing, webbed feet on flat ground. Simple sky background with a hint of sea on the horizon. Flat vector style, clean shapes, limited palette. Output: exactly one self-contained SVG (viewBox "0 0 800 600", no external references) inside a single ```svg fenced block. Short prose outside the fence is allowed.