beam-free vs nemotron-3.5-lightning:free
Scores
| Suite | beam-free | nemotron-3.5-lightning:free | Delta |
|---|---|---|---|
| IFEval-50 prompt | n/a | 89.8% | |
| GSM8K-50 | 84.0% | 70.0% | 14.0 pts |
| SVG total | n/a | 55/250 |
beach
Sun low over water with a reflection path; distant objects smaller and hazier than near ones.
opencode-go/beam-free
unjudged
no svg
nvidia/nemotron-3.5-lightning:free
21/50
clock
A clock is checkable to the minute: 10:10 means the hour hand just past 10, the minute hand on 2.
opencode-go/beam-free
unjudged
no svg
nvidia/nemotron-3.5-lightning:free
0/50
duo
Two characters mid-action, not posed: a dog driving a jet ski, a raccoon holding on.
opencode-go/beam-free
unjudged
no svg
nvidia/nemotron-3.5-lightning:free
21/50
monalisa
Leonardo's portrait: three-quarter bust, folded hands, winding river landscape behind.
opencode-go/beam-free
unjudged
no svg
nvidia/nemotron-3.5-lightning:free
6/50
pelican
Everyone knows what a pelican looks like: large beak with throat pouch, long neck, webbed feet.
opencode-go/beam-free
unjudged
no svg
nvidia/nemotron-3.5-lightning:free
7/50