nemotron-3.5-lightning:free vs north-mini-code:free
Scores
| Suite | nemotron-3.5-lightning:free | north-mini-code:free | Delta |
|---|---|---|---|
| IFEval-50 prompt | 89.8% | 91.8% | -2.0 pts |
| GSM8K-50 | 70.0% | 80.0% | -10.0 pts |
| SVG total | 55/250 | 98/250 | -43 |
beach 21 vs 15
Sun low over water with a reflection path; distant objects smaller and hazier than near ones.
nvidia/nemotron-3.5-lightning:free
21/50
cohere/north-mini-code:free
15/50
clock 0 vs 19
A clock is checkable to the minute: 10:10 means the hour hand just past 10, the minute hand on 2.
nvidia/nemotron-3.5-lightning:free
0/50
cohere/north-mini-code:free
19/50
duo 21 vs 20
Two characters mid-action, not posed: a dog driving a jet ski, a raccoon holding on.
nvidia/nemotron-3.5-lightning:free
21/50
cohere/north-mini-code:free
20/50
monalisa 6 vs 10
Leonardo's portrait: three-quarter bust, folded hands, winding river landscape behind.
nvidia/nemotron-3.5-lightning:free
6/50
cohere/north-mini-code:free
10/50
pelican 7 vs 34
Everyone knows what a pelican looks like: large beak with throat pouch, long neck, webbed feet.
nvidia/nemotron-3.5-lightning:free
7/50
cohere/north-mini-code:free
34/50