nemotron-3-nano-omni-30b-a3b-reasoning:free vs nemotron-3-ultra-550b-a55b:free
Scores
| Suite | nemotron-3-nano-omni-30b-a3b-reasoning:free | nemotron-3-ultra-550b-a55b:free | Delta |
|---|---|---|---|
| IFEval-50 prompt | 89.8% | 85.7% | 4.1 pts |
| GSM8K-50 | 78.0% | 78.0% | 0.0 pts |
| SVG total | 104/250 | 150/250 | -46 |
beach 17 vs 19
Sun low over water with a reflection path; distant objects smaller and hazier than near ones.
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free
17/50
nvidia/nemotron-3-ultra-550b-a55b:free
19/50
clock 31 vs 26
A clock is checkable to the minute: 10:10 means the hour hand just past 10, the minute hand on 2.
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free
31/50
nvidia/nemotron-3-ultra-550b-a55b:free
26/50
duo 20 vs 31
Two characters mid-action, not posed: a dog driving a jet ski, a raccoon holding on.
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free
20/50
nvidia/nemotron-3-ultra-550b-a55b:free
31/50
monalisa 16 vs 34
Leonardo's portrait: three-quarter bust, folded hands, winding river landscape behind.
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free
16/50
nvidia/nemotron-3-ultra-550b-a55b:free
34/50
pelican 20 vs 40
Everyone knows what a pelican looks like: large beak with throat pouch, long neck, webbed feet.
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free
20/50
nvidia/nemotron-3-ultra-550b-a55b:free
40/50