Includes 694 hourly rounds up to 2026-11-16 from NIMStats by Mauro Druwel (source), measured with a different prompt and timeout. Our own probe adds a round every 30 minutes.
Run timeline
709 probe rounds in the last 30 days. Click a round to see every model's result.
22 min ago 9/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.38 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 163 ms 1.38 s 164 tok/s nvidia nemotron-3.5-bolt-e4b OK 146 ms 1.82 s 81.9 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 180 ms 2.05 s 107 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 799 ms 2.51 s 117 tok/s nvidia nemotron-3-ultra-550b-a55b OK 782 ms 4.79 s 50.0 tok/s poolside laguna-xs-2.1 OK 157 ms 10.5 s 16.7 tok/s minimax minimax-m3.1-flash OK 18.4 s 23.6 s 38.8 tok/s meta muse-glimmer-30b OK 55.6 s 91.2 s 5.6 tok/s mistral mistral-large-4-1t-a52b OK 5.30 s 97.7 s 2.2 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Empty answer n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 52 min ago 10/15 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 1.77 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 176 ms 1.77 s 126 tok/s nvidia nemotron-3.5-bolt-e4b OK 146 ms 1.88 s 77.2 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 562 ms 2.47 s 105 tok/s poolside laguna-xs-2.1 OK 136 ms 4.87 s 34.0 tok/s nvidia nemotron-3.5-lightning-30b-a3b OK 173 ms 4.98 s 41.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 546 ms 6.45 s 33.0 tok/s stepfun step-5-preview OK 6.51 s 16.2 s 20.7 tok/s mistral mistral-large-4-1t-a52b OK 6.40 s 36.3 s 6.7 tok/s minimax minimax-m3.1-flash OK 36.4 s 43.0 s 30.1 tok/s meta muse-glimmer-30b OK 41.2 s 65.5 s 8.2 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Empty answer n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a 82 min ago 11/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.36 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 205 ms 1.36 s 173 tok/s nvidia nemotron-3.5-bolt-e4b OK 91 ms 1.62 s 86.9 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 455 ms 1.84 s 144 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 215 ms 2.85 s 75.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 382 ms 4.34 s 50.6 tok/s poolside laguna-xs-2.1 OK 178 ms 5.59 s 31.0 tok/s stepfun step-5-preview OK 7.49 s 25.4 s 11.2 tok/s mistral mistral-large-4-1t-a52b OK 342 ms 44.6 s 4.5 tok/s minimax minimax-m3.1-flash OK 46.1 s 50.7 s 43.9 tok/s google gemma-4-31b-it OK 97.7 s 102.1 s 33.2 tok/s meta muse-glimmer-30b OK 133.1 s 167.6 s 5.8 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a 2 h ago 8/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.41 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 190 ms 1.41 s 163 tok/s nvidia nemotron-3.5-bolt-e4b OK 130 ms 1.59 s 90.8 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 393 ms 1.99 s 126 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 179 ms 2.55 s 84.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 405 ms 5.39 s 40.1 tok/s poolside laguna-xs-2.1 OK 181 ms 9.88 s 19.0 tok/s mistral mistral-large-4-1t-a52b OK 372 ms 26.1 s 7.8 tok/s meta muse-glimmer-30b OK 10.3 s 33.0 s 8.8 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 2 h ago 9/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.60 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 305 ms 1.60 s 154 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 304 ms 1.60 s 154 tok/s nvidia nemotron-3.5-bolt-e4b OK 110 ms 1.70 s 83.8 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 193 ms 2.85 s 75.2 tok/s poolside laguna-xs-2.1 OK 196 ms 6.01 s 30.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 877 ms 6.50 s 35.6 tok/s mistral mistral-large-4-1t-a52b OK 344 ms 8.66 s 24.1 tok/s minimax minimax-m3.1-flash OK 23.8 s 31.5 s 26.0 tok/s meta muse-glimmer-30b OK 72.4 s 96.9 s 8.2 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 3 h ago 11/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.22 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 187 ms 1.22 s 193 tok/s nvidia nemotron-3.5-bolt-e4b OK 102 ms 1.55 s 91.7 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 148 ms 1.84 s 118 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 322 ms 2.80 s 80.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 406 ms 4.13 s 53.6 tok/s poolside laguna-xs-2.1 OK 133 ms 9.01 s 18.6 tok/s mistral mistral-large-4-1t-a52b OK 2.17 s 9.89 s 25.9 tok/s meta muse-glimmer-30b OK 26.4 s 52.4 s 7.7 tok/s minimax minimax-m3.1-flash OK 64.8 s 71.7 s 29.1 tok/s stepfun step-5-preview OK 111.6 s 134.4 s 8.8 tok/s google gemma-4-31b-it OK 154.0 s 160.6 s 20.5 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a 3 h ago 10/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.37 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 251 ms 1.37 s 178 tok/s nvidia nemotron-3.5-bolt-e4b OK 178 ms 1.89 s 79.1 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 380 ms 2.00 s 124 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 170 ms 2.08 s 105 tok/s poolside laguna-xs-2.1 OK 171 ms 3.08 s 57.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.59 s 4.87 s 60.9 tok/s stepfun step-5-preview OK 293 ms 7.40 s 28.1 tok/s minimax minimax-m3.1-flash OK 620 ms 12.6 s 16.7 tok/s meta muse-glimmer-30b OK 26.2 s 47.8 s 9.3 tok/s mistral mistral-large-4-1t-a52b OK 7.15 s 57.1 s 4.0 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a 4 h ago 7/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.58 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 224 ms 1.58 s 148 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 343 ms 2.00 s 121 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 183 ms 2.39 s 90.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 397 ms 2.50 s 95.1 tok/s poolside laguna-xs-2.1 OK 195 ms 7.49 s 22.3 tok/s nvidia nemotron-3.5-bolt-e4b OK 262 ms 9.61 s 16.8 tok/s mistral mistral-large-4-1t-a52b OK 2.33 s 18.0 s 12.8 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a meta muse-glimmer-30b Timed out n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 4 h ago 10/15 models answered Fastest nemotron-3.5-super-vl-120b-a12b 1.67 s
Model Result First token Full reply Speed nvidia nemotron-3.5-super-vl-120b-a12b OK 317 ms 1.67 s 148 tok/s nvidia nemotron-3.5-bolt-e4b OK 139 ms 1.75 s 82.7 tok/s poolside laguna-xs-2.1 OK 148 ms 2.07 s 88.9 tok/s nvidia nemotron-3.5-lightning-30b-a3b OK 200 ms 2.38 s 91.9 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 280 ms 3.04 s 72.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 461 ms 6.72 s 32.0 tok/s mistral mistral-large-4-1t-a52b OK 438 ms 8.40 s 25.1 tok/s minimax minimax-m3.1-flash OK 9.31 s 24.8 s 12.9 tok/s meta muse-glimmer-30b OK 33.4 s 61.1 s 7.2 tok/s google gemma-4-31b-it OK 59.1 s 66.2 s 19.3 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Empty answer n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 5 h ago 10/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.34 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 167 ms 1.34 s 171 tok/s nvidia nemotron-3.5-bolt-e4b OK 118 ms 1.46 s 98.9 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 318 ms 1.91 s 126 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 241 ms 4.31 s 49.2 tok/s poolside laguna-xs-2.1 OK 635 ms 4.91 s 39.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 414 ms 7.04 s 30.2 tok/s mistral mistral-large-4-1t-a52b OK 505 ms 7.21 s 29.8 tok/s minimax minimax-m3.1-flash OK 1.48 s 8.90 s 27.0 tok/s meta muse-glimmer-30b OK 6.22 s 30.4 s 8.3 tok/s stepfun step-5-preview OK 107.8 s 126.5 s 10.7 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a 5 h ago 9/15 models answered Fastest nemotron-3.5-bolt-e4b 1.57 s
Model Result First token Full reply Speed nvidia nemotron-3.5-bolt-e4b OK 111 ms 1.57 s 90.9 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 334 ms 1.60 s 158 tok/s nvidia nemotron-3.5-lightning-30b-a3b OK 157 ms 1.74 s 126 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 145 ms 2.11 s 102 tok/s poolside laguna-xs-2.1 OK 184 ms 2.21 s 74.2 tok/s minimax minimax-m3.1-flash OK 476 ms 7.26 s 29.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 369 ms 13.7 s 15.0 tok/s mistral mistral-large-4-1t-a52b OK 316 ms 22.2 s 9.1 tok/s meta muse-glimmer-30b OK 3.35 s 26.5 s 8.6 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 6 h ago 11/15 models answered Fastest nemotron-3.5-super-vl-120b-a12b 957 ms
Model Result First token Full reply Speed nvidia nemotron-3.5-super-vl-120b-a12b OK 295 ms 957 ms 302 tok/s nvidia nemotron-3.5-lightning-30b-a3b OK 197 ms 1.13 s 215 tok/s nvidia nemotron-3.5-bolt-e4b OK 87 ms 1.54 s 91.7 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 147 ms 2.00 s 108 tok/s poolside laguna-xs-2.1 OK 156 ms 2.64 s 73.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 717 ms 3.83 s 64.3 tok/s minimax minimax-m3.1-flash OK 831 ms 6.18 s 37.4 tok/s mistral mistral-large-4-1t-a52b OK 2.83 s 39.3 s 5.5 tok/s google gemma-4-31b-it OK 36.3 s 40.6 s 31.8 tok/s stepfun step-5-preview OK 26.8 s 57.6 s 6.5 tok/s meta muse-glimmer-30b OK 55.2 s 88.0 s 6.1 tok/s deepseek deepseek-v4.1-flash Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Empty answer n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a 25 h ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 9.24 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 972 ms 9.24 s 54.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.64 s 10.7 s 46.9 tok/s stepfun step-5-preview OK 8.84 s 18.4 s 23.9 tok/s mistral mistral-large-4-1t-a52b OK 30.8 s 42.0 s 11.9 tok/s google gemma-4-31b-it OK 41.7 s 51.4 s 9.7 tok/s openai gpt-oss-20b OK 167.7 s 173.0 s 2.9 tok/s z glm-5.3-flash OK 294.0 s 297.3 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 26 h ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.43 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.44 s 5.43 s 92.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.76 s 10.7 s 46.6 tok/s mistral mistral-large-4-1t-a52b OK 20.0 s 22.0 s 22.7 tok/s minimax minimax-m3.1-flash OK 15.0 s 26.2 s 19.1 tok/s google gemma-4-31b-it OK 56.1 s 65.7 s 7.6 tok/s openai gpt-oss-20b OK 124.0 s 129.3 s 3.9 tok/s z glm-5.3-flash OK 289.3 s 296.0 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 26 h ago 10/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.34 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 196 ms 1.34 s 175 tok/s nvidia nemotron-3.5-bolt-e4b OK 114 ms 1.76 s 80.8 tok/s poolside laguna-xs-2.1 OK 244 ms 1.85 s 112 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 192 ms 2.03 s 109 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 1.34 s 2.46 s 178 tok/s nvidia nemotron-3-ultra-550b-a55b OK 436 ms 3.64 s 57.7 tok/s stepfun step-5-preview OK 350 ms 10.4 s 19.8 tok/s mistral mistral-large-4-1t-a52b OK 293 ms 15.5 s 13.2 tok/s meta muse-glimmer-30b OK 713 ms 22.7 s 9.1 tok/s minimax minimax-m3.1-flash OK 8.93 s 24.7 s 12.7 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a 27 h ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.20 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 710 ms 6.20 s 80.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.56 s 11.2 s 44.7 tok/s openai gpt-oss-20b OK 159.5 s 165.3 s 3.0 tok/s stepfun step-5-preview OK 196.0 s 205.9 s 2.4 tok/s mistral mistral-large-4-1t-a52b OK 229.5 s 248.5 s 2.0 tok/s z glm-5.3-flash OK 290.5 s 294.4 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 28 h ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.42 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 665 ms 5.42 s 92.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.39 s 15.6 s 32.0 tok/s stepfun step-5-preview OK 14.2 s 17.9 s 28.0 tok/s z glm-5.3-flash OK 127.9 s 129.9 s 1.8 tok/s openai gpt-oss-20b OK 145.3 s 152.0 s 3.3 tok/s deepseek deepseek-v4.1-flash OK 289.3 s 291.6 s 1.3 tok/s google gemma-4-31b-it Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 29 h ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.87 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 710 ms 4.87 s 103 tok/s nvidia nemotron-3-ultra-550b-a55b OK 5.59 s 11.7 s 42.9 tok/s minimax minimax-m3.1-flash OK 18.9 s 19.6 s 25.5 tok/s stepfun step-5-preview OK 18.1 s 22.5 s 22.3 tok/s mistral mistral-large-4-1t-a52b OK 127.9 s 151.8 s 3.3 tok/s openai gpt-oss-20b OK 151.4 s 159.8 s 3.1 tok/s z glm-5.3-flash OK 165.9 s 172.8 s 1.4 tok/s google gemma-4-31b-it OK 249.8 s 265.5 s 1.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 30 h ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.09 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 407 ms 4.09 s 122 tok/s stepfun step-5-preview OK 4.48 s 7.87 s 63.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.08 s 8.68 s 57.6 tok/s minimax minimax-m3.1-flash OK 21.6 s 24.0 s 20.8 tok/s z glm-5.3-flash OK 89.6 s 97.7 s 2.7 tok/s openai gpt-oss-20b OK 154.0 s 161.9 s 3.1 tok/s google gemma-4-31b-it OK 153.6 s 164.8 s 3.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 31 h ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.99 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 621 ms 3.99 s 125 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.51 s 7.81 s 64.0 tok/s mistral mistral-large-4-1t-a52b OK 20.0 s 21.8 s 22.9 tok/s stepfun step-5-preview OK 33.5 s 33.6 s 14.9 tok/s google gemma-4-31b-it OK 188.2 s 220.0 s 2.3 tok/s z glm-5.3-flash OK 251.8 s 255.6 s 0.9 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 31 h ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.08 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 667 ms 4.08 s 123 tok/s nvidia nemotron-3-ultra-550b-a55b OK 6.08 s 16.3 s 30.6 tok/s minimax minimax-m3.1-flash OK 29.5 s 34.8 s 14.4 tok/s openai gpt-oss-20b OK 80.3 s 85.5 s 5.8 tok/s z glm-5.3-flash OK 126.5 s 130.2 s 1.9 tok/s deepseek deepseek-v4.1-flash OK 134.9 s 145.1 s 2.4 tok/s google gemma-4-31b-it OK 250.2 s 261.2 s 1.9 tok/s meta llama-3.2-90b-vision-instruct Not served (404) n/a n/a n/a mistral mistral-large-4-1t-a52b Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Not served (404) n/a n/a n/a 33 h ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.79 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 758 ms 6.79 s 73.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.37 s 10.9 s 45.8 tok/s meta llama-3.2-90b-vision-instruct OK 1.01 s 41.0 s 8.4 tok/s minimax minimax-m3.1-flash OK 20.3 s 43.5 s 11.5 tok/s stepfun step-5-preview OK 34.9 s 77.8 s 6.4 tok/s google gemma-4-31b-it OK 108.8 s 121.0 s 4.1 tok/s openai gpt-oss-20b OK 158.4 s 163.1 s 3.1 tok/s deepseek deepseek-v4.1-flash OK 211.4 s 215.7 s 2.0 tok/s z glm-5.3-flash Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 34 h ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.78 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 470 ms 4.78 s 105 tok/s nvidia nemotron-3-ultra-550b-a55b OK 789 ms 15.3 s 32.7 tok/s minimax minimax-m3.1-flash OK 16.6 s 19.9 s 25.1 tok/s openai gpt-oss-20b OK 48.3 s 53.4 s 8.2 tok/s meta llama-3.2-90b-vision-instruct OK 48.3 s 89.6 s 4.4 tok/s google gemma-4-31b-it OK 118.2 s 138.0 s 3.6 tok/s z glm-5.3-flash OK 289.4 s 297.9 s 1.0 tok/s deepseek deepseek-v4.1-flash OK 290.3 s 300.3 s 1.4 tok/s mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 35 h ago· NIMStats 7/12 models answered Fastest nemotron-3-ultra-550b-a55b 6.35 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 2.13 s 6.35 s 78.8 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 593 ms 6.79 s 73.7 tok/s stepfun step-5-preview OK 4.17 s 9.20 s 54.3 tok/s openai gpt-oss-20b OK 41.8 s 47.1 s 10.6 tok/s meta llama-3.2-90b-vision-instruct OK 36.0 s 84.5 s 4.5 tok/s google gemma-4-31b-it OK 108.8 s 119.1 s 4.2 tok/s mistral mistral-large-4-1t-a52b OK 165.8 s 166.3 s 3.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a minimax minimax-m3.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 9.97 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 869 ms 9.97 s 50.1 tok/s minimax minimax-m3.1-flash OK 19.7 s 22.7 s 22.0 tok/s google gemma-4-31b-it OK 95.5 s 107.1 s 4.7 tok/s mistral mistral-large-4-1t-a52b OK 171.9 s 175.4 s 2.9 tok/s nvidia nemotron-3-ultra-550b-a55b OK 83.2 s 205.0 s 2.4 tok/s openai gpt-oss-20b OK 199.6 s 206.3 s 2.4 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.07 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 475 ms 5.07 s 98.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.32 s 7.26 s 68.9 tok/s minimax minimax-m3.1-flash OK 14.6 s 18.0 s 27.7 tok/s google gemma-4-31b-it OK 47.4 s 57.3 s 8.7 tok/s meta llama-3.2-90b-vision-instruct OK 1.81 s 76.7 s 4.8 tok/s stepfun step-5-preview OK 59.0 s 78.7 s 6.4 tok/s openai gpt-oss-20b OK 170.0 s 175.8 s 2.8 tok/s mistral mistral-large-4-1t-a52b OK 282.0 s 283.0 s 1.8 tok/s z glm-5.3-flash OK 276.7 s 289.0 s 1.1 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago 9/15 models answered Fastest nemotron-3.5-lightning-30b-a3b 1.40 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 196 ms 1.40 s 167 tok/s nvidia nemotron-3.5-bolt-e4b OK 97 ms 1.63 s 86.3 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 157 ms 1.70 s 130 tok/s poolside laguna-xs-2.1 OK 175 ms 2.11 s 85.9 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 358 ms 2.48 s 94.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 437 ms 9.35 s 21.1 tok/s minimax minimax-m3.1-flash OK 1.82 s 9.96 s 24.6 tok/s meta muse-glimmer-30b OK 666 ms 20.6 s 10.0 tok/s stepfun step-5-preview OK 25.7 s 31.4 s 34.6 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Timed out n/a n/a n/a 2 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.29 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 482 ms 4.29 s 116 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.52 s 13.3 s 37.7 tok/s mistral mistral-large-4-1t-a52b OK 16.3 s 16.5 s 30.2 tok/s minimax minimax-m3.1-flash OK 13.5 s 19.1 s 26.2 tok/s stepfun step-5-preview OK 19.1 s 29.0 s 17.3 tok/s meta llama-3.2-90b-vision-instruct OK 3.59 s 60.1 s 6.8 tok/s google gemma-4-31b-it OK 60.6 s 69.1 s 7.2 tok/s openai gpt-oss-20b OK 173.0 s 178.4 s 2.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.73 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.03 s 5.73 s 87.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.65 s 14.1 s 35.5 tok/s minimax minimax-m3.1-flash OK 14.8 s 21.7 s 23.1 tok/s openai gpt-oss-20b OK 41.3 s 46.2 s 10.8 tok/s meta llama-3.2-90b-vision-instruct OK 754 ms 55.4 s 7.1 tok/s stepfun step-5-preview OK 180.0 s 192.6 s 2.6 tok/s z glm-5.3-flash OK 192.5 s 196.9 s 1.2 tok/s google gemma-4-31b-it OK 232.1 s 240.9 s 2.1 tok/s deepseek deepseek-v4.1-flash OK 306.0 s 309.1 s 1.0 tok/s mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-ultra-550b-a55b 4.37 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 701 ms 4.37 s 114 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 848 ms 6.42 s 77.9 tok/s stepfun step-5-preview OK 8.01 s 11.7 s 42.8 tok/s minimax minimax-m3.1-flash OK 15.5 s 20.8 s 24.1 tok/s mistral mistral-large-4-1t-a52b OK 46.3 s 48.8 s 10.2 tok/s meta llama-3.2-90b-vision-instruct OK 4.76 s 82.3 s 4.8 tok/s google gemma-4-31b-it OK 107.0 s 117.6 s 4.2 tok/s openai gpt-oss-20b OK 163.3 s 168.7 s 2.9 tok/s z glm-5.3-flash OK 270.4 s 277.1 s 1.6 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.93 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 451 ms 3.93 s 127 tok/s stepfun step-5-preview OK 5.22 s 14.4 s 34.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.11 s 16.7 s 30.0 tok/s google gemma-4-31b-it OK 58.8 s 71.1 s 7.0 tok/s meta llama-3.2-90b-vision-instruct OK 2.68 s 92.2 s 4.7 tok/s mistral mistral-large-4-1t-a52b OK 73.7 s 147.8 s 3.4 tok/s openai gpt-oss-20b OK 166.8 s 170.5 s 2.9 tok/s z glm-5.3-flash OK 256.6 s 261.9 s 1.0 tok/s deepseek deepseek-v4.1-flash OK 274.1 s 287.2 s 1.1 tok/s minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 5/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.04 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 474 ms 4.04 s 124 tok/s stepfun step-5-preview OK 9.86 s 10.4 s 48.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.17 s 13.1 s 38.3 tok/s mistral mistral-large-4-1t-a52b OK 39.5 s 48.7 s 10.3 tok/s google gemma-4-31b-it OK 57.0 s 66.6 s 7.5 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago 10/16 models answered Fastest nemotron-3.5-lightning-30b-a3b 758 ms
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 166 ms 758 ms 338 tok/s nvidia nemotron-3.5-bolt-e4b OK 86 ms 1.60 s 87.6 tok/s poolside laguna-xs-2.1 OK 142 ms 1.75 s 107 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 279 ms 1.85 s 127 tok/s nvidia nemotron-3.5-super-vl-120b-a12b OK 337 ms 2.16 s 110 tok/s mistral mistral-large-4-1t-a52b OK 261 ms 4.85 s 43.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 430 ms 6.32 s 34.0 tok/s stepfun step-5-preview OK 877 ms 6.68 s 34.5 tok/s minimax minimax-m3.1-flash OK 516 ms 7.48 s 28.7 tok/s meta llama-3.2-90b-vision-instruct OK 19.2 s 46.6 s 4.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta muse-glimmer-30b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a 2 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.48 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 602 ms 3.48 s 144 tok/s z glm-5.3-flash OK 3.23 s 12.1 s 19.0 tok/s minimax minimax-m3.1-flash OK 12.4 s 17.9 s 26.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.02 s 19.2 s 26.0 tok/s stepfun step-5-preview OK 22.0 s 27.3 s 18.3 tok/s mistral mistral-large-4-1t-a52b OK 70.0 s 71.0 s 7.0 tok/s google gemma-4-31b-it OK 112.1 s 122.8 s 4.1 tok/s deepseek deepseek-v4.1-flash OK 264.2 s 276.7 s 1.8 tok/s openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 7/12 models answered Fastest glm-5.3-flash 4.37 s
Model Result First token Full reply Speed z glm-5.3-flash OK 394 ms 4.37 s 52.8 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 778 ms 4.43 s 113 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.72 s 11.4 s 43.8 tok/s mistral mistral-large-4-1t-a52b OK 23.4 s 25.4 s 19.7 tok/s stepfun step-5-preview OK 26.9 s 31.9 s 15.4 tok/s deepseek deepseek-v4.1-flash OK 60.6 s 64.1 s 4.0 tok/s meta llama-3.2-90b-vision-instruct OK 58.4 s 137.3 s 2.9 tok/s google gemma-4-31b-it Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.69 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 522 ms 4.69 s 107 tok/s z glm-5.3-flash OK 1.29 s 7.12 s 39.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.92 s 11.6 s 43.3 tok/s minimax minimax-m3.1-flash OK 13.0 s 16.4 s 30.5 tok/s meta llama-3.2-90b-vision-instruct OK 334 ms 60.7 s 6.7 tok/s google gemma-4-31b-it OK 114.3 s 124.9 s 4.0 tok/s mistral mistral-large-4-1t-a52b OK 136.5 s 237.1 s 2.1 tok/s deepseek deepseek-v4.1-flash OK 297.8 s 305.0 s 1.3 tok/s stepfun step-5-preview OK 312.7 s 333.9 s 1.5 tok/s openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.30 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 706 ms 5.30 s 94.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.76 s 17.3 s 28.9 tok/s minimax minimax-m3.1-flash OK 36.7 s 45.3 s 11.0 tok/s mistral mistral-large-4-1t-a52b OK 71.0 s 75.3 s 6.6 tok/s meta llama-3.2-90b-vision-instruct OK 12.8 s 86.7 s 4.6 tok/s z glm-5.3-flash OK 167.6 s 170.5 s 1.5 tok/s google gemma-4-31b-it OK 184.3 s 195.1 s 2.6 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.19 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 816 ms 6.19 s 80.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.37 s 10.8 s 46.5 tok/s google gemma-4-31b-it OK 41.3 s 50.2 s 10.0 tok/s meta llama-3.2-90b-vision-instruct OK 7.97 s 60.8 s 6.2 tok/s openai gpt-oss-20b OK 140.7 s 145.0 s 3.0 tok/s z glm-5.3-flash OK 144.8 s 164.6 s 1.5 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.55 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 814 ms 5.55 s 90.1 tok/s minimax minimax-m3.1-flash OK 10.1 s 16.4 s 29.8 tok/s meta llama-3.2-90b-vision-instruct OK 5.70 s 60.0 s 4.7 tok/s google gemma-4-31b-it OK 131.7 s 146.0 s 3.4 tok/s openai gpt-oss-20b OK 149.3 s 154.2 s 3.1 tok/s z glm-5.3-flash OK 296.6 s 306.9 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Server error (5xx) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.44 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 662 ms 4.44 s 113 tok/s minimax minimax-m3.1-flash OK 18.4 s 25.2 s 19.8 tok/s meta llama-3.2-90b-vision-instruct OK 31.8 s 111.9 s 3.8 tok/s z glm-5.3-flash OK 170.6 s 182.8 s 1.6 tok/s openai gpt-oss-20b OK 178.4 s 201.2 s 2.5 tok/s google gemma-4-31b-it OK 235.5 s 245.7 s 2.0 tok/s deepseek deepseek-v4.1-flash OK 302.5 s 309.0 s 1.2 tok/s mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Timed out n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 9.13 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 4.02 s 9.13 s 54.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.10 s 19.1 s 26.1 tok/s mistral mistral-large-4-1t-a52b OK 20.6 s 25.9 s 19.3 tok/s minimax minimax-m3.1-flash OK 17.5 s 27.0 s 18.5 tok/s meta llama-3.2-90b-vision-instruct OK 1.09 s 45.2 s 9.2 tok/s google gemma-4-31b-it OK 135.1 s 159.8 s 3.1 tok/s openai gpt-oss-20b OK 156.6 s 160.2 s 3.1 tok/s z glm-5.3-flash OK 295.9 s 311.4 s 0.8 tok/s stepfun step-5-preview OK 333.0 s 352.2 s 1.4 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 6/12 models answered Fastest gpt-oss-20b 8.44 s
Model Result First token Full reply Speed openai gpt-oss-20b OK 2.56 s 8.44 s 59.2 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.12 s 9.39 s 53.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.53 s 34.1 s 14.7 tok/s meta llama-3.2-90b-vision-instruct OK 5.32 s 45.9 s 7.3 tok/s z glm-5.3-flash OK 142.7 s 148.0 s 2.0 tok/s google gemma-4-31b-it OK 234.1 s 244.6 s 2.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.52 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.06 s 4.52 s 111 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.18 s 10.2 s 48.8 tok/s mistral mistral-large-4-1t-a52b OK 6.09 s 18.1 s 27.6 tok/s openai gpt-oss-20b OK 19.1 s 23.5 s 21.3 tok/s minimax minimax-m3.1-flash OK 15.8 s 24.7 s 18.8 tok/s meta llama-3.2-90b-vision-instruct OK 19.6 s 58.9 s 6.5 tok/s z glm-5.3-flash OK 65.4 s 75.8 s 3.2 tok/s google gemma-4-31b-it OK 162.1 s 172.7 s 2.9 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.97 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 548 ms 5.97 s 83.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.48 s 9.60 s 52.1 tok/s openai gpt-oss-20b OK 10.3 s 16.9 s 29.6 tok/s minimax minimax-m3.1-flash OK 21.0 s 22.5 s 22.2 tok/s z glm-5.3-flash OK 31.9 s 43.9 s 5.1 tok/s google gemma-4-31b-it OK 42.5 s 53.2 s 9.4 tok/s mistral mistral-large-4-1t-a52b OK 57.8 s 59.8 s 8.4 tok/s meta llama-3.2-90b-vision-instruct OK 247.3 s 302.3 s 1.4 tok/s stepfun step-5-preview OK 283.2 s 328.9 s 1.5 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.17 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 677 ms 5.17 s 96.8 tok/s openai gpt-oss-20b OK 3.05 s 7.86 s 63.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.82 s 8.17 s 61.2 tok/s minimax minimax-m3.1-flash OK 18.2 s 24.2 s 20.7 tok/s mistral mistral-large-4-1t-a52b OK 79.4 s 86.8 s 5.8 tok/s z glm-5.3-flash OK 95.3 s 111.3 s 2.1 tok/s google gemma-4-31b-it OK 140.8 s 151.4 s 3.3 tok/s deepseek deepseek-v4.1-flash OK 237.6 s 243.1 s 1.5 tok/s meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 2 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.09 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 663 ms 5.09 s 98.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.61 s 7.96 s 62.8 tok/s openai gpt-oss-20b OK 3.14 s 7.99 s 62.6 tok/s mistral mistral-large-4-1t-a52b OK 13.7 s 16.5 s 30.2 tok/s z glm-5.3-flash OK 29.2 s 34.1 s 7.5 tok/s meta llama-3.2-90b-vision-instruct OK 472 ms 46.2 s 8.5 tok/s stepfun step-5-preview OK 33.4 s 65.0 s 7.7 tok/s google gemma-4-31b-it OK 135.7 s 146.4 s 3.4 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a minimax minimax-m3.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.58 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 579 ms 7.58 s 65.9 tok/s google gemma-4-31b-it OK 1.10 s 10.2 s 48.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.12 s 12.2 s 40.9 tok/s mistral mistral-large-4-1t-a52b OK 19.0 s 21.1 s 23.7 tok/s meta llama-3.2-90b-vision-instruct OK 209 ms 40.1 s 9.6 tok/s stepfun step-5-preview OK 6.59 s 45.2 s 11.1 tok/s minimax minimax-m3.1-flash OK 28.1 s 48.3 s 8.6 tok/s openai gpt-oss-20b OK 143.9 s 148.9 s 3.1 tok/s z glm-5.3-flash OK 151.8 s 156.1 s 1.5 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 10/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.95 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 2.74 s 6.95 s 72.0 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.53 s 15.2 s 32.9 tok/s minimax minimax-m3.1-flash OK 13.5 s 18.1 s 27.6 tok/s mistral mistral-large-4-1t-a52b OK 25.9 s 29.0 s 17.2 tok/s google gemma-4-31b-it OK 60.8 s 72.8 s 6.9 tok/s openai gpt-oss-20b OK 149.8 s 155.0 s 3.0 tok/s meta llama-3.2-90b-vision-instruct OK 90.8 s 210.9 s 1.7 tok/s z glm-5.3-flash OK 205.6 s 212.7 s 1.4 tok/s deepseek deepseek-v4.1-flash OK 222.8 s 236.2 s 1.9 tok/s stepfun step-5-preview OK 223.5 s 258.7 s 1.9 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.93 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 440 ms 3.93 s 127 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.63 s 10.3 s 48.7 tok/s openai gpt-oss-20b OK 4.79 s 10.6 s 47.1 tok/s google gemma-4-31b-it OK 6.09 s 15.0 s 33.4 tok/s mistral mistral-large-4-1t-a52b OK 6.73 s 16.2 s 30.9 tok/s stepfun step-5-preview OK 5.28 s 16.5 s 30.2 tok/s z glm-5.3-flash OK 58.9 s 66.3 s 3.4 tok/s minimax minimax-m3.1-flash OK 92.7 s 96.9 s 5.2 tok/s meta llama-3.2-90b-vision-instruct OK 156.7 s 220.9 s 2.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 2 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.37 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 548 ms 4.37 s 114 tok/s nvidia nemotron-3-ultra-550b-a55b OK 965 ms 6.85 s 73.0 tok/s mistral mistral-large-4-1t-a52b OK 8.27 s 9.06 s 55.2 tok/s stepfun step-5-preview OK 8.42 s 12.9 s 38.8 tok/s minimax minimax-m3.1-flash OK 16.9 s 22.6 s 22.1 tok/s google gemma-4-31b-it OK 55.9 s 65.2 s 7.7 tok/s openai gpt-oss-20b OK 104.6 s 108.7 s 4.6 tok/s z glm-5.3-flash OK 209.7 s 224.1 s 1.4 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.13 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 472 ms 4.13 s 121 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.65 s 8.02 s 62.3 tok/s stepfun step-5-preview OK 7.88 s 12.3 s 40.6 tok/s minimax minimax-m3.1-flash OK 16.3 s 20.4 s 24.6 tok/s meta llama-3.2-90b-vision-instruct OK 4.68 s 58.6 s 6.7 tok/s google gemma-4-31b-it OK 59.3 s 68.6 s 7.3 tok/s openai gpt-oss-20b OK 185.3 s 190.8 s 2.6 tok/s z glm-5.3-flash OK 229.6 s 241.8 s 1.2 tok/s deepseek deepseek-v4.1-flash OK 265.8 s 277.9 s 1.5 tok/s mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.00 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 813 ms 4.00 s 125 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.67 s 7.02 s 71.2 tok/s openai gpt-oss-20b OK 6.97 s 12.3 s 40.5 tok/s stepfun step-5-preview OK 6.72 s 18.2 s 27.5 tok/s minimax minimax-m3.1-flash OK 12.1 s 20.9 s 24.0 tok/s mistral mistral-large-4-1t-a52b OK 19.2 s 21.3 s 23.5 tok/s google gemma-4-31b-it OK 113.1 s 123.5 s 4.0 tok/s z glm-5.3-flash OK 132.5 s 141.0 s 2.2 tok/s meta llama-3.2-90b-vision-instruct OK 221.6 s 294.3 s 1.3 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.44 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 2.56 s 7.44 s 67.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.97 s 9.55 s 52.3 tok/s google gemma-4-31b-it OK 388 ms 13.3 s 37.6 tok/s minimax minimax-m3.1-flash OK 16.6 s 17.2 s 29.1 tok/s openai gpt-oss-20b OK 12.1 s 17.5 s 24.9 tok/s meta llama-3.2-90b-vision-instruct OK 14.1 s 73.8 s 5.5 tok/s z glm-5.3-flash OK 71.9 s 76.5 s 3.0 tok/s stepfun step-5-preview OK 216.8 s 219.4 s 2.3 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.14 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 729 ms 5.14 s 97.2 tok/s mistral mistral-large-4-1t-a52b OK 7.94 s 8.89 s 56.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 871 ms 10.2 s 49.0 tok/s minimax minimax-m3.1-flash OK 12.9 s 19.9 s 25.1 tok/s meta llama-3.2-90b-vision-instruct OK 34.5 s 108.8 s 2.8 tok/s google gemma-4-31b-it OK 111.2 s 119.8 s 4.2 tok/s openai gpt-oss-20b OK 131.9 s 136.4 s 2.9 tok/s stepfun step-5-preview OK 178.3 s 249.2 s 2.0 tok/s z glm-5.3-flash OK 271.2 s 274.8 s 0.9 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.36 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 536 ms 3.36 s 149 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.66 s 11.7 s 42.7 tok/s google gemma-4-31b-it OK 346 ms 32.9 s 15.2 tok/s mistral mistral-large-4-1t-a52b OK 54.7 s 57.0 s 8.8 tok/s stepfun step-5-preview OK 57.7 s 60.1 s 8.3 tok/s meta llama-3.2-90b-vision-instruct OK 9.12 s 94.3 s 4.2 tok/s openai gpt-oss-20b OK 144.7 s 147.8 s 3.4 tok/s z glm-5.3-flash OK 289.8 s 301.7 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a minimax minimax-m3.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 10/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.39 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 425 ms 5.39 s 92.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 6.60 s 14.1 s 35.4 tok/s minimax minimax-m3.1-flash OK 12.5 s 15.7 s 31.9 tok/s google gemma-4-31b-it OK 140 ms 16.7 s 29.9 tok/s stepfun step-5-preview OK 21.7 s 59.8 s 8.4 tok/s mistral mistral-large-4-1t-a52b OK 60.0 s 64.4 s 7.8 tok/s meta llama-3.2-90b-vision-instruct OK 10.8 s 67.5 s 5.1 tok/s openai gpt-oss-20b OK 131.5 s 138.7 s 3.6 tok/s deepseek deepseek-v4.1-flash OK 199.4 s 210.7 s 1.9 tok/s z glm-5.3-flash OK 265.6 s 269.1 s 1.1 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.16 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 638 ms 4.16 s 120 tok/s nvidia nemotron-3-ultra-550b-a55b OK 803 ms 4.33 s 116 tok/s google gemma-4-31b-it OK 376 ms 22.9 s 21.8 tok/s z glm-5.3-flash OK 13.1 s 23.2 s 12.6 tok/s stepfun step-5-preview OK 40.7 s 44.3 s 11.3 tok/s meta llama-3.2-90b-vision-instruct OK 181.8 s 248.1 s 1.5 tok/s deepseek deepseek-v4.1-flash OK 293.6 s 296.4 s 1.0 tok/s openai gpt-oss-20b Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.88 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.15 s 3.88 s 129 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.99 s 8.97 s 55.8 tok/s google gemma-4-31b-it OK 134 ms 13.2 s 37.7 tok/s stepfun step-5-preview OK 6.02 s 15.8 s 31.7 tok/s minimax minimax-m3.1-flash OK 14.3 s 22.8 s 21.1 tok/s meta llama-3.2-90b-vision-instruct OK 2.83 s 49.7 s 8.7 tok/s deepseek deepseek-v4.1-flash OK 55.0 s 58.7 s 4.8 tok/s z glm-5.3-flash OK 205.5 s 212.1 s 1.2 tok/s openai gpt-oss-20b OK 245.0 s 252.9 s 2.0 tok/s mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.75 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 438 ms 4.75 s 105 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.59 s 8.61 s 58.1 tok/s minimax minimax-m3.1-flash OK 17.8 s 20.1 s 24.8 tok/s google gemma-4-31b-it OK 5.91 s 26.3 s 19.0 tok/s z glm-5.3-flash OK 29.0 s 39.7 s 6.1 tok/s stepfun step-5-preview OK 49.6 s 54.9 s 8.9 tok/s meta llama-3.2-90b-vision-instruct OK 577 ms 91.7 s 4.5 tok/s openai gpt-oss-20b OK 120.4 s 125.2 s 3.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.92 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 2.02 s 5.92 s 84.4 tok/s stepfun step-5-preview OK 9.73 s 12.7 s 39.5 tok/s google gemma-4-31b-it OK 915 ms 16.5 s 30.4 tok/s minimax minimax-m3.1-flash OK 22.9 s 30.7 s 16.3 tok/s meta llama-3.2-90b-vision-instruct OK 12.6 s 41.5 s 7.8 tok/s z glm-5.3-flash OK 49.6 s 54.6 s 5.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 82.6 s 242.5 s 2.1 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.87 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 790 ms 5.87 s 85.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 859 ms 7.48 s 66.8 tok/s openai gpt-oss-20b OK 12.1 s 17.9 s 27.9 tok/s stepfun step-5-preview OK 9.22 s 18.0 s 27.8 tok/s google gemma-4-31b-it OK 545 ms 19.1 s 26.1 tok/s minimax minimax-m3.1-flash OK 11.4 s 20.4 s 23.9 tok/s meta llama-3.2-90b-vision-instruct OK 4.48 s 43.6 s 8.9 tok/s z glm-5.3-flash OK 42.6 s 57.6 s 5.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.74 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 750 ms 5.74 s 87.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.96 s 7.31 s 68.4 tok/s minimax minimax-m3.1-flash OK 12.5 s 17.5 s 28.6 tok/s google gemma-4-31b-it OK 322 ms 24.3 s 20.6 tok/s stepfun step-5-preview OK 39.4 s 40.5 s 12.4 tok/s z glm-5.3-flash OK 40.0 s 56.5 s 4.0 tok/s openai gpt-oss-20b OK 258.6 s 263.0 s 1.6 tok/s meta llama-3.2-90b-vision-instruct OK 237.2 s 369.9 s 1.3 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.20 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 469 ms 6.20 s 80.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.10 s 10.8 s 46.4 tok/s google gemma-4-31b-it OK 202 ms 15.5 s 32.3 tok/s minimax minimax-m3.1-flash OK 14.5 s 19.2 s 26.1 tok/s meta llama-3.2-90b-vision-instruct OK 2.11 s 58.0 s 6.4 tok/s stepfun step-5-preview OK 43.5 s 63.2 s 7.9 tok/s openai gpt-oss-20b OK 179.3 s 185.3 s 2.7 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.09 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 525 ms 5.09 s 98.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.19 s 7.96 s 62.8 tok/s meta llama-3.2-90b-vision-instruct OK 1.73 s 44.2 s 7.9 tok/s google gemma-4-31b-it OK 58.9 s 68.8 s 7.3 tok/s openai gpt-oss-20b OK 201.7 s 206.6 s 2.4 tok/s z glm-5.3-flash OK 233.7 s 236.6 s 1.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 3 days ago· NIMStats 10/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.43 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 874 ms 5.43 s 92.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.29 s 7.75 s 64.6 tok/s mistral mistral-large-4-1t-a52b OK 23.3 s 23.3 s 21.4 tok/s minimax minimax-m3.1-flash OK 17.9 s 32.0 s 15.6 tok/s z glm-5.3-flash OK 33.4 s 38.9 s 6.2 tok/s stepfun step-5-preview OK 33.3 s 47.9 s 10.4 tok/s google gemma-4-31b-it OK 96.7 s 111.0 s 4.5 tok/s openai gpt-oss-20b OK 158.1 s 163.1 s 2.9 tok/s meta llama-3.2-90b-vision-instruct OK 132.7 s 189.9 s 1.7 tok/s deepseek deepseek-v4.1-flash OK 238.9 s 242.7 s 1.0 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.12 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.02 s 5.12 s 97.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 968 ms 7.02 s 71.2 tok/s minimax minimax-m3.1-flash OK 23.1 s 26.4 s 18.9 tok/s meta llama-3.2-90b-vision-instruct OK 7.31 s 49.0 s 7.6 tok/s mistral mistral-large-4-1t-a52b OK 90.2 s 92.3 s 5.4 tok/s stepfun step-5-preview OK 117.3 s 122.6 s 4.1 tok/s google gemma-4-31b-it OK 126.1 s 141.9 s 3.5 tok/s openai gpt-oss-20b OK 169.8 s 176.6 s 2.8 tok/s z glm-5.3-flash OK 298.6 s 305.5 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.47 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 653 ms 5.47 s 91.4 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.38 s 12.1 s 41.2 tok/s minimax minimax-m3.1-flash OK 16.3 s 18.8 s 26.6 tok/s mistral mistral-large-4-1t-a52b OK 24.0 s 26.0 s 19.2 tok/s meta llama-3.2-90b-vision-instruct OK 849 ms 57.0 s 6.5 tok/s stepfun step-5-preview OK 55.9 s 59.8 s 8.4 tok/s google gemma-4-31b-it OK 100.8 s 111.5 s 4.5 tok/s openai gpt-oss-20b OK 121.9 s 124.8 s 2.5 tok/s z glm-5.3-flash OK 240.2 s 251.2 s 1.2 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.71 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 792 ms 6.71 s 74.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.79 s 8.73 s 57.3 tok/s openai gpt-oss-20b OK 16.9 s 20.4 s 24.6 tok/s stepfun step-5-preview OK 29.7 s 30.3 s 16.5 tok/s z glm-5.3-flash OK 30.2 s 34.1 s 7.0 tok/s mistral mistral-large-4-1t-a52b OK 52.1 s 55.4 s 9.0 tok/s meta llama-3.2-90b-vision-instruct OK 65.1 s 102.1 s 4.5 tok/s deepseek deepseek-v4.1-flash Network error n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.30 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 579 ms 7.30 s 68.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 4.83 s 10.0 s 49.9 tok/s stepfun step-5-preview OK 6.80 s 15.2 s 32.8 tok/s meta llama-3.2-90b-vision-instruct OK 7.78 s 58.0 s 5.9 tok/s google gemma-4-31b-it OK 67.9 s 78.2 s 6.4 tok/s mistral mistral-large-4-1t-a52b OK 62.5 s 79.7 s 6.3 tok/s openai gpt-oss-20b OK 158.2 s 166.2 s 3.0 tok/s z glm-5.3-flash OK 161.9 s 182.5 s 1.3 tok/s deepseek deepseek-v4.1-flash OK 279.2 s 285.8 s 1.5 tok/s minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.19 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 864 ms 6.19 s 80.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.54 s 9.75 s 51.3 tok/s minimax minimax-m3.1-flash OK 26.9 s 30.6 s 16.4 tok/s google gemma-4-31b-it OK 64.7 s 84.0 s 6.0 tok/s z glm-5.3-flash OK 164.8 s 167.7 s 1.3 tok/s meta llama-3.2-90b-vision-instruct OK 5.91 s 231.8 s 1.7 tok/s deepseek deepseek-v4.1-flash OK 319.0 s 323.2 s 1.2 tok/s openai gpt-oss-20b Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 3 days ago· NIMStats 10/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.70 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 783 ms 5.70 s 87.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 942 ms 7.40 s 67.5 tok/s minimax minimax-m3.1-flash OK 13.5 s 25.2 s 18.9 tok/s openai gpt-oss-20b OK 32.5 s 36.8 s 13.6 tok/s mistral mistral-large-4-1t-a52b OK 33.3 s 43.3 s 11.5 tok/s z glm-5.3-flash OK 27.9 s 44.0 s 5.1 tok/s stepfun step-5-preview OK 79.8 s 138.3 s 3.6 tok/s deepseek deepseek-v4.1-flash OK 132.7 s 145.3 s 2.1 tok/s google gemma-4-31b-it OK 284.0 s 293.1 s 1.7 tok/s meta llama-3.2-90b-vision-instruct OK 238.9 s 409.1 s 0.9 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.55 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 561 ms 3.55 s 141 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.68 s 9.08 s 55.1 tok/s mistral mistral-large-4-1t-a52b OK 10.4 s 13.0 s 38.5 tok/s stepfun step-5-preview OK 17.7 s 21.0 s 23.9 tok/s minimax minimax-m3.1-flash OK 22.7 s 28.8 s 17.4 tok/s google gemma-4-31b-it OK 67.5 s 77.8 s 6.4 tok/s openai gpt-oss-20b OK 157.0 s 163.0 s 3.1 tok/s deepseek deepseek-v4.1-flash OK 221.1 s 223.5 s 1.7 tok/s z glm-5.3-flash OK 294.6 s 297.9 s 0.8 tok/s meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.41 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.00 s 4.41 s 113 tok/s nvidia nemotron-3-ultra-550b-a55b OK 866 ms 6.41 s 78.0 tok/s stepfun step-5-preview OK 9.60 s 11.9 s 42.0 tok/s openai gpt-oss-20b OK 7.55 s 12.9 s 38.7 tok/s minimax minimax-m3.1-flash OK 11.0 s 16.4 s 30.5 tok/s z glm-5.3-flash OK 21.7 s 33.6 s 6.8 tok/s meta llama-3.2-90b-vision-instruct OK 2.58 s 46.4 s 8.2 tok/s deepseek deepseek-v4.1-flash OK 227.8 s 239.1 s 1.2 tok/s google gemma-4-31b-it OK 264.6 s 274.4 s 1.8 tok/s mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 3 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.68 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.13 s 7.68 s 65.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.57 s 9.37 s 53.4 tok/s mistral mistral-large-4-1t-a52b OK 8.10 s 13.8 s 36.3 tok/s google gemma-4-31b-it OK 43.7 s 54.0 s 9.3 tok/s meta llama-3.2-90b-vision-instruct OK 15.6 s 56.5 s 7.0 tok/s openai gpt-oss-20b OK 148.3 s 153.8 s 3.3 tok/s deepseek deepseek-v4.1-flash OK 190.9 s 201.8 s 2.1 tok/s z glm-5.3-flash OK 281.2 s 294.3 s 0.8 tok/s minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.41 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 734 ms 6.41 s 78.0 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.05 s 7.90 s 63.3 tok/s stepfun step-5-preview OK 15.6 s 31.6 s 15.8 tok/s minimax minimax-m3.1-flash OK 28.8 s 33.1 s 15.1 tok/s mistral mistral-large-4-1t-a52b OK 38.9 s 53.4 s 9.4 tok/s meta llama-3.2-90b-vision-instruct OK 3.73 s 55.1 s 6.7 tok/s google gemma-4-31b-it OK 110.2 s 120.0 s 4.2 tok/s openai gpt-oss-20b OK 165.5 s 173.1 s 2.9 tok/s z glm-5.3-flash OK 270.0 s 273.4 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 6/12 models answered Fastest nemotron-3-ultra-550b-a55b 4.65 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 794 ms 4.65 s 108 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 574 ms 6.23 s 80.2 tok/s mistral mistral-large-4-1t-a52b OK 5.65 s 10.4 s 48.0 tok/s openai gpt-oss-20b OK 11.4 s 17.4 s 28.8 tok/s z glm-5.3-flash OK 40.8 s 44.8 s 6.8 tok/s meta llama-3.2-90b-vision-instruct OK 222.8 s 264.2 s 1.6 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a minimax minimax-m3.1-flash Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.30 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 860 ms 8.30 s 60.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.31 s 8.79 s 56.9 tok/s stepfun step-5-preview OK 9.17 s 10.1 s 49.6 tok/s minimax minimax-m3.1-flash OK 6.83 s 11.8 s 36.8 tok/s openai gpt-oss-20b OK 19.0 s 25.0 s 20.0 tok/s z glm-5.3-flash OK 69.2 s 74.3 s 3.1 tok/s google gemma-4-31b-it OK 296.5 s 306.2 s 1.6 tok/s deepseek deepseek-v4.1-flash Network error n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Timed out n/a n/a n/a 4 days ago· NIMStats 6/12 models answered Fastest gpt-oss-20b 7.46 s
Model Result First token Full reply Speed openai gpt-oss-20b OK 3.98 s 7.46 s 67.0 tok/s stepfun step-5-preview OK 6.01 s 9.47 s 52.8 tok/s minimax minimax-m3.1-flash OK 23.2 s 23.9 s 21.0 tok/s z glm-5.3-flash OK 31.9 s 42.1 s 5.9 tok/s nvidia nemotron-3-ultra-550b-a55b OK 30.4 s 75.1 s 6.7 tok/s meta llama-3.2-90b-vision-instruct OK 87.2 s 138.3 s 2.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-nano-omni-30b-a3b-reasoning Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.29 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 2.79 s 7.29 s 68.6 tok/s stepfun step-5-preview OK 6.15 s 9.65 s 51.8 tok/s openai gpt-oss-20b OK 6.69 s 11.1 s 45.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.24 s 18.0 s 27.8 tok/s z glm-5.3-flash OK 31.8 s 37.5 s 6.2 tok/s mistral mistral-large-4-1t-a52b OK 49.6 s 50.5 s 9.9 tok/s deepseek deepseek-v4.1-flash OK 306.0 s 315.5 s 1.1 tok/s google gemma-4-31b-it Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.06 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 359 ms 3.06 s 163 tok/s minimax minimax-m3.1-flash OK 24.5 s 32.4 s 15.4 tok/s nvidia nemotron-3-ultra-550b-a55b OK 28.3 s 71.7 s 7.0 tok/s deepseek deepseek-v4.1-flash OK 78.9 s 88.6 s 4.0 tok/s google gemma-4-31b-it OK 128.6 s 139.4 s 3.6 tok/s openai gpt-oss-20b OK 164.6 s 169.6 s 2.6 tok/s meta llama-3.2-90b-vision-instruct OK 4.89 s 173.9 s 2.4 tok/s z glm-5.3-flash OK 238.4 s 247.2 s 1.2 tok/s mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.33 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 739 ms 6.33 s 79.0 tok/s z glm-5.3-flash OK 1.15 s 8.58 s 25.5 tok/s minimax minimax-m3.1-flash OK 12.3 s 14.0 s 35.6 tok/s openai gpt-oss-20b OK 17.6 s 23.2 s 21.6 tok/s mistral mistral-large-4-1t-a52b OK 30.4 s 32.7 s 15.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 26.2 s 101.0 s 5.0 tok/s meta llama-3.2-90b-vision-instruct OK 154.2 s 211.1 s 1.9 tok/s google gemma-4-31b-it OK 272.7 s 282.6 s 1.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Not served (404) n/a n/a n/a 4 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.25 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.20 s 7.25 s 69.0 tok/s openai gpt-oss-20b OK 10.1 s 15.6 s 32.1 tok/s minimax minimax-m3.1-flash OK 22.2 s 27.1 s 18.4 tok/s stepfun step-5-preview OK 29.7 s 32.3 s 15.5 tok/s google gemma-4-31b-it OK 10.4 s 33.4 s 15.0 tok/s meta llama-3.2-90b-vision-instruct OK 1.82 s 38.9 s 10.0 tok/s z glm-5.3-flash OK 42.0 s 45.7 s 5.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Server error (5xx) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 8/12 models answered Fastest glm-5.3-flash 3.71 s
Model Result First token Full reply Speed z glm-5.3-flash OK 1.14 s 3.71 s 60.6 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 687 ms 4.56 s 110 tok/s openai gpt-oss-20b OK 2.55 s 6.98 s 71.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.03 s 13.1 s 38.3 tok/s mistral mistral-large-4-1t-a52b OK 10.4 s 38.1 s 13.1 tok/s deepseek deepseek-v4.1-flash OK 30.8 s 40.3 s 12.4 tok/s stepfun step-5-preview OK 38.6 s 47.0 s 10.6 tok/s meta llama-3.2-90b-vision-instruct OK 75.1 s 127.8 s 3.0 tok/s google gemma-4-31b-it Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.25 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 597 ms 3.25 s 154 tok/s nvidia nemotron-3-ultra-550b-a55b OK 5.99 s 14.1 s 35.4 tok/s mistral mistral-large-4-1t-a52b OK 36.6 s 38.3 s 13.0 tok/s meta llama-3.2-90b-vision-instruct OK 18.8 s 87.7 s 4.0 tok/s google gemma-4-31b-it OK 96.3 s 106.1 s 4.7 tok/s openai gpt-oss-20b OK 133.1 s 138.8 s 3.6 tok/s deepseek deepseek-v4.1-flash OK 154.5 s 161.5 s 1.5 tok/s z glm-5.3-flash OK 165.9 s 169.5 s 1.4 tok/s minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 9.21 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 661 ms 9.21 s 54.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.71 s 9.28 s 53.9 tok/s openai gpt-oss-20b OK 33.8 s 43.3 s 11.6 tok/s mistral mistral-large-4-1t-a52b OK 50.2 s 68.6 s 7.3 tok/s google gemma-4-31b-it OK 157.1 s 167.0 s 3.0 tok/s deepseek deepseek-v4.1-flash OK 173.4 s 188.2 s 2.2 tok/s z glm-5.3-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 9/12 models answered Fastest glm-5.3-flash 7.34 s
Model Result First token Full reply Speed z glm-5.3-flash OK 1.04 s 7.34 s 31.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.87 s 7.62 s 65.6 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 724 ms 8.25 s 60.6 tok/s stepfun step-5-preview OK 16.0 s 17.9 s 28.0 tok/s minimax minimax-m3.1-flash OK 18.0 s 30.2 s 16.5 tok/s openai gpt-oss-20b OK 42.5 s 49.2 s 10.2 tok/s meta llama-3.2-90b-vision-instruct OK 63.7 s 106.3 s 3.3 tok/s mistral mistral-large-4-1t-a52b OK 102.1 s 110.8 s 4.5 tok/s deepseek deepseek-v4.1-flash OK 303.1 s 314.4 s 0.8 tok/s google gemma-4-31b-it Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 10/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 10.5 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 849 ms 10.5 s 47.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 905 ms 16.2 s 30.9 tok/s z glm-5.3-flash OK 4.35 s 16.7 s 14.5 tok/s minimax minimax-m3.1-flash OK 23.2 s 30.8 s 16.3 tok/s meta llama-3.2-90b-vision-instruct OK 24.9 s 58.3 s 7.0 tok/s mistral mistral-large-4-1t-a52b OK 79.0 s 82.7 s 6.0 tok/s google gemma-4-31b-it OK 98.6 s 108.3 s 4.6 tok/s deepseek deepseek-v4.1-flash OK 185.8 s 196.2 s 2.0 tok/s stepfun step-5-preview OK 185.0 s 218.8 s 2.3 tok/s openai gpt-oss-20b OK 271.9 s 278.3 s 1.8 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 4/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.96 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 514 ms 3.96 s 126 tok/s z glm-5.3-flash OK 58.6 s 62.6 s 4.6 tok/s google gemma-4-31b-it OK 90.4 s 99.0 s 5.1 tok/s openai gpt-oss-20b OK 135.0 s 141.1 s 3.5 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a meta llama-3.2-90b-vision-instruct Empty answer n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Timed out n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.03 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.13 s 8.03 s 62.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.30 s 14.9 s 33.6 tok/s google gemma-4-31b-it OK 88.0 s 96.9 s 5.2 tok/s openai gpt-oss-20b OK 139.4 s 144.5 s 3.5 tok/s deepseek deepseek-v4.1-flash OK 233.9 s 247.3 s 1.3 tok/s meta llama-3.2-90b-vision-instruct OK 154.1 s 268.4 s 1.2 tok/s z glm-5.3-flash Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 4/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.55 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 971 ms 7.55 s 66.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.54 s 9.07 s 55.1 tok/s meta llama-3.2-90b-vision-instruct OK 3.11 s 54.2 s 6.7 tok/s openai gpt-oss-20b OK 65.9 s 72.6 s 6.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a z glm-5.3-flash Not served (404) n/a n/a n/a minimax minimax-m3.1-flash Server error (5xx) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 7/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.50 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 979 ms 8.50 s 58.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.12 s 8.63 s 58.0 tok/s minimax minimax-m3.1-flash OK 22.2 s 25.0 s 20.0 tok/s meta llama-3.2-90b-vision-instruct OK 2.40 s 76.3 s 6.0 tok/s google gemma-4-31b-it OK 85.7 s 93.6 s 5.3 tok/s openai gpt-oss-20b OK 152.3 s 158.8 s 3.1 tok/s deepseek deepseek-v4.1-flash OK 313.7 s 324.8 s 1.5 tok/s z glm-5.3-flash Not served (404) n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 8/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.47 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 760 ms 7.47 s 67.0 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.69 s 15.9 s 31.5 tok/s google gemma-4-31b-it OK 360 ms 18.3 s 27.3 tok/s minimax minimax-m3.1-flash OK 18.8 s 21.8 s 23.0 tok/s mistral mistral-large-4-1t-a52b OK 18.9 s 25.1 s 19.9 tok/s meta llama-3.2-90b-vision-instruct OK 1.07 s 75.4 s 5.0 tok/s openai gpt-oss-20b OK 89.0 s 95.6 s 4.7 tok/s stepfun step-5-preview OK 100.2 s 183.0 s 2.7 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a z glm-5.3-flash Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 10/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.92 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 668 ms 6.92 s 72.3 tok/s nvidia nemotron-3.5-lightning-30b-a3b OK 8.62 s 8.65 s 57.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.62 s 9.25 s 54.0 tok/s minimax minimax-m3.1-flash OK 14.4 s 22.2 s 21.8 tok/s stepfun step-5-preview OK 11.2 s 33.4 s 14.9 tok/s meta llama-3.2-90b-vision-instruct OK 2.41 s 38.4 s 8.7 tok/s mistral mistral-large-4-1t-a52b OK 34.6 s 38.5 s 13.0 tok/s google gemma-4-31b-it OK 37.8 s 46.4 s 10.8 tok/s openai gpt-oss-20b OK 145.8 s 151.7 s 3.3 tok/s deepseek deepseek-v4.1-flash OK 355.3 s 367.3 s 0.8 tok/s z glm-5.3-flash Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a 4 days ago· NIMStats 6/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.26 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.08 s 8.26 s 60.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 864 ms 11.1 s 45.0 tok/s minimax minimax-m3.1-flash OK 20.8 s 21.8 s 23.0 tok/s google gemma-4-31b-it OK 84.4 s 93.3 s 5.4 tok/s z glm-5.3-flash OK 106.9 s 111.8 s 2.4 tok/s meta llama-3.2-90b-vision-instruct OK 113.9 s 196.5 s 2.1 tok/s deepseek deepseek-v4.1-flash Network error n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a mistral mistral-large-4-1t-a52b Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 9/12 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.21 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 608 ms 8.21 s 60.9 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.60 s 10.7 s 46.8 tok/s minimax minimax-m3.1-flash OK 10.5 s 27.7 s 17.9 tok/s mistral mistral-large-4-1t-a52b OK 19.2 s 36.2 s 13.8 tok/s meta llama-3.2-90b-vision-instruct OK 11.2 s 70.1 s 5.5 tok/s google gemma-4-31b-it OK 80.3 s 90.7 s 5.5 tok/s openai gpt-oss-20b OK 114.2 s 118.4 s 4.2 tok/s z glm-5.3-flash OK 271.5 s 281.2 s 0.9 tok/s deepseek deepseek-v4.1-flash OK 303.2 s 305.4 s 1.4 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 4 days ago· NIMStats 6/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 12.7 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.15 s 12.7 s 39.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.85 s 12.8 s 39.2 tok/s stepfun step-5-preview OK 22.9 s 52.8 s 9.5 tok/s z glm-5.3-flash OK 109.8 s 113.4 s 2.0 tok/s google gemma-4-31b-it OK 257.1 s 266.8 s 1.9 tok/s deepseek deepseek-v4.1-flash OK 298.8 s 300.7 s 1.7 tok/s openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 4 days ago· NIMStats 7/10 models answered Fastest nemotron-3.5-lightning-30b-a3b 5.29 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 4.85 s 5.29 s 94.4 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.02 s 8.10 s 61.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.44 s 8.56 s 58.4 tok/s google gemma-4-31b-it OK 192.8 s 203.3 s 2.5 tok/s z glm-5.3-flash OK 210.6 s 221.7 s 1.1 tok/s meta llama-3.2-90b-vision-instruct OK 178.1 s 234.6 s 1.7 tok/s deepseek deepseek-v4.1-flash OK 291.7 s 293.7 s 1.3 tok/s openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 5 days ago· NIMStats 5/10 models answered Fastest nemotron-3-ultra-550b-a55b 8.26 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 1.24 s 8.26 s 60.5 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.36 s 10.5 s 47.4 tok/s meta llama-3.2-90b-vision-instruct OK 8.12 s 61.2 s 8.2 tok/s google gemma-4-31b-it OK 145.1 s 155.7 s 3.2 tok/s z glm-5.3-flash OK 254.6 s 258.5 s 1.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Not served (404) n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest nemotron-3-ultra-550b-a55b 7.31 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 988 ms 7.31 s 68.4 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 738 ms 7.99 s 62.6 tok/s stepfun step-5-preview OK 39.0 s 44.7 s 11.2 tok/s meta llama-3.2-90b-vision-instruct OK 2.74 s 46.5 s 7.5 tok/s google gemma-4-31b-it OK 37.6 s 47.3 s 10.6 tok/s openai gpt-oss-20b OK 88.9 s 93.2 s 5.4 tok/s z glm-5.3-flash OK 297.3 s 305.7 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest step-5-preview 5.61 s
Model Result First token Full reply Speed stepfun step-5-preview OK 4.89 s 5.61 s 89.2 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.16 s 10.5 s 47.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.03 s 13.5 s 37.1 tok/s google gemma-4-31b-it OK 52.1 s 61.2 s 8.2 tok/s openai gpt-oss-20b OK 116.3 s 122.9 s 4.1 tok/s deepseek deepseek-v4.1-flash OK 274.9 s 286.8 s 0.8 tok/s meta llama-3.2-90b-vision-instruct OK 198.0 s 330.7 s 1.3 tok/s z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.42 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.00 s 8.42 s 59.4 tok/s stepfun step-5-preview OK 12.2 s 13.9 s 36.0 tok/s google gemma-4-31b-it OK 64.8 s 76.0 s 6.6 tok/s deepseek deepseek-v4.1-flash OK 338.7 s 350.5 s 1.1 tok/s z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.13 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 781 ms 8.13 s 61.5 tok/s stepfun step-5-preview OK 6.75 s 10.1 s 49.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.18 s 12.2 s 41.1 tok/s meta llama-3.2-90b-vision-instruct OK 310 ms 41.2 s 11.1 tok/s google gemma-4-31b-it OK 51.4 s 60.8 s 8.2 tok/s openai gpt-oss-20b OK 148.9 s 155.0 s 3.1 tok/s deepseek deepseek-v4.1-flash OK 302.2 s 308.0 s 1.1 tok/s z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 9.87 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 2.20 s 9.87 s 50.7 tok/s stepfun step-5-preview OK 9.24 s 11.3 s 44.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.86 s 18.7 s 26.7 tok/s meta llama-3.2-90b-vision-instruct OK 2.30 s 42.0 s 9.0 tok/s google gemma-4-31b-it OK 81.4 s 92.0 s 5.4 tok/s openai gpt-oss-20b OK 190.6 s 200.5 s 2.5 tok/s z glm-5.3-flash OK 286.9 s 289.4 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 8/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 8.83 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 3.69 s 8.83 s 56.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 6.01 s 16.9 s 29.7 tok/s deepseek deepseek-v4.1-flash OK 36.1 s 36.5 s 13.7 tok/s stepfun step-5-preview OK 48.8 s 50.9 s 9.8 tok/s meta llama-3.2-90b-vision-instruct OK 8.86 s 66.8 s 5.1 tok/s google gemma-4-31b-it OK 76.1 s 87.0 s 5.7 tok/s openai gpt-oss-20b OK 135.8 s 145.1 s 3.4 tok/s z glm-5.3-flash OK 290.4 s 295.5 s 0.8 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 5/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.08 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 294 ms 3.08 s 162 tok/s stepfun step-5-preview OK 2.62 s 3.33 s 49.0 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.62 s 8.60 s 58.1 tok/s z glm-5.3-flash OK 16.5 s 29.4 s 7.6 tok/s deepseek deepseek-v4.1-flash OK 189.1 s 198.2 s 1.9 tok/s google gemma-4-31b-it Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 8/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.47 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 632 ms 4.47 s 112 tok/s nvidia nemotron-3-ultra-550b-a55b OK 850 ms 7.32 s 68.3 tok/s deepseek deepseek-v4.1-flash OK 21.6 s 24.5 s 12.1 tok/s stepfun step-5-preview OK 42.7 s 43.2 s 5.6 tok/s google gemma-4-31b-it OK 40.3 s 50.2 s 10.0 tok/s z glm-5.3-flash OK 102.0 s 108.6 s 2.9 tok/s meta llama-3.2-90b-vision-instruct OK 92.7 s 132.8 s 2.8 tok/s openai gpt-oss-20b OK 146.2 s 151.6 s 2.7 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.91 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 624 ms 4.91 s 102 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.00 s 6.57 s 76.1 tok/s stepfun step-5-preview OK 8.09 s 10.1 s 49.3 tok/s meta llama-3.2-90b-vision-instruct OK 529 ms 114.3 s 4.0 tok/s google gemma-4-31b-it OK 92.0 s 124.6 s 4.0 tok/s openai gpt-oss-20b OK 195.9 s 197.9 s 2.5 tok/s deepseek deepseek-v4.1-flash OK 294.1 s 296.5 s 1.2 tok/s z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 5/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.12 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.17 s 7.12 s 70.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 978 ms 7.58 s 66.0 tok/s deepseek deepseek-v4.1-flash OK 40.4 s 53.9 s 5.6 tok/s z glm-5.3-flash OK 143.4 s 148.2 s 1.6 tok/s meta llama-3.2-90b-vision-instruct OK 131.9 s 180.0 s 2.3 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 5 days ago· NIMStats 5/10 models answered Fastest step-5-preview 4.60 s
Model Result First token Full reply Speed stepfun step-5-preview OK 3.45 s 4.60 s 49.8 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 742 ms 6.01 s 83.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 4.38 s 31.4 s 15.9 tok/s z glm-5.3-flash OK 138.0 s 140.4 s 1.7 tok/s meta llama-3.2-90b-vision-instruct OK 161.9 s 198.4 s 1.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest step-5-preview 6.32 s
Model Result First token Full reply Speed stepfun step-5-preview OK 2.42 s 6.32 s 70.9 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 905 ms 6.51 s 76.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 6.68 s 17.4 s 28.7 tok/s deepseek deepseek-v4.1-flash OK 42.9 s 44.6 s 7.7 tok/s meta llama-3.2-90b-vision-instruct OK 1.07 s 86.5 s 5.0 tok/s openai gpt-oss-20b OK 134.4 s 139.8 s 3.2 tok/s z glm-5.3-flash OK 292.1 s 306.7 s 0.8 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 6/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.86 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 791 ms 5.86 s 85.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 5.92 s 18.5 s 27.0 tok/s stepfun step-5-preview OK 46.8 s 73.5 s 6.8 tok/s z glm-5.3-flash OK 168.1 s 171.1 s 1.4 tok/s openai gpt-oss-20b OK 245.7 s 251.2 s 2.0 tok/s meta llama-3.2-90b-vision-instruct OK 273.3 s 321.1 s 1.1 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 6/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.07 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 736 ms 6.07 s 82.4 tok/s stepfun step-5-preview OK 14.5 s 14.5 s 34.4 tok/s nvidia nemotron-3-ultra-550b-a55b OK 5.59 s 21.1 s 23.7 tok/s meta llama-3.2-90b-vision-instruct OK 4.45 s 53.1 s 7.7 tok/s openai gpt-oss-20b OK 154.9 s 161.1 s 3.1 tok/s deepseek deepseek-v4.1-flash OK 176.8 s 185.2 s 2.7 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 6/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.53 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.66 s 6.53 s 76.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 7.72 s 19.6 s 25.5 tok/s stepfun step-5-preview OK 41.3 s 41.6 s 12.0 tok/s meta llama-3.2-90b-vision-instruct OK 2.51 s 45.8 s 10.4 tok/s openai gpt-oss-20b OK 144.4 s 149.2 s 2.7 tok/s z glm-5.3-flash OK 282.0 s 286.9 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 9.83 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 2.49 s 9.83 s 50.9 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.08 s 10.0 s 49.9 tok/s stepfun step-5-preview OK 22.4 s 24.5 s 20.4 tok/s openai gpt-oss-20b OK 179.0 s 185.3 s 2.7 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 5/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.01 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 749 ms 6.01 s 83.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.30 s 6.84 s 73.1 tok/s meta llama-3.2-90b-vision-instruct OK 407 ms 57.6 s 5.2 tok/s stepfun step-5-preview OK 64.3 s 65.4 s 3.6 tok/s openai gpt-oss-20b OK 131.7 s 137.5 s 3.6 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 5/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.63 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 656 ms 4.63 s 108 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.10 s 8.12 s 61.6 tok/s stepfun step-5-preview OK 21.7 s 34.9 s 14.3 tok/s meta llama-3.2-90b-vision-instruct OK 30.9 s 105.0 s 4.8 tok/s openai gpt-oss-20b OK 165.6 s 171.6 s 2.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.83 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 791 ms 5.83 s 85.8 tok/s stepfun step-5-preview OK 5.48 s 6.05 s 25.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.94 s 12.1 s 41.4 tok/s meta llama-3.2-90b-vision-instruct OK 4.50 s 42.8 s 9.8 tok/s deepseek deepseek-v4.1-flash OK 101.0 s 109.9 s 3.6 tok/s openai gpt-oss-20b OK 166.6 s 177.7 s 2.8 tok/s z glm-5.3-flash OK 270.3 s 281.4 s 1.4 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.50 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.33 s 6.50 s 77.0 tok/s meta llama-3.2-90b-vision-instruct OK 62.7 s 115.2 s 3.8 tok/s z glm-5.3-flash OK 201.0 s 215.4 s 1.1 tok/s openai gpt-oss-20b OK 249.2 s 260.3 s 1.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Server error (5xx) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 5 days ago· NIMStats 5/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.36 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.28 s 6.36 s 78.7 tok/s nvidia nemotron-3-ultra-550b-a55b OK 4.85 s 11.0 s 45.3 tok/s stepfun step-5-preview OK 26.3 s 26.6 s 18.8 tok/s meta llama-3.2-90b-vision-instruct OK 102.9 s 175.9 s 2.4 tok/s z glm-5.3-flash OK 223.9 s 237.8 s 1.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 5 days ago· NIMStats 4/10 models answered Fastest nemotron-3-ultra-550b-a55b 7.95 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 2.22 s 7.95 s 62.9 tok/s meta llama-3.2-90b-vision-instruct OK 773 ms 41.7 s 8.3 tok/s openai gpt-oss-20b OK 134.6 s 141.5 s 3.5 tok/s deepseek deepseek-v4.1-flash OK 148.4 s 158.1 s 2.1 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a nvidia nemotron-3-nano-omni-30b-a3b-reasoning Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Empty answer n/a n/a n/a 5 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.26 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 490 ms 3.26 s 154 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.12 s 5.37 s 93.0 tok/s stepfun step-5-preview OK 6.32 s 7.81 s 64.0 tok/s z glm-5.3-flash OK 274.1 s 281.8 s 1.0 tok/s openai gpt-oss-20b OK 292.0 s 297.3 s 1.7 tok/s deepseek deepseek-v4.1-flash OK 295.6 s 297.7 s 1.2 tok/s meta llama-3.2-90b-vision-instruct OK 277.0 s 366.5 s 1.2 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.71 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.14 s 4.71 s 106 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.04 s 8.27 s 60.5 tok/s stepfun step-5-preview OK 19.8 s 21.2 s 23.6 tok/s meta llama-3.2-90b-vision-instruct OK 28.8 s 93.2 s 5.0 tok/s openai gpt-oss-20b OK 169.2 s 175.6 s 2.8 tok/s z glm-5.3-flash OK 231.7 s 234.7 s 1.0 tok/s deepseek deepseek-v4.1-flash OK 234.7 s 248.6 s 1.7 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.73 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 858 ms 3.73 s 132 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.75 s 7.80 s 64.1 tok/s stepfun step-5-preview OK 8.51 s 9.10 s 43.9 tok/s meta llama-3.2-90b-vision-instruct OK 546 ms 46.5 s 6.9 tok/s openai gpt-oss-20b OK 158.9 s 164.4 s 3.0 tok/s z glm-5.3-flash OK 256.9 s 265.3 s 1.1 tok/s deepseek deepseek-v4.1-flash OK 267.4 s 280.6 s 1.0 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.88 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.02 s 4.88 s 103 tok/s stepfun step-5-preview OK 6.03 s 6.61 s 21.2 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.84 s 7.15 s 69.9 tok/s meta llama-3.2-90b-vision-instruct OK 12.4 s 72.4 s 4.7 tok/s openai gpt-oss-20b OK 163.4 s 165.6 s 3.0 tok/s deepseek deepseek-v4.1-flash OK 254.2 s 260.5 s 1.4 tok/s z glm-5.3-flash OK 272.7 s 279.6 s 0.9 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 5/10 models answered Fastest step-5-preview 4.91 s
Model Result First token Full reply Speed stepfun step-5-preview OK 3.49 s 4.91 s 44.2 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.20 s 5.24 s 95.4 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.48 s 11.3 s 44.3 tok/s z glm-5.3-flash OK 199.6 s 208.7 s 1.2 tok/s meta llama-3.2-90b-vision-instruct OK 197.1 s 227.1 s 1.6 tok/s deepseek deepseek-v4.1-flash Empty answer n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 4/10 models answered Fastest step-5-preview 1.65 s
Model Result First token Full reply Speed stepfun step-5-preview OK 1.06 s 1.65 s 116 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 753 ms 3.65 s 137 tok/s nvidia nemotron-3-ultra-550b-a55b OK 778 ms 5.94 s 84.1 tok/s meta llama-3.2-90b-vision-instruct OK 31.4 s 96.3 s 4.4 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a z glm-5.3-flash Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 6/10 models answered Fastest step-5-preview 3.93 s
Model Result First token Full reply Speed stepfun step-5-preview OK 2.17 s 3.93 s 127 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 599 ms 4.26 s 117 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.95 s 6.32 s 79.1 tok/s openai gpt-oss-20b OK 168.8 s 179.0 s 2.8 tok/s z glm-5.3-flash OK 263.9 s 269.1 s 1.0 tok/s deepseek deepseek-v4.1-flash OK 306.1 s 311.6 s 1.2 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a meta llama-3.2-90b-vision-instruct Empty answer n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.30 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 519 ms 4.30 s 116 tok/s nvidia nemotron-3-ultra-550b-a55b OK 629 ms 6.10 s 81.9 tok/s stepfun step-5-preview OK 8.66 s 15.3 s 32.7 tok/s deepseek deepseek-v4.1-flash OK 38.7 s 40.8 s 11.3 tok/s meta llama-3.2-90b-vision-instruct OK 12.3 s 85.5 s 4.6 tok/s z glm-5.3-flash OK 200.5 s 205.4 s 1.1 tok/s openai gpt-oss-20b OK 216.7 s 221.0 s 2.3 tok/s google gemma-4-31b-it Other error n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 5/10 models answered Fastest nemotron-3-ultra-550b-a55b 5.89 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 730 ms 5.89 s 84.8 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 916 ms 6.02 s 83.1 tok/s stepfun step-5-preview OK 10.1 s 11.0 s 45.6 tok/s z glm-5.3-flash OK 27.6 s 31.2 s 7.2 tok/s meta llama-3.2-90b-vision-instruct OK 46.7 s 120.4 s 3.6 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Server error (5xx) n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.07 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 683 ms 5.07 s 98.6 tok/s stepfun step-5-preview OK 20.3 s 20.3 s 24.6 tok/s z glm-5.3-flash OK 45.2 s 48.5 s 5.0 tok/s meta llama-3.2-90b-vision-instruct OK 39.0 s 89.5 s 4.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.49 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 593 ms 7.49 s 66.8 tok/s z glm-5.3-flash OK 6.12 s 8.43 s 30.2 tok/s stepfun step-5-preview OK 27.0 s 29.0 s 17.2 tok/s nvidia nemotron-3.5-lightning-30b-a3b OK 31.3 s 31.4 s 15.9 tok/s meta llama-3.2-90b-vision-instruct OK 16.7 s 62.5 s 6.0 tok/s openai gpt-oss-20b OK 94.3 s 99.5 s 4.3 tok/s deepseek deepseek-v4.1-flash OK 200.4 s 209.5 s 1.6 tok/s google gemma-4-31b-it Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a 6 days ago· NIMStats 5/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.25 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 705 ms 4.25 s 118 tok/s z glm-5.3-flash OK 3.79 s 8.18 s 46.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.01 s 9.59 s 52.2 tok/s stepfun step-5-preview OK 12.4 s 14.3 s 35.0 tok/s deepseek deepseek-v4.1-flash OK 14.6 s 18.3 s 18.6 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a meta llama-3.2-90b-vision-instruct Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 5/10 models answered Fastest step-5-preview 1.43 s
Model Result First token Full reply Speed stepfun step-5-preview OK 1.09 s 1.43 s 108 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 686 ms 6.46 s 77.4 tok/s meta llama-3.2-90b-vision-instruct OK 31.5 s 81.0 s 5.0 tok/s openai gpt-oss-20b OK 253.1 s 256.9 s 1.9 tok/s z glm-5.3-flash OK 272.2 s 280.0 s 0.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Other error n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 6/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.43 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.05 s 6.43 s 77.8 tok/s meta llama-3.2-90b-vision-instruct OK 1.77 s 89.2 s 5.0 tok/s deepseek deepseek-v4.1-flash OK 149.3 s 152.2 s 2.1 tok/s openai gpt-oss-20b OK 150.1 s 155.0 s 3.2 tok/s z glm-5.3-flash OK 263.8 s 269.1 s 0.9 tok/s stepfun step-5-preview OK 411.0 s 412.8 s 1.2 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.42 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 553 ms 5.42 s 88.9 tok/s meta llama-3.2-90b-vision-instruct OK 12.9 s 74.8 s 5.4 tok/s openai gpt-oss-20b OK 191.5 s 198.1 s 2.5 tok/s deepseek deepseek-v4.1-flash OK 262.2 s 265.5 s 1.2 tok/s google gemma-4-31b-it Not served (404) n/a n/a n/a z glm-5.3-flash Network error n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 6 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 7.37 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 982 ms 7.37 s 67.8 tok/s stepfun step-5-preview OK 23.8 s 25.1 s 18.5 tok/s meta llama-3.2-90b-vision-instruct OK 9.11 s 97.6 s 3.7 tok/s z glm-5.3-flash OK 106.9 s 110.9 s 2.2 tok/s deepseek deepseek-v4.1-flash Network error n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a openai gpt-oss-20b Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 5/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.35 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 689 ms 5.35 s 93.4 tok/s stepfun step-5-preview OK 6.32 s 7.24 s 69.1 tok/s meta llama-3.2-90b-vision-instruct OK 42.7 s 103.2 s 3.8 tok/s openai gpt-oss-20b OK 140.1 s 146.2 s 3.4 tok/s z glm-5.3-flash OK 300.3 s 306.2 s 0.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.90 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 794 ms 4.90 s 102 tok/s meta llama-3.2-90b-vision-instruct OK 5.35 s 73.0 s 4.4 tok/s openai gpt-oss-20b OK 287.5 s 294.0 s 1.7 tok/s z glm-5.3-flash OK 292.2 s 299.0 s 0.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Other error n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 6 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 3.94 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 496 ms 3.94 s 127 tok/s meta llama-3.2-90b-vision-instruct OK 6.58 s 80.4 s 4.7 tok/s z glm-5.3-flash OK 142.6 s 145.2 s 1.6 tok/s openai gpt-oss-20b OK 142.9 s 149.0 s 3.4 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Other error n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Empty answer n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 6 days ago· NIMStats 4/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 6.02 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 675 ms 6.02 s 83.0 tok/s meta llama-3.2-90b-vision-instruct OK 13.5 s 83.6 s 5.4 tok/s openai gpt-oss-20b OK 176.6 s 184.1 s 2.7 tok/s z glm-5.3-flash OK 274.7 s 282.7 s 0.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3-ultra-550b-a55b Server error (5xx) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a stepfun step-5-preview Timed out n/a n/a n/a 6 days ago· NIMStats 5/10 models answered Fastest nemotron-3-ultra-550b-a55b 8.06 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 1.10 s 8.06 s 62.1 tok/s stepfun step-5-preview OK 13.1 s 15.5 s 32.4 tok/s z glm-5.3-flash OK 223.0 s 228.3 s 1.1 tok/s meta llama-3.2-90b-vision-instruct OK 160.3 s 240.8 s 1.7 tok/s openai gpt-oss-20b OK 259.4 s 265.9 s 1.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Not served (404) n/a n/a n/a nvidia nemotron-3-nano-omni-30b-a3b-reasoning Server error (5xx) n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.42 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 771 ms 4.42 s 113 tok/s stepfun step-5-preview OK 11.9 s 13.6 s 36.8 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.58 s 18.9 s 26.5 tok/s google gemma-4-31b-it OK 552 ms 34.8 s 14.4 tok/s meta llama-3.2-90b-vision-instruct OK 2.88 s 38.2 s 8.5 tok/s openai gpt-oss-20b OK 43.2 s 48.7 s 10.3 tok/s z glm-5.3-flash OK 229.4 s 234.3 s 1.4 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.02 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 697 ms 5.02 s 99.7 tok/s stepfun step-5-preview OK 7.66 s 8.50 s 58.9 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.65 s 16.8 s 29.8 tok/s google gemma-4-31b-it OK 5.85 s 22.0 s 22.7 tok/s meta llama-3.2-90b-vision-instruct OK 9.73 s 79.6 s 4.9 tok/s openai gpt-oss-20b OK 154.6 s 161.9 s 3.1 tok/s z glm-5.3-flash OK 291.2 s 294.7 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 6 days ago· NIMStats 9/10 models answered Fastest nemotron-3.5-lightning-30b-a3b 6.09 s
Model Result First token Full reply Speed nvidia nemotron-3.5-lightning-30b-a3b OK 5.83 s 6.09 s 82.1 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 799 ms 6.35 s 78.7 tok/s stepfun step-5-preview OK 4.71 s 6.59 s 75.9 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.47 s 8.58 s 58.3 tok/s google gemma-4-31b-it OK 697 ms 120.1 s 4.2 tok/s meta llama-3.2-90b-vision-instruct OK 6.40 s 121.5 s 3.1 tok/s openai gpt-oss-20b OK 121.2 s 125.9 s 4.0 tok/s z glm-5.3-flash OK 302.1 s 305.8 s 1.0 tok/s deepseek deepseek-v4.1-flash OK 325.3 s 335.6 s 1.4 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a 6 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.95 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 881 ms 5.95 s 84.1 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.01 s 13.8 s 36.2 tok/s stepfun step-5-preview OK 2.54 s 16.4 s 30.5 tok/s google gemma-4-31b-it OK 11.9 s 41.9 s 11.9 tok/s meta llama-3.2-90b-vision-instruct OK 618 ms 57.5 s 7.1 tok/s openai gpt-oss-20b OK 128.4 s 133.6 s 3.7 tok/s z glm-5.3-flash OK 254.3 s 261.4 s 1.1 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 7 days ago· NIMStats 7/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.68 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 643 ms 5.68 s 88.0 tok/s nvidia nemotron-3-ultra-550b-a55b OK 15.6 s 23.5 s 21.2 tok/s stepfun step-5-preview OK 23.8 s 24.0 s 20.8 tok/s google gemma-4-31b-it OK 30.5 s 53.1 s 9.4 tok/s meta llama-3.2-90b-vision-instruct OK 31.0 s 78.4 s 4.7 tok/s openai gpt-oss-20b OK 197.4 s 200.2 s 2.5 tok/s z glm-5.3-flash OK 282.0 s 290.2 s 1.0 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 7 days ago· NIMStats 6/10 models answered Fastest nemotron-3-ultra-550b-a55b 7.20 s
Model Result First token Full reply Speed nvidia nemotron-3-ultra-550b-a55b OK 841 ms 7.20 s 69.5 tok/s stepfun step-5-preview OK 10.3 s 11.9 s 42.0 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 3.66 s 13.2 s 37.9 tok/s openai gpt-oss-20b OK 137.0 s 142.0 s 3.5 tok/s z glm-5.3-flash OK 220.5 s 223.6 s 1.1 tok/s meta llama-3.2-90b-vision-instruct OK 300.7 s 456.9 s 0.9 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a google gemma-4-31b-it Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 7 days ago· NIMStats 8/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 4.52 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 628 ms 4.52 s 111 tok/s stepfun step-5-preview OK 8.51 s 9.17 s 28.6 tok/s nvidia nemotron-3-ultra-550b-a55b OK 1.07 s 17.9 s 27.9 tok/s google gemma-4-31b-it OK 445 ms 20.3 s 24.7 tok/s meta llama-3.2-90b-vision-instruct OK 6.96 s 62.4 s 5.5 tok/s deepseek deepseek-v4.1-flash OK 107.2 s 122.7 s 2.2 tok/s openai gpt-oss-20b OK 163.1 s 168.9 s 3.0 tok/s z glm-5.3-flash OK 210.6 s 214.9 s 1.1 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 7 days ago· NIMStats 8/10 models answered Fastest nemotron-3-nano-omni-30b-a3b-reasoning 5.41 s
Model Result First token Full reply Speed nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.96 s 5.41 s 92.5 tok/s nvidia nemotron-3-ultra-550b-a55b OK 2.67 s 10.7 s 46.7 tok/s stepfun step-5-preview OK 14.8 s 17.8 s 28.1 tok/s google gemma-4-31b-it OK 2.04 s 43.0 s 11.6 tok/s meta llama-3.2-90b-vision-instruct OK 891 ms 77.1 s 5.3 tok/s openai gpt-oss-20b OK 126.9 s 131.7 s 3.1 tok/s deepseek deepseek-v4.1-flash OK 144.4 s 147.5 s 2.5 tok/s z glm-5.3-flash OK 293.3 s 300.8 s 0.8 tok/s nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a 7 days ago· NIMStats 7/10 models answered Fastest step-5-preview 4.34 s
Model Result First token Full reply Speed stepfun step-5-preview OK 3.52 s 4.34 s 56.0 tok/s nvidia nemotron-3-nano-omni-30b-a3b-reasoning OK 1.33 s 9.83 s 46.3 tok/s nvidia nemotron-3-ultra-550b-a55b OK 3.96 s 12.1 s 41.4 tok/s google gemma-4-31b-it OK 970 ms 19.0 s 26.3 tok/s meta llama-3.2-90b-vision-instruct OK 2.94 s 42.0 s 9.0 tok/s openai gpt-oss-20b OK 152.4 s 157.2 s 3.2 tok/s z glm-5.3-flash OK 299.9 s 305.5 s 0.8 tok/s deepseek deepseek-v4.1-flash Timed out n/a n/a n/a nvidia nemotron-3-super-120b-a12b Not served (404) n/a n/a n/a nvidia nemotron-3.5-lightning-30b-a3b Empty answer n/a n/a n/a
Showing the newest 150 of 709 rounds.