Skip to main content

Includes 694 hourly rounds up to 2026-11-16 from NIMStats by Mauro Druwel (source), measured with a different prompt and timeout. Our own probe adds a round every 30 minutes.

nvidia

nemotron-3-ultra-550b-a55b

Serving

Rank 5 of 15 Last probed (22 min ago)

nvidia/nemotron-3-ultra-550b-a55b answered 92.6% of probes on the NVIDIA NIM free API in the last 14 days, with a median time to first token of 1.72 s and 49.9 tok/s. It ranks 5 of 15 tracked models.

92.6% Uptime 301/325 probes
80/ 100 Score 27 round wins
1.72 s First token p95 7.60 s
9.59 s Full reply median
1.79 s Best reply fastest in range
49.9tok/s Throughput median

Model vs. median

Against the median of models that answered, last 14 days.

Uptime
92.6% 79.4%
13 pts above median
First token
1.72 s 13.0 s
7.6× better than median
Full reply
9.59 s 22.6 s
2.4× better than median
Throughput
49.9 tok/s 21.3 tok/s
2.3× better than median

nemotron-3-ultra-550b-a55b median of answering models

Error breakdown

24 failed of 325 probes, last 14 days.

FailureProbesShare of failures
Empty answer10 41.7%
Timed out5 20.8%
Server error (5xx)5 20.8%
Network error4 16.7%

Time to first token

Each probe. Lower is better.

0 ms50.0 s100.0 s150.0 s200.0 s11-03 17:0011-17 16:13 UTC
answered no answer

Throughput

Tokens per second after the first token, each probe. Higher is better.

0.0 tok/s125 tok/s250 tok/s375 tok/s500 tok/s11-03 17:0011-17 16:13 UTC
answered no answer

Availability heatmap

Last 7 days by UTC hour.

all answered some failed none answered not probed

Run history

Last 20 probes.

TimeResultFirst tokenFull replySpeed
OK782 ms4.79 s50.0 tok/s
OK546 ms6.45 s33.0 tok/s
OK382 ms4.34 s50.6 tok/s
OK405 ms5.39 s40.1 tok/s
OK877 ms6.50 s35.6 tok/s
OK406 ms4.13 s53.6 tok/s
OK1.59 s4.87 s60.9 tok/s
OK397 ms2.50 s95.1 tok/s
OK461 ms6.72 s32.0 tok/s
OK414 ms7.04 s30.2 tok/s
OK369 ms13.7 s15.0 tok/s
OK717 ms3.83 s64.3 tok/s
OK2.64 s10.7 s46.9 tok/s
OK1.76 s10.7 s46.6 tok/s
OK436 ms3.64 s57.7 tok/s
OK3.56 s11.2 s44.7 tok/s
OK1.39 s15.6 s32.0 tok/s
OK5.59 s11.7 s42.9 tok/s
OK1.08 s8.68 s57.6 tok/s
OK2.51 s7.81 s64.0 tok/s

Call nemotron-3-ultra-550b-a55b

The endpoint is OpenAI-compatible.

Create a free key at build.nvidia.com, then:

curl https://integrate.api.nvidia.com/v1/chat/completions \
  -H "Authorization: Bearer $NVIDIA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/nemotron-3-ultra-550b-a55b",
    "messages": [{"role": "user", "content": "Hello"}],
    "max_tokens": 256,
    "stream": true
  }'

Other models answering

Top of the leaderboard right now.