Skip to main content

Includes 694 hourly rounds up to 2026-11-16 from NIMStats by Mauro Druwel (source), measured with a different prompt and timeout. Our own probe adds a round every 30 minutes.

nvidia

nemotron-3.5-lightning-30b-a3b

Serving

Rank 1 of 15 Last probed (9 min ago)

nvidia/nemotron-3.5-lightning-30b-a3b answered 100% of probes on the NVIDIA NIM free API in the last 24 hours, with a median time to first token of 190 ms and 163 tok/s. It ranks 1 of 15 tracked models.

100% Uptime 12/12 probes
96/ 100 Score 8 round wins
190 ms First token p95 305 ms
1.38 s Full reply median
1.13 s Best reply fastest in range
163tok/s Throughput median

Model vs. median

Against the median of models that answered, last 24 hours.

Uptime
100% 100%
at the median
First token
190 ms 414 ms
2.2× better than median
Full reply
1.38 s 4.91 s
3.6× better than median
Throughput
163 tok/s 31.0 tok/s
5.3× better than median

nemotron-3.5-lightning-30b-a3b median of answering models

Error breakdown

0 failed of 12 probes, last 24 hours.

No failed probes in this range.

Time to first token

Each probe. Lower is better.

0 ms125 ms250 ms375 ms500 ms11-17 10:4311-17 16:13 UTC
answered no answer

Throughput

Tokens per second after the first token, each probe. Higher is better.

0.0 tok/s62.5 tok/s125 tok/s188 tok/s250 tok/s11-17 10:4311-17 16:13 UTC
answered no answer

Availability heatmap

Last 7 days by UTC hour.

all answered some failed none answered not probed

Run history

Last 20 probes.

TimeResultFirst tokenFull replySpeed
OK163 ms1.38 s164 tok/s
OK173 ms4.98 s41.6 tok/s
OK205 ms1.36 s173 tok/s
OK190 ms1.41 s163 tok/s
OK305 ms1.60 s154 tok/s
OK187 ms1.22 s193 tok/s
OK251 ms1.37 s178 tok/s
OK224 ms1.58 s148 tok/s
OK200 ms2.38 s91.9 tok/s
OK167 ms1.34 s171 tok/s
OK157 ms1.74 s126 tok/s
OK197 ms1.13 s215 tok/s

Call nemotron-3.5-lightning-30b-a3b

The endpoint is OpenAI-compatible.

Create a free key at build.nvidia.com, then:

curl https://integrate.api.nvidia.com/v1/chat/completions \
  -H "Authorization: Bearer $NVIDIA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/nemotron-3.5-lightning-30b-a3b",
    "messages": [{"role": "user", "content": "Hello"}],
    "max_tokens": 256,
    "stream": true
  }'

Other models answering

Top of the leaderboard right now.