Includes 694 hourly rounds up to 2026-11-16 from NIMStats by Mauro Druwel (source), measured with a different prompt and timeout. Our own probe adds a round every 30 minutes.
nemotron-3.5-lightning-30b-a3b
Unstablenvidia/nemotron-3.5-lightning-30b-a3b answered 12.0% of probes on the NVIDIA NIM free API in the last 7 days, with a median time to first token of 197 ms and 163 tok/s. It ranks 14 of 15 tracked models.
Model vs. median
Against the median of models that answered, last 7 days.
nemotron-3.5-lightning-30b-a3b median of answering models
Error breakdown
139 failed of 158 probes, last 7 days.
| Failure | Probes | Share of failures |
|---|---|---|
| Empty answer | 138 | 99.3% |
| Timed out | 1 | 0.7% |
Time to first token
Each probe. Lower is better.
Throughput
Tokens per second after the first token, each probe. Higher is better.
Availability heatmap
Last 7 days by UTC hour.
all answered some failed none answered not probed
Run history
Last 20 probes.
| Time | Result | First token | Full reply | Speed |
|---|---|---|---|---|
| OK | 163 ms | 1.38 s | 164 tok/s | |
| OK | 173 ms | 4.98 s | 41.6 tok/s | |
| OK | 205 ms | 1.36 s | 173 tok/s | |
| OK | 190 ms | 1.41 s | 163 tok/s | |
| OK | 305 ms | 1.60 s | 154 tok/s | |
| OK | 187 ms | 1.22 s | 193 tok/s | |
| OK | 251 ms | 1.37 s | 178 tok/s | |
| OK | 224 ms | 1.58 s | 148 tok/s | |
| OK | 200 ms | 2.38 s | 91.9 tok/s | |
| OK | 167 ms | 1.34 s | 171 tok/s | |
| OK | 157 ms | 1.74 s | 126 tok/s | |
| OK | 197 ms | 1.13 s | 215 tok/s | |
| Empty answer | n/a | n/a | n/a | |
| Empty answer | n/a | n/a | n/a | |
| OK | 196 ms | 1.34 s | 175 tok/s | |
| Empty answer | n/a | n/a | n/a | |
| Empty answer | n/a | n/a | n/a | |
| Empty answer | n/a | n/a | n/a | |
| Empty answer | n/a | n/a | n/a | |
| Empty answer | n/a | n/a | n/a |
Call nemotron-3.5-lightning-30b-a3b
The endpoint is OpenAI-compatible.
Create a free key at build.nvidia.com, then:
curl https://integrate.api.nvidia.com/v1/chat/completions \
-H "Authorization: Bearer $NVIDIA_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "nvidia/nemotron-3.5-lightning-30b-a3b",
"messages": [{"role": "user", "content": "Hello"}],
"max_tokens": 256,
"stream": true
}'Other models answering
Top of the leaderboard right now.
- 95 nvidia nemotron-3.5-bolt-e4b 114 ms first token · 86.3 tok/s compare
- 93 nvidia nemotron-3.5-super-vl-120b-a12b 343 ms first token · 126 tok/s compare
- 91 poolside laguna-xs-2.1 175 ms first token · 39.8 tok/s compare
- 88 nvidia nemotron-3-nano-omni-30b-a3b-reasoning 731 ms first token · 88.0 tok/s compare
- 79 nvidia nemotron-3-ultra-550b-a55b 1.75 s first token · 48.0 tok/s compare
- 62 meta muse-glimmer-30b 26.4 s first token · 8.2 tok/s compare