Includes 694 hourly rounds up to 2026-11-16 from NIMStats by Mauro Druwel (source), measured with a different prompt and timeout. Our own probe adds a round every 30 minutes.
nemotron-3.5-lightning-30b-a3b
Servingnvidia/nemotron-3.5-lightning-30b-a3b answered 100% of probes on the NVIDIA NIM free API in the last 24 hours, with a median time to first token of 190 ms and 163 tok/s. It ranks 1 of 15 tracked models.
Model vs. median
Against the median of models that answered, last 24 hours.
nemotron-3.5-lightning-30b-a3b median of answering models
Error breakdown
0 failed of 12 probes, last 24 hours.
No failed probes in this range.
Time to first token
Each probe. Lower is better.
Throughput
Tokens per second after the first token, each probe. Higher is better.
Availability heatmap
Last 7 days by UTC hour.
all answered some failed none answered not probed
Run history
Last 20 probes.
| Time | Result | First token | Full reply | Speed |
|---|---|---|---|---|
| OK | 163 ms | 1.38 s | 164 tok/s | |
| OK | 173 ms | 4.98 s | 41.6 tok/s | |
| OK | 205 ms | 1.36 s | 173 tok/s | |
| OK | 190 ms | 1.41 s | 163 tok/s | |
| OK | 305 ms | 1.60 s | 154 tok/s | |
| OK | 187 ms | 1.22 s | 193 tok/s | |
| OK | 251 ms | 1.37 s | 178 tok/s | |
| OK | 224 ms | 1.58 s | 148 tok/s | |
| OK | 200 ms | 2.38 s | 91.9 tok/s | |
| OK | 167 ms | 1.34 s | 171 tok/s | |
| OK | 157 ms | 1.74 s | 126 tok/s | |
| OK | 197 ms | 1.13 s | 215 tok/s |
Call nemotron-3.5-lightning-30b-a3b
The endpoint is OpenAI-compatible.
Create a free key at build.nvidia.com, then:
curl https://integrate.api.nvidia.com/v1/chat/completions \
-H "Authorization: Bearer $NVIDIA_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "nvidia/nemotron-3.5-lightning-30b-a3b",
"messages": [{"role": "user", "content": "Hello"}],
"max_tokens": 256,
"stream": true
}'Other models answering
Top of the leaderboard right now.
- 95 nvidia nemotron-3.5-bolt-e4b 118 ms first token · 83.8 tok/s compare
- 94 nvidia nemotron-3-nano-omni-30b-a3b-reasoning 179 ms first token · 90.5 tok/s compare
- 93 nvidia nemotron-3.5-super-vl-120b-a12b 334 ms first token · 126 tok/s compare
- 90 poolside laguna-xs-2.1 171 ms first token · 31.0 tok/s compare
- 89 nvidia nemotron-3-ultra-550b-a55b 414 ms first token · 40.1 tok/s compare
- 82 mistral mistral-large-4-1t-a52b 505 ms first token · 7.8 tok/s compare