Includes 694 hourly rounds up to 2026-11-16 from NIMStats by Mauro Druwel (source), measured with a different prompt and timeout. Our own probe adds a round every 30 minutes.
gemma-4-31b-it
Unstablegoogle/gemma-4-31b-it answered 33.3% of probes on the NVIDIA NIM free API in the last 24 hours, with a median time to first token of 59.1 s and 20.5 tok/s. It ranks 11 of 15 tracked models.
Model vs. median
Against the median of models that answered, last 24 hours.
gemma-4-31b-it median of answering models
Error breakdown
8 failed of 12 probes, last 24 hours.
| Failure | Probes | Share of failures |
|---|---|---|
| Timed out | 8 | 100% |
Time to first token
Each probe. Lower is better.
Throughput
Tokens per second after the first token, each probe. Higher is better.
Availability heatmap
Last 7 days by UTC hour.
all answered some failed none answered not probed
Run history
Last 20 probes.
| Time | Result | First token | Full reply | Speed |
|---|---|---|---|---|
| Timed out | n/a | n/a | n/a | |
| Timed out | n/a | n/a | n/a | |
| OK | 97.7 s | 102.1 s | 33.2 tok/s | |
| Timed out | n/a | n/a | n/a | |
| Timed out | n/a | n/a | n/a | |
| OK | 154.0 s | 160.6 s | 20.5 tok/s | |
| Timed out | n/a | n/a | n/a | |
| Timed out | n/a | n/a | n/a | |
| OK | 59.1 s | 66.2 s | 19.3 tok/s | |
| Timed out | n/a | n/a | n/a | |
| Timed out | n/a | n/a | n/a | |
| OK | 36.3 s | 40.6 s | 31.8 tok/s |
Call gemma-4-31b-it
The endpoint is OpenAI-compatible.
Create a free key at build.nvidia.com, then:
curl https://integrate.api.nvidia.com/v1/chat/completions \
-H "Authorization: Bearer $NVIDIA_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "google/gemma-4-31b-it",
"messages": [{"role": "user", "content": "Hello"}],
"max_tokens": 256,
"stream": true
}'Other models answering
Top of the leaderboard right now.
- 96 nvidia nemotron-3.5-lightning-30b-a3b 190 ms first token · 163 tok/s compare
- 95 nvidia nemotron-3.5-bolt-e4b 118 ms first token · 83.8 tok/s compare
- 94 nvidia nemotron-3-nano-omni-30b-a3b-reasoning 179 ms first token · 90.5 tok/s compare
- 93 nvidia nemotron-3.5-super-vl-120b-a12b 334 ms first token · 126 tok/s compare
- 90 poolside laguna-xs-2.1 171 ms first token · 31.0 tok/s compare
- 89 nvidia nemotron-3-ultra-550b-a55b 414 ms first token · 40.1 tok/s compare