Skip to main content

Includes 694 hourly rounds up to 2026-11-16 from NIMStats by Mauro Druwel (source), measured with a different prompt and timeout. Our own probe adds a round every 30 minutes.

google

gemma-4-31b-it

Unstable

Rank 11 of 15 Last probed (9 min ago)

google/gemma-4-31b-it answered 33.3% of probes on the NVIDIA NIM free API in the last 24 hours, with a median time to first token of 59.1 s and 20.5 tok/s. It ranks 11 of 15 tracked models.

33.3% Uptime 4/12 probes
31/ 100 Score 0 round wins
59.1 s First token p95 154.0 s
66.2 s Full reply median
40.6 s Best reply fastest in range
20.5tok/s Throughput median

Model vs. median

Against the median of models that answered, last 24 hours.

Uptime
33.3% 100%
67 pts below median
First token
59.1 s 414 ms
143× worse than median
Full reply
66.2 s 4.91 s
13× worse than median
Throughput
20.5 tok/s 31.0 tok/s
1.5× worse than median

gemma-4-31b-it median of answering models

Error breakdown

8 failed of 12 probes, last 24 hours.

FailureProbesShare of failures
Timed out8 100%

Time to first token

Each probe. Lower is better.

0 ms50.0 s100.0 s150.0 s200.0 s11-17 10:4311-17 16:13 UTC
answered no answer

Throughput

Tokens per second after the first token, each probe. Higher is better.

0.0 tok/s12.5 tok/s25.0 tok/s37.5 tok/s50.0 tok/s11-17 10:4311-17 16:13 UTC
answered no answer

Availability heatmap

Last 7 days by UTC hour.

all answered some failed none answered not probed

Run history

Last 20 probes.

TimeResultFirst tokenFull replySpeed
Timed outn/an/an/a
Timed outn/an/an/a
OK97.7 s102.1 s33.2 tok/s
Timed outn/an/an/a
Timed outn/an/an/a
OK154.0 s160.6 s20.5 tok/s
Timed outn/an/an/a
Timed outn/an/an/a
OK59.1 s66.2 s19.3 tok/s
Timed outn/an/an/a
Timed outn/an/an/a
OK36.3 s40.6 s31.8 tok/s

Call gemma-4-31b-it

The endpoint is OpenAI-compatible.

Create a free key at build.nvidia.com, then:

curl https://integrate.api.nvidia.com/v1/chat/completions \
  -H "Authorization: Bearer $NVIDIA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "google/gemma-4-31b-it",
    "messages": [{"role": "user", "content": "Hello"}],
    "max_tokens": 256,
    "stream": true
  }'

Other models answering

Top of the leaderboard right now.