Experiential
ModelsObservability
Star us on GitHubJoin the DiscordDocs
Sign in
Continue with GoogleContinue with GitHub
or
Models

Gemma 4 31b It

gemma-4-31b-itby GeminiZDR enforceable
Try in Chat

Context

262K

Max output

262K

Price per million tokens

$0.090in$0.34out

Released

-

Waterfall

  1. 1N
    Novita via Experiential Cloud$0.090/$0.3499.9% up--
  2. 2
    greenference via Experiential Cloud$0.15/$0.4299.9% up--

Quickstart

I want you to route my LLM calls for "gemma-4-31b-it" through the Experiential gateway instead of calling the provider directly. It speaks the OpenAI Chat Completions API, so this is a base-URL and key swap. Please:

1. Point the client at https://api.experientiallabs.jp/v1 as the base URL.
2. Securely ask me for my API key. Authenticate with my Experiential key from EXPLABS_API_KEY. I can create one under Settings -> API Keys.
3. Use the model id "gemma-4-31b-it" exactly.
4. Update every place my code builds an LLM client for this model to use that base URL and key, leaving streaming and tool-calls as they are.
5. Make one test call and show me the reply plus the token usage, so we confirm it runs on my Experiential credits.

Tell me which files you changed.
CapabilitiesAccepts text

Sampling

Temperature*0-2Top-p*0.01-1Top-k*Stop sequences*

Tools & structure

Tools*Strict tools*Parallel tool calls*Structured output*

Reasoning

Reasoning*none · minimal · low · medium · high · xhigh · maxDefaultmedium

Streaming

Streaming

Limits

Max output16,384

Sending an unsupported field? See error reference

Benchmarks8
BenchmarkScoreSource
MMLU-ProHugging Face · Aug 202685.2%Hugging Face · Aug 2026
GPQA DiamondHugging Face · Aug 202684.3%Hugging Face · Aug 2026
AIME 2025Hugging Face · Aug 202687.1%Hugging Face · Aug 2026
AIME 2026Hugging Face · Aug 202689.2%Hugging Face · Aug 2026
Humanity's Last ExamHugging Face · Aug 202619.5%Hugging Face · Aug 2026
MATH-500Hugging Face · Aug 202687.9%Hugging Face · Aug 2026
IFEvalHugging Face · Aug 202694.6%Hugging Face · Aug 2026
LMArena EloLMArena · Aug 20261442LMArena · Aug 2026
Providers serving this model6
Status
greenference via Experiential Cloudexperientialno datano data99.9%#3 / 3262K262K$0.15$0.42cache$0.058-no dataactiveestimated
Gemini via Experiential Cloudexperientialno datano data99.9%#1 / 3262K262K$0$0$0-no dataactive-
NNovita via Experiential Cloudexperientialno datano data99.9%#2 / 3262K262K$0.090$0.34no data-ZDRactive-
Azure Foundryno datano data99.9%-262K262K$0.61≈$2.94≈no data≈-no dataactiveestimated
Fireworksaccounts/fireworks/models/gemma-4-31b-itno datano data99.9%-262K262K$0.61≈$2.94≈no data≈-ZDRactiveestimated
Fireworksaccounts/fireworks/models/gemma-4-31b-it-nvfp4no datano data99.9%-262K262K$0.61≈$2.94≈no data≈nvfp4ZDRactiveestimated
Hugging Face