Experiential
ModelsObservability
Star us on GitHubJoin the DiscordDocs
Sign in
Continue with GoogleContinue with GitHub
or
Models

GPT-4o (Batch)

gpt-4o-batchby GPT
Try in Chat

Context

128K

Max output

16K

Price per million tokens

$1.25in$0.63cached$5out

Released

May 2024

Waterfall

  1. 1
    OpenAI via Experiential Cloud$1.25/$599.9% up--

Quickstart

I want you to route my LLM calls for "gpt-4o-batch" through the Experiential gateway instead of calling the provider directly. It speaks the OpenAI Chat Completions API, so this is a base-URL and key swap. Please:

1. Point the client at https://api.experientiallabs.jp/v1 as the base URL.
2. Securely ask me for my API key. Authenticate with my Experiential key from EXPLABS_API_KEY. I can create one under Settings -> API Keys.
3. Use the model id "gpt-4o-batch" exactly.
4. Update every place my code builds an LLM client for this model to use that base URL and key, leaving streaming and tool-calls as they are.
5. Make one test call and show me the reply plus the token usage, so we confirm it runs on my Experiential credits.

Tell me which files you changed.
CapabilitiesAccepts text, image, pdf

Sampling

Temperature0-2Top-p0-1Logprobs

Tools & structure

ToolsStrict toolsParallel tool callsStructured output

Streaming

Streaming

Limits

Max output16,384

Sending an unsupported field? See error referenceOpenAI docs

Providers serving this model1
Status
OpenAI via Experiential Cloudexperientialno datano data99.9%#1 / 1128K16K$1.25$5cache$0.63Write 5m: $1.56-no dataactive-
Release notes