Quickstart

Make your first request to the Infyrence Gateway in three steps. The gateway is OpenAI-compatible, so you can use the official OpenAI SDKs (or plain HTTP) by pointing the base URL at https://api.infyrence.com/v1.

Create an API key

Your API key is a secret. Store it in an environment variable, never commit it to source control, and never expose it in client-side code.

Keep it handy as an environment variable:

export INFYRENCE_API_KEY="sk-..."

Point the base URL at Infyrence

Every request goes to the base URL https://api.infyrence.com/v1 and authenticates with your key as a Bearer token:

Authorization: Bearer sk-...

If you already use an OpenAI SDK, set the base URL and the API key. No other code change is required.

The model field accepts any id returned by GET /v1/models. Example ids include claude-sonnet-5, gpt-5.5, and gemini-3.1-pro. Always call GET /v1/models for the live list available to your account.

Make a chat completion

Send a POST to /v1/chat/completions with a model and a list of messages.

curl https://api.infyrence.com/v1/chat/completions \
  -H "Authorization: Bearer $INFYRENCE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-sonnet-5",
    "messages": [
      { "role": "system", "content": "You are a helpful assistant." },
      { "role": "user", "content": "Explain quantum entanglement in one sentence." }
    ]
  }'

from openai import OpenAI

client = OpenAI(
    base_url="https://api.infyrence.com/v1",
    api_key="sk-...",  # or os.environ["INFYRENCE_API_KEY"]
)

completion = client.chat.completions.create(
    model="claude-sonnet-5",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Explain quantum entanglement in one sentence."},
    ],
)

print(completion.choices[0].message.content)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.infyrence.com/v1",
  apiKey: process.env.INFYRENCE_API_KEY, // "sk-..."
});

const completion = await client.chat.completions.create({
  model: "claude-sonnet-5",
  messages: [
    { role: "system", content: "You are a helpful assistant." },
    { role: "user", content: "Explain quantum entanglement in one sentence." },
  ],
});

console.log(completion.choices[0].message.content);

The response

A non-streaming request returns a single chat.completion JSON object. The generated text is in choices[0].message.content, and token counts are in usage.

{
  "id": "chatcmpl-...",
  "object": "chat.completion",
  "created": 1710000000,
  "model": "claude-sonnet-5",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "Quantum entanglement is when two particles share a single quantum state, so measuring one instantly determines the other, no matter the distance between them."
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 24,
    "completion_tokens": 31,
    "total_tokens": 55
  }
}

Every response includes an X-Request-Id header. Include it when you contact support so a request can be traced quickly.

Stream the response

Set stream: true to receive the response incrementally as Server-Sent Events. Each event is a data: line carrying a chat.completion.chunk object, and the stream ends with a final data: [DONE] line. The text for each chunk arrives in choices[0].delta.content.

curl https://api.infyrence.com/v1/chat/completions \
  -H "Authorization: Bearer $INFYRENCE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-5.5",
    "messages": [
      { "role": "user", "content": "Write a haiku about the edge." }
    ],
    "stream": true
  }'

from openai import OpenAI

client = OpenAI(
    base_url="https://api.infyrence.com/v1",
    api_key="sk-...",
)

stream = client.chat.completions.create(
    model="gpt-5.5",
    messages=[{"role": "user", "content": "Write a haiku about the edge."}],
    stream=True,
)

for chunk in stream:
    delta = chunk.choices[0].delta.content
    if delta:
        print(delta, end="", flush=True)

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.infyrence.com/v1",
  apiKey: process.env.INFYRENCE_API_KEY,
});

const stream = await client.chat.completions.create({
  model: "gpt-5.5",
  messages: [{ role: "user", content: "Write a haiku about the edge." }],
  stream: true,
});

for await (const chunk of stream) {
  const delta = chunk.choices[0]?.delta?.content;
  if (delta) process.stdout.write(delta);
}

Next steps

Browse models

Call GET /v1/models to see every model available to your account.

Chat completions reference

Full request and response fields, plus every parameter you can send.

Authentication

How Bearer tokens work and how to rotate your keys.

Pricing

Usage-based, per-model rates for input and output tokens.

Get started

Guides

API reference

The response

Stream the response

Next steps

Browse models

Chat completions reference

Authentication

Pricing

​The response

​Stream the response

​Next steps

Browse models

Chat completions reference

Authentication

Pricing

The response

Stream the response

Next steps