OpenAI Compatible Chat Completion

Authorization

AuthorizationRequiredBearer <token>

Module-specific API Key (Bearer token format, starting with 'mk_') for accessing the LLM Gateway (/gateway).

In: header

Request Body

application/jsonRequired

modelstring

messagesRequiredarray<object>

streamboolean

Default: false

toolsarray<object>

tool_choicestring | object

userstring

temperaturenumber

Format: "float"

max_tokensinteger

top_pnumber

Format: "float"

ninteger

Default: 1

stopstring | array<string>

presence_penaltynumber

Format: "float"

frequency_penaltynumber

Format: "float"

logit_biasobject

curl -X POST "http://localhost:8000/gateway/chat/completions" \
  -H "Authorization: Bearer <token>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "string",
    "messages": [
      {
        "role": "user",
        "content": "string",
        "tool_calls": [
          {
            "id": "string",
            "type": "function",
            "function": {
              "name": "string",
              "arguments": "string"
            }
          }
        ],
        "tool_call_id": "string",
        "name": "string"
      }
    ],
    "stream": false,
    "tools": [
      {}
    ],
    "tool_choice": "string",
    "user": "string",
    "temperature": 0.1,
    "max_tokens": 0,
    "top_p": 0.1,
    "n": 1,
    "stop": "string",
    "presence_penalty": 0.1,
    "frequency_penalty": 0.1,
    "logit_bias": {
      "property1": 0.1,
      "property2": 0.1
    }
  }'

Successful Response (Streaming or JSON)

{
  "id": "string",
  "object": "chat.completion",
  "created": 0,
  "model": "string",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "user",
        "content": "string",
        "tool_calls": [
          {
            "id": "string",
            "type": "function",
            "function": {
              "name": "string",
              "arguments": "string"
            }
          }
        ],
        "tool_call_id": "string",
        "name": "string"
      },
      "finish_reason": "string"
    }
  ],
  "usage": {
    "prompt_tokens": 0,
    "total_tokens": 0
  }
}

OpenAI Compatible Chat Completion

Authorization

Request Body

Response

TypeScript