Skip to main content

Interface: GatewayInferenceRequestOptions

Defined in: src/ai-gateway/inference-client.ts:91

Per-call cancellation, deadlines and provider/routing headers.

Example​

`await inference.createChatCompletion(body, { signal: controller.signal });`

Properties​

signal?​

optional signal?: AbortSignal;

Defined in: src/ai-gateway/inference-client.ts:92

timeoutMs?​

optional timeoutMs?: number;

Defined in: src/ai-gateway/inference-client.ts:93

numRetries?​

optional numRetries?: number;

Defined in: src/ai-gateway/inference-client.ts:95

Opt-in retries may replay a billable generation; streams are never replayed after headers.

headers?​

optional headers?: Record<string, string>;

Defined in: src/ai-gateway/inference-client.ts:97

x-portkey-* routing/observability headers or OpenAI-Beta; authentication cannot be overridden.