Skip to main content

Type Alias: GatewayInferenceInputCreateCompletionRequest

type GatewayInferenceInputCreateCompletionRequest = {
  model: string | "gpt-3.5-turbo-instruct" | "davinci-002" | "babbage-002";
  prompt: string | string[] | number[] | number[][] | null;
  best_of?: number | null;
  echo?: boolean | null;
  frequency_penalty?: number | null;
  logit_bias?:   | {
   [key: string]: number;
   }
     | null;
  logprobs?: number | null;
  max_tokens?: number | null;
  n?: number | null;
  presence_penalty?: number | null;
  seed?: number | null;
  stop?: string | null | string[] | null;
  stream?: boolean | null;
  stream_options?: GatewayInferenceInputChatCompletionStreamOptions;
  suffix?: string | null;
  temperature?: number | null;
  top_p?: number | null;
  user?: string;
};

Defined in: src/models/ai-gateway-inference.ts:14

Portkey CreateCompletionRequest; strict modeled input with explicit JSON extension maps.

Example​

`GatewayInferenceInputCreateCompletionRequestSchema.parse(value);`

Properties​

model​

model: string | "gpt-3.5-turbo-instruct" | "davinci-002" | "babbage-002";

Defined in: src/models/ai-gateway-inference.ts:15

prompt​

prompt: string | string[] | number[] | number[][] | null;

Defined in: src/models/ai-gateway-inference.ts:16

best_of?​

optional best_of?: number | null;

Defined in: src/models/ai-gateway-inference.ts:17

echo?​

optional echo?: boolean | null;

Defined in: src/models/ai-gateway-inference.ts:18

frequency_penalty?​

optional frequency_penalty?: number | null;

Defined in: src/models/ai-gateway-inference.ts:19

logit_bias?​

optional logit_bias?: 
  | {
[key: string]: number;
}
  | null;

Defined in: src/models/ai-gateway-inference.ts:20

logprobs?​

optional logprobs?: number | null;

Defined in: src/models/ai-gateway-inference.ts:21

max_tokens?​

optional max_tokens?: number | null;

Defined in: src/models/ai-gateway-inference.ts:22

n?​

optional n?: number | null;

Defined in: src/models/ai-gateway-inference.ts:23

presence_penalty?​

optional presence_penalty?: number | null;

Defined in: src/models/ai-gateway-inference.ts:24

seed?​

optional seed?: number | null;

Defined in: src/models/ai-gateway-inference.ts:25

stop?​

optional stop?: string | null | string[] | null;

Defined in: src/models/ai-gateway-inference.ts:26

stream?​

optional stream?: boolean | null;

Defined in: src/models/ai-gateway-inference.ts:27

stream_options?​

optional stream_options?: GatewayInferenceInputChatCompletionStreamOptions;

Defined in: src/models/ai-gateway-inference.ts:28

suffix?​

optional suffix?: string | null;

Defined in: src/models/ai-gateway-inference.ts:29

temperature?​

optional temperature?: number | null;

Defined in: src/models/ai-gateway-inference.ts:30

top_p?​

optional top_p?: number | null;

Defined in: src/models/ai-gateway-inference.ts:31

user?​

optional user?: string;

Defined in: src/models/ai-gateway-inference.ts:32