OctopusX

OpenAI

延迟—

吞吐量—

上传速率—

上下文长度128K tokens

最大输出16384 tokens

上传价格—每百万

输出价格—每百万

缓存读取—每百万

缓存写入—每百万

性能统计

平均TPS—

平均延迟—

平均成功率—

TPS—

TTFT—

延迟—

成功率—

成功率

速度

代码示例

curl ${API_BASE_URL}/v1/chat/completions \
  -H "Authorization: Bearer <YOUR_API_KEY>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o",
    "messages": [
      {
        "role": "user",
        "content": "Hello"
      }
    ]
  }'

将 <YOUR_API_KEY> 替换为你在令牌管理页面生成的 API Key。

认证方式

所有请求必须携带 Authorization: Bearer <TOKEN> 请求头。

接口路径

POST

openai

支持的参数

参数类型默认值说明

float0.0This setting aims to control the repetition of tokens based on how often they appear in the input. It tries to use less frequently those tokens that appear more in the input, proportional to how frequently they occur. Token penalty scales with the number of occurrences. Negative values will encourage token reuse.

map-Accepts a JSON object that maps tokens (specified by their token ID in the tokenizer) to an associated bias value from -100 to 100. Mathematically, the bias is added to the logits generated by the model prior to sampling. The exact effect will vary per model, but values between -1 and 1 should decrease or increase likelihood of selection; values like -100 or 100 should result in a ban or exclusive selection of the relevant token.

boolean-Whether to return log probabilities of the output tokens or not. If true, returns the log probabilities of each output token returned.

integer-This sets the upper limit for the number of tokens the model can generate in response. It won't produce more than this limit. The maximum value is the context length minus the prompt length.

float0.0Adjusts how often the model repeats specific tokens already used in the input. Higher values make such repetition less likely, while negative values do the opposite. Token penalty does not scale with the number of occurrences. Negative values will encourage token reuse.

map-Forces the model to produce specific output format. Setting to `{ "type": "json_object" }` enables JSON mode, which guarantees the message the model generates is valid JSON. **Note**: when using JSON mode, you should also instruct the model to produce JSON yourself via a system or user message.

integer-If specified, the inferencing will sample deterministically, such that repeated requests with the same seed and parameters should return the same result. Determinism is not guaranteed for some models.

array-Stop generation immediately if the model encounter any token specified in the stop array.

boolean-If the model can return structured outputs using response\_format json\_schema.

float1.0This setting influences the variety in the model's responses. Lower values lead to more predictable and typical responses, while higher values encourage more diverse and less common responses. At 0, the model always gives the same response for a given input.

string or object-Controls which (if any) tool is called by the model. 'none' means the model will not call any tool and instead generates a message. 'auto' means the model can pick between generating a message or calling one or more tools. 'required' means the model must call one or more tools. Specifying a particular tool via `{"type": "function", "function": {"name": "my_function"}}` forces the model to call that tool.

array-Tool calling parameter, following OpenAI's tool calling request shape. For non-OpenAI providers, it will be transformed accordingly. [Click here to learn more about tool calling](/docs/guides/features/tool-calling)

integer-An integer between 0 and 20 specifying the number of most likely tokens to return at each token position, each with an associated log probability. logprobs must be set to true if this parameter is used.

float1.0This setting limits the model's choices to a percentage of likely tokens: only the top tokens whose probabilities add up to P. A lower value makes the model's responses more predictable, while the default setting allows for a full range of token choices. Think of it like a dynamic Top-K.

map-Configures native web search options for models and providers that support web-connected answers.

速率限制

分组RPMTPMRPD

RPM = 每分钟请求数，TPM = 每分钟 Token 数，RPD = 每天请求数。限制按令牌分组生效。

价格

分组计费类型价格摘要

OpenAI: gpt-4o