OpenAI 兼容请求
OpenAI 兼容请求
curl http://127.0.0.1:8000/v1/chat/completions -H 'Content-Type: application/json' -d '{
"model": "<模型名>",
"messages": [{"role": "user", "content": "你好"}],
"temperature": 0.7
}'Python SDK
Python SDK
from openai import OpenAI
client = OpenAI(base_url="http://127.0.0.1:8000/v1", api_key="EMPTY")
r = client.chat.completions.create(
model="<模型名>",
messages=[{"role": "user", "content": "你好"}],
temperature=0.2,
)经验用法：抽取、分类、代码类任务用低温度（0~0.3）；创作类可到 0.7~1.0；与 top_p 一般只调其中一个。