 ZheFox
|
9631b229b3
|
fix(gateway): add provider key concurrency and cache affinity modes
|
2026-09-01 08:06:58 +08:00 |
|
|
AAEE86
|
71b54070e8
|
feat(gateway): Codex/OpenAI Responses WebSocket 代理模式
在 /v1/responses 上支持 WebSocket 升级，把客户端帧中继到上游 Codex /
OpenAI Responses WebSocket 端点，同时保持既有的路由、鉴权、配额与用量
语义：
- 路由与准入：control/route/ai.rs 识别 WebSocket 升级请求；
websocket/ingress.rs 复用 API Key 鉴权、IP 规则与并发许可，并引入
独立的 WebSocket 连接许可
- 中继：websocket/responses/* 按 connection / session / turn 分层，
帧解析归一化、socket 写入有界、continuation 保持调度亲和性
- 配额：orchestration/codex_quota_breaker.rs 在账号配额耗尽时熔断并
自动恢复，不再直接断开客户端连接
- 用量：每个 turn 的终态用量落库，request_metadata 记录
websocket_mode / websocket_transport，管理端与 usage 视图暴露
is_websocket
- 管理端：provider 可配置 Responses WebSocket 开关
|
2026-08-17 14:50:33 +08:00 |
|
|
elky
|
6f00e9fc67
|
Improve gateway transport and usage runtime
|
2026-06-25 22:36:27 +08:00 |
|
|
elky
|
d336d1a7fa
|
Improve gateway scheduling and runtime admission
|
2026-06-24 01:53:45 +08:00 |
|
|
elky
|
5b7805181b
|
perf: queue request candidate persistence
|
2026-06-22 02:49:17 +08:00 |
|
|
fawney19
|
ef2a96bcc4
|
Remove default hot pool size cap
|
2026-05-28 17:01:03 +08:00 |
|
|
fawney19
|
54a8312e46
|
feat: add adaptive pool metrics and self-check
|
2026-05-15 02:21:11 +08:00 |
|