elky
fc92c4f431
perf(gateway): scale request hot paths for 20k streams
...
Shard and singleflight hot-path caches, batch and prioritize candidate and usage lifecycle persistence, and extend database and pressure-test instrumentation for 20k concurrent streams.
2026-07-22 02:11:08 +08:00
MMEXA
20b27a13b2
feat(codex): 按操作语义路由 Responses V2 压缩
...
(cherry picked from commit 2fc604e047
2026-07-16 00:34:42 +08:00
MMEXA
dfa121dd5b
feat(openai): align GPT-5.6 and Codex request contracts
2026-07-11 07:40:12 +08:00
elky
6f00e9fc67
Improve gateway transport and usage runtime
2026-06-25 22:36:27 +08:00
elky
d336d1a7fa
Improve gateway scheduling and runtime admission
2026-06-24 01:53:45 +08:00
MMEXA
3455faf7da
修复格式转换优先级保持的首轮候选排序
...
让开启格式转换优先级保持的跨格式候选进入首轮候选页。
普通跨格式候选仍延后到后续页，保持原有兜底语义。
2026-05-29 22:01:11 +08:00
fawney19
f76bbaab52
feat: support api key ip restriction rules
2026-05-20 16:11:49 +08:00
RWDai
2a3593d9c5
Update planner auth snapshot fixtures
2026-05-18 20:48:14 +08:00
fawney19
92813e6122
feat: add routing profile scheduling policies
2026-05-18 11:03:49 +08:00
fawney19
fa73655134
refactor: isolate dispatch scheduling core
2026-05-12 13:15:41 +08:00
fawney19
09146f8cdd
fix: tighten model candidate matching scopes
2026-05-12 00:52:19 +08:00
fawney19
a703acd1fe
feat(proxy): record tunnel stability metrics
2026-05-08 22:03:17 +08:00
fawney19
bfda9b3e78
Capture TLS fingerprints in report context
2026-05-06 15:02:44 +08:00
RWDai
bcd542f7ee
feat: pass session affinity through planner inputs
2026-05-05 11:23:54 +08:00
fawney19
6f00cabe96
Lazy load requested model candidates
2026-05-03 20:56:31 +08:00
fawney19
c4ea042eb4
feat: add model directive management
2026-05-03 14:48:25 +08:00
fawney19
c130d0e2c9
refactor ai serving modules and crates
2026-05-02 13:23:54 +08:00
elky