Commit Graph

1394 Commits

Author SHA1 Message Date
RWDai
628329e493 fix: scope scheduler effects by session 2026-05-05 12:25:07 +08:00
RWDai
82e7a0080e fix: prefer client session adapters 2026-05-05 12:25:07 +08:00
RWDai
17b06bd4d6 refactor: abstract model fetch strategies 2026-05-05 11:23:54 +08:00
RWDai
5fcb49b08e feat: wire specialized planner session affinity 2026-05-05 11:23:54 +08:00
RWDai
044ef59d81 feat: wire OpenAI responses session affinity 2026-05-05 11:23:54 +08:00
RWDai
51b191ad2c feat: wire OpenAI chat session affinity 2026-05-05 11:23:54 +08:00
RWDai
e890a5c2f1 feat: wire standard family session affinity 2026-05-05 11:23:54 +08:00
RWDai
591dcf5cf2 feat: carry session affinity through candidate materialization 2026-05-05 11:23:54 +08:00
RWDai
58d6b2add6 feat: scope planner affinity cache by session 2026-05-05 11:23:54 +08:00
RWDai
bcd542f7ee feat: pass session affinity through planner inputs 2026-05-05 11:23:54 +08:00
RWDai
37da4e245a feat: scope tunnel affinity by client session 2026-05-05 11:23:54 +08:00
RWDai
9ef7952da5 fix: keep scheduler affinity out of runtime checks 2026-05-05 11:23:54 +08:00
RWDai
eb8878695a feat: thread session affinity through scheduler selection 2026-05-05 11:23:54 +08:00
RWDai
c596d82dec feat: pass session scope into scheduler cache 2026-05-05 11:23:54 +08:00
RWDai
96dd3fa4ca feat: add gateway session affinity adapters 2026-05-05 11:23:54 +08:00
RWDai
14eeff8f75 fix: keep affinity out of scheduler eligibility 2026-05-05 11:23:54 +08:00
RWDai
2cbbd9ca36 feat: add session-aware scheduler keys 2026-05-05 11:23:54 +08:00
fawney19
627eb4f335 Merge pull request #371 from Kayphoon/feature/embedding-model-support
feat: add embedding and rerank support
v0.7.0-rc22
2026-05-04 12:56:11 +08:00
fawney19
8dd4135f7c Fix provider key insert placeholder order 2026-05-04 12:21:54 +08:00
Kayphoon
6bdd7792eb fix: repair embedding rerank CI checks 2026-05-04 11:33:00 +08:00
fawney19
099653f732 Cap Codex pool cooldowns and add key circuit breaker 2026-05-04 02:15:32 +08:00
fawney19
1d62722d47 Improve Codex model fetching 2026-05-04 01:16:56 +08:00
fawney19
fb642f7d62 feat: improve OAuth provider configuration 2026-05-04 00:18:05 +08:00
fawney19
cb5b8ee1ee Use Rust build metadata for system version 2026-05-03 22:06:16 +08:00
fawney19
b4a8c5dde2 Format execution runtime transport imports 2026-05-03 21:52:15 +08:00
fawney19
53a5e18b20 Merge pull request #370 from yao177/aether-rust-pioneer
fix(proxy): record manual proxy node traffic
2026-05-03 21:40:20 +08:00
fawney19
6f00cabe96 Lazy load requested model candidates 2026-05-03 20:56:31 +08:00
fawney19
a24e4a793d Refactor pool candidate scheduling 2026-05-03 20:14:29 +08:00
fawney19
8ebee9922c fix: return auth mismatch key setting in provider key list 2026-05-03 20:11:49 +08:00
Yao177
c3d97b8c16 fix(proxy): record manual proxy node traffic
- add manual proxy traffic mutations to the data layer
- record sync and stream outcomes for manual proxy requests
- prevent tunnel proxy nodes from receiving manual traffic updates
2026-05-03 18:38:04 +08:00
Kayphoon
5abe664d65 feat: add embedding and rerank support 2026-05-03 17:32:41 +08:00
jiuwovo-ai
3e2eca4fd0 fix: 修复手动代理节点请求不计数及延迟/心跳不显示的问题 (#368)
* fix: 修复手动代理节点请求不计数及延迟/心跳不显示的问题

问题描述:
- 手动添加的代理节点请求数始终为0,不会递增
- 手动代理节点的延迟和最后心跳时间不显示

根因:
Rust 重写版中缺失了 Python 版的手动代理节点请求计数逻辑。
隧道节点通过心跳上报计数,但手动节点没有心跳机制,
需要在 usage recording 路径中递增计数并更新延迟信息。

修复方案:
1. 在 ExecutionPlan 中提取 proxy 信息,注入到 request_metadata
2. 在 request_metadata 白名单中添加 proxy 字段
3. 新增 INCREMENT_MANUAL_PROXY_NODE_REQUESTS_SQL,
   递增 total_requests/failed_requests,
   同时更新 avg_latency_ms 和 last_heartbeat_at
4. 在 ProxyNodeWriteRepository trait 新增 increment_manual_node_requests 方法
5. 在 write_event_record 中解析 request_metadata 中的 proxy 信息,
   对非隧道模式的手动节点调用递增方法
6. 为 GatewayDataState 实现 ManualProxyNodeCounter trait

影响范围:
- 仅影响手动代理节点的统计数据
- 隧道节点不受影响(继续通过心跳计数)
- 不影响请求转发逻辑

* style: cargo fmt

---------

Co-authored-by: root <root@ser406777952330.local>
2026-05-03 14:50:36 +08:00
fawney19
c4ea042eb4 feat: add model directive management 2026-05-03 14:48:25 +08:00
Kayphoon
fe27fb17fb feat: add provider-key concurrent limit (#352)
* feat: add provider-key concurrent limit

* Fix provider key concurrent limit checks

---------

Co-authored-by: fawney19 <elky0401@gmail.com>
2026-05-03 01:55:23 +08:00
fawney19
11c5884d4f Remove API format rate multiplier field 2026-05-03 00:55:59 +08:00
fawney19
e3ea2d1451 feat: configure auth channel mismatch formats 2026-05-03 00:49:22 +08:00
fawney19
3a770306cc refactor: separate request auth channel from route kind
Extract request_auth_channel as a distinct routing dimension to distinguish
between api_key and bearer_like authentication methods. This improves routing
clarity by decoupling authentication mechanism from route classification.
2026-05-02 21:23:33 +08:00
fawney19
47ee8b9c13 refactor: fold ai surfaces into formats 2026-05-02 18:19:39 +08:00
jiuwovo-ai
bfd1ea72b3 fix: codex free accounts incorrectly marked as quota exhausted (#366)
* fix: codex free accounts incorrectly marked as quota exhausted when skip_exhausted_accounts enabled

- Cross-validate stored exhausted flag against window used_ratio in snapshot reader
- Guard has_credits:false check with window data presence in upstream_metadata fallback
- Add windows.is_empty() precondition to exhausted_by_credits in snapshot builder

Free codex accounts have has_credits:false (they use window-based quotas, not credits),
but the old logic treated this as credits depleted, skipping actual window usage checks.
This caused all free accounts to be incorrectly marked exhausted.

* test: cover codex free quota windows

---------

Co-authored-by: root <root@ser488556369540.local>
Co-authored-by: fawney19 <elky0401@gmail.com>
2026-05-02 14:11:29 +08:00
fawney19
c130d0e2c9 refactor ai serving modules and crates 2026-05-02 13:23:54 +08:00
fawney19
4fc7cecf30 Fix OAuth token import and table filters 2026-05-01 02:14:49 +08:00
fawney19
9570e5c2c1 Fix legacy Claude and Gemini auth migration v0.7.0-rc21 2026-04-30 18:01:58 +08:00
fawney19
33aa70c22b fix scheduler affinity candidate selection 2026-04-30 16:27:24 +08:00
fawney19
558abfcfa3 Route request origin through ai pipeline facade 2026-04-30 12:15:51 +08:00
fawney19
7fcb9e6292 feat(usage): record request origin metadata (#362)
Record client IP and User-Agent in usage request_metadata for local execution requests without adding schema, API, or table fields.

References #357 and supersedes #358.

Co-authored-by: RWDai <27391645+RWDai@users.noreply.github.com>
2026-04-30 11:26:56 +08:00
RWDai
2b5247b9a8 fix(data): repair request candidate epoch created_at (#343)
Co-authored-by: fawney19 <elky0401@gmail.com>
2026-04-30 09:23:21 +08:00
fawney19
fa47e8a3c0 feat: add select all to access limit dropdowns 2026-04-30 00:45:53 +08:00
Entropy.Xu
4d59d518d1 fix: correct API key expiry and dashboard savings (#361) 2026-04-30 00:35:32 +08:00
fawney19
9e2faa7e5b Tighten local auth allow-list matching 2026-04-30 00:26:33 +08:00
fawney19
37392d8774 fix(ai): allow null OpenAI Responses error fields 2026-04-29 21:12:14 +08:00