RWDai
bcd542f7ee
feat: pass session affinity through planner inputs
2026-05-05 11:23:54 +08:00
RWDai
37da4e245a
feat: scope tunnel affinity by client session
2026-05-05 11:23:54 +08:00
RWDai
9ef7952da5
fix: keep scheduler affinity out of runtime checks
2026-05-05 11:23:54 +08:00
RWDai
eb8878695a
feat: thread session affinity through scheduler selection
2026-05-05 11:23:54 +08:00
RWDai
c596d82dec
feat: pass session scope into scheduler cache
2026-05-05 11:23:54 +08:00
RWDai
96dd3fa4ca
feat: add gateway session affinity adapters
2026-05-05 11:23:54 +08:00
RWDai
14eeff8f75
fix: keep affinity out of scheduler eligibility
2026-05-05 11:23:54 +08:00
RWDai
2cbbd9ca36
feat: add session-aware scheduler keys
2026-05-05 11:23:54 +08:00
fawney19
627eb4f335
Merge pull request #371 from Kayphoon/feature/embedding-model-support
...
feat: add embedding and rerank support
v0.7.0-rc22
2026-05-04 12:56:11 +08:00
fawney19
8dd4135f7c
Fix provider key insert placeholder order
2026-05-04 12:21:54 +08:00
Kayphoon
6bdd7792eb
fix: repair embedding rerank CI checks
2026-05-04 11:33:00 +08:00
fawney19
099653f732
Cap Codex pool cooldowns and add key circuit breaker
2026-05-04 02:15:32 +08:00
fawney19
1d62722d47
Improve Codex model fetching
2026-05-04 01:16:56 +08:00
fawney19
fb642f7d62
feat: improve OAuth provider configuration
2026-05-04 00:18:05 +08:00
fawney19
cb5b8ee1ee
Use Rust build metadata for system version
2026-05-03 22:06:16 +08:00
fawney19
b4a8c5dde2
Format execution runtime transport imports
2026-05-03 21:52:15 +08:00
fawney19
53a5e18b20
Merge pull request #370 from yao177/aether-rust-pioneer
...
fix(proxy): record manual proxy node traffic
2026-05-03 21:40:20 +08:00
fawney19
6f00cabe96
Lazy load requested model candidates
2026-05-03 20:56:31 +08:00
fawney19
a24e4a793d
Refactor pool candidate scheduling
2026-05-03 20:14:29 +08:00
fawney19
8ebee9922c
fix: return auth mismatch key setting in provider key list
2026-05-03 20:11:49 +08:00
Yao177
c3d97b8c16
fix(proxy): record manual proxy node traffic
...
- add manual proxy traffic mutations to the data layer
- record sync and stream outcomes for manual proxy requests
- prevent tunnel proxy nodes from receiving manual traffic updates
2026-05-03 18:38:04 +08:00
Kayphoon
5abe664d65
feat: add embedding and rerank support
2026-05-03 17:32:41 +08:00
jiuwovo-ai
3e2eca4fd0
fix: 修复手动代理节点请求不计数及延迟/心跳不显示的问题 ( #368 )
...
* fix: 修复手动代理节点请求不计数及延迟/心跳不显示的问题
问题描述:
- 手动添加的代理节点请求数始终为0,不会递增
- 手动代理节点的延迟和最后心跳时间不显示
根因:
Rust 重写版中缺失了 Python 版的手动代理节点请求计数逻辑。
隧道节点通过心跳上报计数,但手动节点没有心跳机制,
需要在 usage recording 路径中递增计数并更新延迟信息。
修复方案:
1. 在 ExecutionPlan 中提取 proxy 信息,注入到 request_metadata
2. 在 request_metadata 白名单中添加 proxy 字段
3. 新增 INCREMENT_MANUAL_PROXY_NODE_REQUESTS_SQL,
递增 total_requests/failed_requests,
同时更新 avg_latency_ms 和 last_heartbeat_at
4. 在 ProxyNodeWriteRepository trait 新增 increment_manual_node_requests 方法
5. 在 write_event_record 中解析 request_metadata 中的 proxy 信息,
对非隧道模式的手动节点调用递增方法
6. 为 GatewayDataState 实现 ManualProxyNodeCounter trait
影响范围:
- 仅影响手动代理节点的统计数据
- 隧道节点不受影响(继续通过心跳计数)
- 不影响请求转发逻辑
* style: cargo fmt
---------
Co-authored-by: root <root@ser406777952330.local >
2026-05-03 14:50:36 +08:00
fawney19
c4ea042eb4
feat: add model directive management
2026-05-03 14:48:25 +08:00
Kayphoon
fe27fb17fb
feat: add provider-key concurrent limit ( #352 )
...
* feat: add provider-key concurrent limit
* Fix provider key concurrent limit checks
---------
Co-authored-by: fawney19 <elky0401@gmail.com >
2026-05-03 01:55:23 +08:00
fawney19
11c5884d4f
Remove API format rate multiplier field
2026-05-03 00:55:59 +08:00
fawney19
e3ea2d1451
feat: configure auth channel mismatch formats
2026-05-03 00:49:22 +08:00
fawney19
3a770306cc
refactor: separate request auth channel from route kind
...
Extract request_auth_channel as a distinct routing dimension to distinguish
between api_key and bearer_like authentication methods. This improves routing
clarity by decoupling authentication mechanism from route classification.
2026-05-02 21:23:33 +08:00
fawney19
47ee8b9c13
refactor: fold ai surfaces into formats
2026-05-02 18:19:39 +08:00
jiuwovo-ai
bfd1ea72b3
fix: codex free accounts incorrectly marked as quota exhausted ( #366 )
...
* fix: codex free accounts incorrectly marked as quota exhausted when skip_exhausted_accounts enabled
- Cross-validate stored exhausted flag against window used_ratio in snapshot reader
- Guard has_credits:false check with window data presence in upstream_metadata fallback
- Add windows.is_empty() precondition to exhausted_by_credits in snapshot builder
Free codex accounts have has_credits:false (they use window-based quotas, not credits),
but the old logic treated this as credits depleted, skipping actual window usage checks.
This caused all free accounts to be incorrectly marked exhausted.
* test: cover codex free quota windows
---------
Co-authored-by: root <root@ser488556369540.local >
Co-authored-by: fawney19 <elky0401@gmail.com >
2026-05-02 14:11:29 +08:00
fawney19
c130d0e2c9
refactor ai serving modules and crates
2026-05-02 13:23:54 +08:00
fawney19
4fc7cecf30
Fix OAuth token import and table filters
2026-05-01 02:14:49 +08:00
fawney19
9570e5c2c1
Fix legacy Claude and Gemini auth migration
v0.7.0-rc21
2026-04-30 18:01:58 +08:00
fawney19
33aa70c22b
fix scheduler affinity candidate selection
2026-04-30 16:27:24 +08:00
fawney19
558abfcfa3
Route request origin through ai pipeline facade
2026-04-30 12:15:51 +08:00
fawney19
7fcb9e6292
feat(usage): record request origin metadata ( #362 )
...
Record client IP and User-Agent in usage request_metadata for local execution requests without adding schema, API, or table fields.
References #357 and supersedes #358 .
Co-authored-by: RWDai <27391645+RWDai@users.noreply.github.com >
2026-04-30 11:26:56 +08:00
RWDai
2b5247b9a8
fix(data): repair request candidate epoch created_at ( #343 )
...
Co-authored-by: fawney19 <elky0401@gmail.com >
2026-04-30 09:23:21 +08:00
fawney19
fa47e8a3c0
feat: add select all to access limit dropdowns
2026-04-30 00:45:53 +08:00
Entropy.Xu
4d59d518d1
fix: correct API key expiry and dashboard savings ( #361 )
2026-04-30 00:35:32 +08:00
fawney19
9e2faa7e5b
Tighten local auth allow-list matching
2026-04-30 00:26:33 +08:00
fawney19
37392d8774
fix(ai): allow null OpenAI Responses error fields
2026-04-29 21:12:14 +08:00
fawney19
a16550249b
fix: allow empty provider secrets to attempt requests
2026-04-29 18:55:52 +08:00
fawney19
d6de917878
Fix key API format auth help
2026-04-29 17:35:16 +08:00
fawney19
e751289dfb
Support per-format provider key auth
2026-04-29 15:46:50 +08:00
fawney19
07a319259b
Normalize canonical API formats
2026-04-29 10:20:41 +08:00
fawney19
02ad67fe33
fix(test): update openai format identifier from cli to responses
2026-04-28 21:04:38 +08:00
github-actions[bot]
655e369f21
chore(proxy): update download links for proxy-v0.3.3
v0.7.0-rc20
2026-04-28 12:04:24 +00:00
fawney19
a9b809a32c
chore(proxy): bump version to 0.3.3
proxy-v0.3.3
2026-04-28 19:57:29 +08:00
fawney19
230e7d6259
Normalize management token prefixes
2026-04-28 19:46:38 +08:00
fawney19
3d20c05ef7
Fix OAuth refresh through tunnel proxy
2026-04-28 19:45:34 +08:00