i/Aether
1
0
Fork 0
mirror of https://github.com/fawney19/Aether.git synced 2026-10-10 19:29:50 +08:00
Code Issues Packages Projects Releases Wiki Activity

perf(gateway): scale request hot paths for 20k streams

Browse Source 
Shard and singleflight hot-path caches, batch and prioritize candidate and usage lifecycle persistence, and extend database and pressure-test instrumentation for 20k concurrent streams.
This commit is contained in:
elky
2026-07-22 02:11:08 +08:00
parent 7756c0913f
commit fc92c4f431
124 changed files with 36325 additions and 3217 deletions
Download Patch File Download Diff File Expand all files Collapse all files
apps/aether-gateway/src/executor/outcome.rs
+2 -2
View File
@@ -345,7 +345,7 @@ pub(crate) async fn record_failed_usage_for_exhausted_request(
state
.usage_runtime
.record_terminal_event_direct(
state.data.as_ref(),
state.usage_lifecycle_data_state().as_ref(),
UsageEvent::new(UsageEventType::Failed, request_id, data),
)
.await;
@@ -484,7 +484,7 @@ pub(crate) async fn record_failed_usage_for_runtime_miss_request(
state
.usage_runtime
.record_terminal_event_direct(
state.data.as_ref(),
state.usage_lifecycle_data_state().as_ref(),
UsageEvent::new(UsageEventType::Failed, request_id, data),
)
.await;