stabey 40434005c0 fix(gateway): use total_ms for non-stream upstream watchdog ...

When the endpoint forces upstream_stream_policy=force_non_stream while
the client streams, the local stream candidate watchdog still preferred
timeouts.first_byte_ms — a non-stream upstream produces no early first
byte, so the watchdog fired before the HTTP request_timeout and aborted
otherwise-healthy attempts at ~300s.

Read upstream_is_stream from report_context and invert the priority:
non-stream upstreams use total_ms first, falling back to first_byte_ms
and then the default; streaming upstreams keep the previous order.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

2026-05-21 15:26:42 +08:00

..

examples

refactor: extract runtime state backends

2026-05-08 00:18:12 +08:00

src

fix(gateway): use total_ms for non-stream upstream watchdog

2026-05-21 15:26:42 +08:00

build.rs

fix: pass explicit local build version

2026-05-17 16:38:22 +00:00

Cargo.toml

Merge pull request #511

2026-05-20 01:22:55 +08:00