Dayuan Jiang c7d0260328 feat: add Bedrock prompt caching for system and conversation messages (#32) ...

* feat: add Bedrock prompt caching for system and conversation messages

- Add cache point to system message (2558+ tokens cached)
- Add cache point to last assistant message in conversation history
- This caches the entire conversation prefix for subsequent requests
- Reduces latency and costs for multi-turn conversations

* refactor: remove duplicated system prompt

2025-12-01 10:43:33 +09:00

..

route.ts

feat: add Bedrock prompt caching for system and conversation messages (#32)

2025-12-01 10:43:33 +09:00

xml_guide.md

minor: fix the prompt

2025-03-25 10:56:08 +00:00