dayuan.jiang 62e07f5f9c feat: add append_diagram tool for truncation continuation ...

When LLM output hits maxOutputTokens mid-generation, instead of
failing with an error loop, the system now:

1. Detects truncation (missing </root> in XML)
2. Stores partial XML and tells LLM to use new append_diagram tool
3. LLM continues generating from where it stopped
4. Fragments are accumulated until XML is complete
5. Server limits to 5 steps via stepCountIs(5)

Key changes:
- Add append_diagram tool definition in route.ts
- Add append_diagram handler in chat-panel.tsx
- Track continuation mode separately from error mode
- Continuation mode has unlimited retries (not counted against limit)
- Error mode still limited to MAX_AUTO_RETRY_COUNT (1)
- Update system prompts to document append_diagram tool

2025-12-14 09:38:47 +09:00

..

route.ts

feat: add append_diagram tool for truncation continuation

2025-12-14 09:38:47 +09:00

xml_guide.md

feat: add XML structure guide to system prompt for smaller models (#51)

2025-12-03 16:14:53 +09:00