Long Conversation Creates Two Risks

As history grows, the runtime must control both cost and answer quality.

Context Growth
Cost
  • Tokens ↑
  • Latency ↑
  • Cache Hit ↓
Conversation History Keeps Growing
T1
T5
T10
T20
T50
Runtime decides what stays raw, what becomes memory, and what stays stable.
Quality
  • Noise ↑
  • State Drift ↑
  • Hallucination Risk ↑