Seonglae ChoCWA, Context Window Architecture
After thinking and response, let agent to choose to keep think procedure into the context or not.
The real value of an AI application isn't just the LLM, but the system intelligently managing its context.
Overall methods
- Keep-It-All – The Simple Approach
- Sliding Window – Focus on Recent Messages
- Summarization – Distill the Important Parts
- Retrieval-Based Memory – Smart Recall
- Agent-Based Context Management – Access Through Tools
