In real-life practical coding scenarios, we primarily use multi-turn chat, making it crucial to improve multi-turn ability. The biggest issues arise from Compounding Error and misalignment between human perspective and AI understanding. Therefore, when iterating improvements, it's important to provide context dumps while clearly specifying the human user's context summary, identified problems, and focus areas. The bias introduced by this approach is relatively minimal compared to the frustration and inefficiency caused by misalignment.
Voice input is closer to real-life conversation and can enhance quality by delivering richer context compared to keyboard input.
Multi-Session Chat(MSC) Dataset
The authors provided annotated summary of each session and summarizer trained with the summaries.
aclanthology.org
https://aclanthology.org/2022.acl-long.356.pdf
Multi turn conversation is the weak joint
arxiv.org
https://arxiv.org/pdf/2505.06120

Seonglae Cho