上下文窗口在欺骗你：如何真正使用128K标记

Many models boast about their context window sizes, such as 128K tokens or 200K tokens, claiming that users can input entire codebases. However, practical experience with the Claude model on an 80K token Node.js project revealed that it identified a bug in an irrelevant file while ignoring the actual issue in the specified file. This indicates that large context windows do not guarantee equal attention across all information. Research has shown that LLMs tend to focus more on the beginning and end of the context, with significantly reduced attention to the middle. This phenomenon can lead to critical information being overlooked, ultimately affecting the efficiency of problem-solving.