📄 中文摘要
网站现在需要与两种受众进行交流：搜索引擎爬虫和大型语言模型（LLMs）。这两者的需求不同，内容的读取方式也不同，而服务于它们的文件几乎没有共同之处。robots.txt 自1994年起便存在，旨在告知爬虫哪些页面可以访问，哪些不可以。尽管在过去的28年里，robots.txt作为一种非正式标准被广泛遵循，但对llms.txt的了解却相对较少。llms.txt是为了满足大型语言模型的需求而设计的，开发者需要理解这两者的不同，以便更好地管理网站内容的可访问性。
robots.txt 与 llms.txt：有什么区别以及为什么重要
出处: robots.txt vs llms.txt: What's the difference and why it matters
发布: 2026年2月27日
📄 English Summary
robots.txt vs llms.txt: What's the difference and why it matters
Websites now communicate with two distinct audiences: search engine crawlers and large language models (LLMs). These entities have different needs and read content in unique ways, with the files that serve them having little in common. robots.txt has been in existence since 1994, designed to inform crawlers which pages they can or cannot access. While robots.txt has been widely followed as an informal standard for 28 years, knowledge about llms.txt is relatively scarce. llms.txt is specifically created to cater to the requirements of large language models, and developers need to understand the differences between these two files to better manage the accessibility of their website content.