OpenAI's crawler read llms.txt 7 times across 83 websites in 12 weeks.
Read the original at www.ezy.ai→Original headline: "We put llms.txt on 83 websites. In 12 weeks OpenAI's crawler read it 7 times"
Coverage timeline
- Aug 13, 02:01 UTC Hacker News (AI) lead source We put llms.txt on 83 websites. In 12 weeks OpenAI's crawler read it 7 times