Crawlerpeek checks which AI crawlers your site allows in (CLI, MCP)
Read the original at github.com→Original headline: "Crawlerpeek – check which AI crawlers your site lets in (CLI, MCP)"
Coverage timeline
- Oct 25, 21:11 UTC Hacker News (AI) lead source Crawlerpeek – check which AI crawlers your site lets in (CLI, MCP)