Kinda off-topic but related: if ChatGPT crawling a website was real, we’d all be in trouble. Imagine it scraping your private stuff? Yikes.
For now, it’s safe. But tools like Botify can help monitor actual crawlers if you’re worried about the wrong bots.
For now, it’s safe. But tools like Botify can help monitor actual crawlers if you’re worried about the wrong bots.
