How to Disallow All Except for robots.txt in Your Site Crawling Rules? or Is There a Way to Disallow

The syntax you used is spot-on for disallow all except robots.txt. Most legit bots respect it, but bad ones won’t care.

For extra security, maybe add rate limiting or firewall rules. Check out tools like Fail2Ban or Wordfence if you’re on WordPress.