How to Disallow All Except for robots.txt in Your Site Crawling Rules? or Is There a Way to Disallow

Your robots.txt setup is right, but yeah, some bots are jerks and ignore it.

For better control, try using a firewall or mod_security rules. Tools like Sucuri or Cloudflare can help automate this.

Also, monitor your traffic—some bots might still sneak in.