Your code works for disallow all except robots.txt, but bad bots will bypass it.
Try combining it with IP blocking or CAPTCHAs for sketchy traffic. Tools like Distil or Imperva can help too.
Try combining it with IP blocking or CAPTCHAs for sketchy traffic. Tools like Distil or Imperva can help too.
