Skip to content

Commit

Permalink
Just stop reading these for a while, ok..
Browse files Browse the repository at this point in the history
  • Loading branch information
omrilotan committed Jul 23, 2024
1 parent 89a88b9 commit 2b32309
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions fixtures/crawlers.yml
Original file line number Diff line number Diff line change
Expand Up @@ -137,6 +137,7 @@ ccBot crawler:
- CCBot/2.0 (http://commoncrawl.org/faq/)
CCleaner:
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36 CCleaner/125.0.0.0
- Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36 CCleaner/126.0.0.0
Censys:
- Mozilla/5.0 (compatible; CensysInspect/1.1; +https://about.censys.io/)
CF-UC:
Expand Down

0 comments on commit 2b32309

Please sign in to comment.