Commit Graph

2217 Commits

Author SHA1 Message Date
Paul Pfeister 0a2978abeb Remove ~correct~ Steam from Removed_Sites 2024-05-07 02:00:49 -04:00
Paul Pfeister 7370a4dcda Restore SteamID
Seems to work now. May need to be adapted for regional issues.
Closes sherlock-project/sherlock#1815
Closes sherlock-project/sherlock#1848
2024-05-07 00:31:57 -04:00
Paul Pfeister 2575450bef Add BugCrowd 2024-05-07 00:22:12 -04:00
github-actions[bot] f5796c24b3 Updated Site List 2024-05-06 20:17:56 +00:00
Siddharth Dushantha 56957408f5 Merge pull request #1990 from nicholasmurillo/my-opensource-contribution
Added Kick
2024-05-06 20:17:43 +00:00
Siddharth Dushantha 6182c3c250 changed error checking method
Checking for the status code wasn't stable. Therefore checking for error
messages is better
2024-05-06 22:14:51 +02:00
github-actions[bot] b3bb3aef61 Updated Site List 2024-05-06 19:58:10 +00:00
Siddharth Dushantha 884019a9e9 Merge pull request #2098 from Ableytner/master
Add AniWorld
2024-05-06 19:57:57 +00:00
github-actions[bot] 014b4bcdf1 Updated Site List 2024-05-06 19:48:52 +00:00
Siddharth Dushantha efd5f36674 Merge pull request #2101 from ppfeister/feature/youtube
Restore YouTube
2024-05-06 19:48:37 +00:00
Paul Pfeister 56b61f34de Restore YouTube 2024-05-06 14:48:27 -04:00
github-actions[bot] 80a513a948 Updated Site List 2024-05-06 15:30:01 +00:00
Siddharth Dushantha b3a56100c8 Merge pull request #2038 from Gowthamk007m/master
Added Blipfoto and LibraryThing
2024-05-06 15:29:49 +00:00
Gowtham K M 26f6bcb7f5 Merge branch 'sherlock-project:master' into master 2024-05-06 19:46:59 +05:30
Gowtham K M 8608aa5747 Blipfoto error checking reverted to status_code 2024-05-06 19:46:31 +05:30
github-actions[bot] 31ab96675c Updated Site List 2024-05-06 10:13:08 +00:00
Siddharth Dushantha 67cae59d73 Merge pull request #2100 from ppfeister/feature/linkedin
Add LinkedIn
2024-05-06 10:12:54 +00:00
Gowtham K M e99e2b11d7 Merge branch 'sherlock-project:master' into master 2024-05-06 11:49:35 +05:30
Gowtham K M ba1377a570 Update error type to 'message' and set errorMsg to 'This user doesn't exist' 2024-05-06 11:48:55 +05:30
Paul Pfeister d8aaeea168 Add regex 2024-05-06 01:09:31 -04:00
Paul Pfeister ffa2310630 Add LinkedIn
LinkedIn requires users to be signed in for normal visitation, but certain high-trust crawlers are allowed as well. Here, we masquerade as Googlebot to get past the 999.
2024-05-06 00:49:13 -04:00
Ableytner e2faa8a281 remove default username_unclaimed 2024-05-05 20:24:59 +02:00
Ableytner f224cbe656 add AniWorld 2024-05-05 19:46:14 +02:00
github-actions[bot] 49b190f841 Updated Site List 2024-05-05 11:45:24 +00:00
Siddharth Dushantha 743aa8d320 Merge pull request #2097 from sherlock-project/hudsonrock
added HudsonRock
2024-05-05 11:45:12 +00:00
Siddharth Dushantha f035cc329d added HudsonRock 2024-05-05 13:41:10 +02:00
github-actions[bot] 58a2cc9c43 Updated Site List 2024-05-04 18:12:10 +00:00
Siddharth Dushantha 667289a23a Merge pull request #2092 from ppfeister/feature/new_targets
Collection of new and restored targets
2024-05-04 18:11:58 +00:00
Siddharth Dushantha a7f94d6ee6 Merge branch 'master' into feature/new_targets 2024-05-04 18:02:16 +00:00
Siddharth Dushantha 122082a602 Merge pull request #2069 from ppfeister/feature/antiwaf
Reduce false positives (those caused by WAFs and bot detection)
2024-05-04 13:12:45 +00:00
github-actions[bot] 71bdf63c19 Updated Site List 2024-05-04 13:08:04 +00:00
Siddharth Dushantha 482982c4e4 Merge pull request #2068 from ppfeister/master
Reduce false positives (those not caused by WAFs or bot detection)
2024-05-04 13:07:53 +00:00
Ryan 9137ee4f09 Add ruff to pr tests (#2093) 2024-04-27 12:41:30 +02:00
Paul Pfeister 2bf6ee4d2e Fix 1337x 2024-04-25 19:44:43 -04:00
Paul Pfeister 7bf4be4b70 Add Untappd
Untappd is behind Cloudflare, but this doesn't seem to impact early requests. After being ratelimited, sherlock-project/sherlock#2069 will suppress any possible WAF-induced false positives.
Closes sherlock-project/sherlock#1780
2024-04-25 19:27:58 -04:00
Paul Pfeister 760bc98a45 Re-add Instagram
Instagram has been added back to the site list using the old picuki probe. This service DOES use Cloudflare, but it will function perfectly fine until rate limited. Once rate limited, sherlock-project/sherlock#2069 will suppress any false positives.
2024-04-25 18:33:51 -04:00
Paul Pfeister 89251745d9 Add Codeberg 2024-04-25 18:02:01 -04:00
Paul Pfeister db213de326 Remove unnecessary errorMsg 2024-04-25 17:53:45 -04:00
Paul Pfeister 7c94534732 Add CSSBattle ~properly~ 2024-04-25 17:49:29 -04:00
Paul Pfeister 137009ef37 Add Spells8 (and sort)
Resolves sherlock-project/sherlock#2091
2024-04-25 17:21:27 -04:00
Paul Pfeister 51959f95a7 Update sites list 2024-04-14 15:35:23 -04:00
Paul Pfeister 2a5fbd9e97 Remove BitcoinForum instead of suppress 2024-04-14 15:32:19 -04:00
Paul Pfeister ca9a78757f Add CyberDefenders 2024-04-11 21:45:22 -04:00
Paul Pfeister 5c23b1555c Update default User-Agent
I've noticed that many bot-detection pages are able to be avoided by using this UA. Unless there's a reason to stay on the old old old one, we may as well update it and reduce our WAF hits.
2024-04-11 21:23:11 -04:00
Paul Pfeister 9f6cd80e28 Add PentesterLab 2024-04-11 21:05:13 -04:00
Paul Pfeister 27e98abbc8 Add some new targets
+ TorrentGalaxy
+ 1337x
+ HackenProof
2024-04-11 19:11:49 -04:00
Paul Pfeister d59661903a Update site lists 2024-04-11 17:43:32 -04:00
Paul Pfeister e43c6047be Fix status_code default logic bug 2024-04-11 17:39:23 -04:00
Paul Pfeister 060088f7a1 Fix status_code logic bug 2024-04-11 17:28:39 -04:00
Paul Pfeister da3c90fce8 Fix Telegram F+ 2024-04-10 22:39:55 -04:00