-
-
Save glaszig/bf96beccf4694ae25d4f1f7cc6224985 to your computer and use it in GitHub Desktop.
#!/usr/bin/env sh | |
# DO WHAT THE FUCK YOU WANT TO PUBLIC LICENSE | |
# Version 2, December 2004 | |
# | |
# Copyright (C) 2020 glaszig <[email protected]> | |
# | |
# Everyone is permitted to copy and distribute verbatim or modified | |
# copies of this license document, and changing it is allowed as long | |
# as the name is changed. | |
# | |
# DO WHAT THE FUCK YOU WANT TO PUBLIC LICENSE | |
# TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION | |
# | |
# 0. You just DO WHAT THE FUCK YOU WANT TO. | |
# inspired by https://gist.github.com/johntyree/3331662#gistcomment-1968023 | |
# | |
# usage: | |
# UA="user agent string" mkp2pblocklist > /tmp/blockp2p.list | |
# or | |
# UA="user agent string" mkp2pblocklist | gzip -9 > /tmp/blockp2p.list.gz | |
PATH="/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin:$PATH" | |
if [ -z "$UA" ]; then | |
echo "User Agent environment variable UA missing." | |
echo "See, e.g., https://user-agents.net/browsers for examples." | |
exit 1 | |
fi | |
curl -A "$UA" -s https://www.iblocklist.com/lists.php \ | |
| sed -n "s/.*value='\(http:.*=p2p.*\)'.*/\1/p" \ | |
| xargs curl -A "$UA" -sL \ | |
| gunzip \ | |
| egrep -v '^#' \ | |
| uniq |
many thx for the update
For whatever reason @glaszig file contains the following:
The Scary IPv4 Internets:0.0.0.0-255.255.255.255
The Scary IPv6 Internets:0000:0000:0000:0000:0000:0000:0000:0000-FFFF:FFFF:FFFF:FFFF:FFFF:FFFF:FFFF:FFFF
I think iblocklist detects its own user agent and returns fake data.
I made an alternative in a GitHub repository.
I made an alternative in a GitHub repository.
looked at it. did you change something? the ua you’re using looks pretty normal.
I'm quite sure they blacklist your UA.
Do you try to refresh to a new one?
edit: I'm now getting a random UA user-agents.net, that will be more future proof ;)
curl 'https://user-agents.net/download' -X POST --data-raw 'download=txt&browser_bits=64&brower_type=browser&limit=100' > ua.txt
cat ua.txt | sort -R | head -1
iblocklist has become a bullshit operation with their automation and anti-scrapgin policies. is anybody aware of a better source?
updated the script to fake its user agent since iblocklist is blocking curl.
PLEASE USE YOUR OWN USER AGENT STRING, supply it with an env var, e.g.,
UA='custom ua string' mkp2pblocklist
.choose any from this list: https://user-agents.net/browsers
@jerkstore369: also fixed, long ago actually.