Skip to content

Instantly share code, notes, and snippets.

View DanNi0130's full-sized avatar

DanNi0130

7 followers · 1 following
View GitHub Profile
@DanNi0130
DanNi0130 / proxy_server
Created August 3, 2018 00:19
const proxies = {
'useragent1': 'http://proxyusername1:proxypassword1@proxyhost1:proxyport1',
'useragent2': 'http://proxyusername2:proxypassword2@proxyhost2:proxyport2',
'useragent3': 'http://proxyusername3:proxypassword3@proxyhost3:proxyport3',
};
const server = new ProxyChain.Server({
port: 8000,
prepareRequestFunction: ({request}) => {
const userAgent = request.headers['user-agent'];
@DanNi0130
DanNi0130 / page_settings
Created August 2, 2018 23:51
const blockedResourceTypes = [
'image',
'media',
'font',
'texttrack',
'object',
'beacon',
'csp_report',
'imageset',
];
@DanNi0130
DanNi0130 / request_interception
Created August 2, 2018 23:13
const blockedResourceTypes = [
'image',
'media',
'font',
'texttrack',
'object',
'beacon',
'csp_report',
'imageset',
@DanNi0130
DanNi0130 / puppeteer_settings
Created August 2, 2018 22:56
// with browserless
browser = await puppeteer.connect({
browserWSEndpoint:
'ws://' +
browserless.ip +
':' +
browserless.port +
'?TOKEN=' +
browserless.token +
'&--proxy-server=' + proxy +
@DanNi0130
DanNi0130 / browserless
Last active August 2, 2018 23:04
docker pull browserless/chrome
docker run -p 3000:3000 -e "MAX_CONCURRENT_SESSIONS=5"
-e "MAX_QUEUE_LENGTH=0"
-e "PREBOOT_CHROME=true"
-e "TOKEN=YOURTOKEN"
-e "ENABLE_DEBUGGER=false"
-e "CONNECTION_TIMEOUT=300000" --restart always browserless/chrome
@DanNi0130
DanNi0130 / reddit.js v3 output
Last active August 1, 2018 17:39
Russian Pipeline. Upvote so that this is the first image people see when they Google “Russian Pipeline”
John F. Kennedy Jr. Sitting in the pilot seat of the Marine One circa 1963
I didn't take it as a compliment.
How beautiful is this
Hustle like Faye
The power of a salt water crocodile's tail.
I'm 36, and will be dead inside of a year.
F***ing genius.
TIL Anthony Daniels, who endured years of discomfort in the C-3PO costume, was so annoyed by Alan Tudyk (Rogue One) playing K-2SO in the comfort of a motion-capture suit that he cursed at Tudyk. Tudyk later joked that a "fuck you" from Daniels was among the highest compliments he had ever received.
Reminder about the fact UC Davis paid over $100k to remove this photo from the internet.
@DanNi0130
DanNi0130 / reddit.js v3
Last active July 19, 2018 02:14
const puppeteer = require('puppeteer');
const $ = require('cheerio');
const url = 'https://www.reddit.com';
puppeteer
.launch()
.then(function(browser) {
return browser.newPage();
})
.then(function(page) {
@DanNi0130
DanNi0130 / reddit.js v2 output
Created July 19, 2018 02:09
<!DOCTYPE html><html lang="en"><head><link
href="//c.amazon-adsystem.com/aax2/apstag.js" rel="preload"
as="script">
...
@DanNi0130
DanNi0130 / reddit.js v2
Created July 19, 2018 02:00
const puppeteer = require('puppeteer');
const url = 'https://www.reddit.com';
puppeteer
.launch()
.then(function(browser) {
return browser.newPage();
})
.then(function(page) {
return page.goto(url).then(function() {
@DanNi0130
DanNi0130 / reddit.js v1 output
Created July 19, 2018 01:55
<!DOCTYPE html><html
lang="en"><head><title>reddit: the front page of the
internet</title>
...