Skip to content

Instantly share code, notes, and snippets.

@pastak
Created December 25, 2017 10:06
Show Gist options
  • Save pastak/1f92adc506264c42bf4459c238022dfe to your computer and use it in GitHub Desktop.
Save pastak/1f92adc506264c42bf4459c238022dfe to your computer and use it in GitHub Desktop.
const puppeteer = require('puppeteer');
const urls = `https://www.amazon.co.jp/dp/B01N0UVSKP
https://www.amazon.co.jp/dp/B01MU4BNSS
https://www.amazon.co.jp/dp/B01N1W14Z2
https://www.amazon.co.jp/dp/B01MU7W6AX
https://www.amazon.co.jp/dp/B01MRY6BVF
https://www.amazon.co.jp/dp/B01N1050ZV
https://www.amazon.co.jp/dp/B01N22480D
https://www.amazon.co.jp/dp/B01N11SMHQ
https://www.amazon.co.jp/dp/B01N9W1CFI
https://www.amazon.co.jp/dp/B06W52KPHH
https://www.amazon.co.jp/dp/B01N19VI3A
https://www.amazon.co.jp/dp/B01N3CV208
https://www.amazon.co.jp/dp/B06XX7ZGRS
https://www.amazon.co.jp/dp/B06Y15PQY1
https://www.amazon.co.jp/dp/B06XNW89M6
https://www.amazon.co.jp/dp/B06WLMNMC3
https://www.amazon.co.jp/dp/B071D7FM39
https://www.amazon.co.jp/dp/B06X6FJN72
https://www.amazon.co.jp/dp/B06XP6T96N
https://www.amazon.co.jp/dp/B01N7WKDCJ
https://www.amazon.co.jp/dp/B071RDS7ML
https://www.amazon.co.jp/dp/B0725W9CS2
https://www.amazon.co.jp/dp/B072QV686T
https://www.amazon.co.jp/dp/B072JGHYLB
https://www.amazon.co.jp/dp/B0732RMGLV
https://www.amazon.co.jp/dp/B071SKCBXY
https://www.amazon.co.jp/dp/B07213NV2D
https://www.amazon.co.jp/dp/B073WQ3Y4W
https://www.amazon.co.jp/dp/B073TTK2FF
https://www.amazon.co.jp/dp/B073TRP1DS
https://www.amazon.co.jp/dp/B00ZTXKHS8
https://www.amazon.co.jp/dp/B0748C9D3G
https://www.amazon.co.jp/dp/B074M4CRXF
https://www.amazon.co.jp/dp/B075GHFMVS
https://www.amazon.co.jp/dp/B07598W5LB
https://www.amazon.co.jp/dp/B075JFZJXL
https://www.amazon.co.jp/dp/B075CY2RRQ
https://www.amazon.co.jp/dp/B074FXTXVN
https://www.amazon.co.jp/dp/B076516JJG
https://www.amazon.co.jp/dp/B076BMQRK8
https://www.amazon.co.jp/dp/B0764YVB8W
https://www.amazon.co.jp/dp/B0761RVFHZ
https://www.amazon.co.jp/dp/B01N16J7G5
https://www.amazon.co.jp/dp/B071V8F1LQ
https://www.amazon.co.jp/dp/B076VF6FW2
https://www.amazon.co.jp/dp/B076F1JY6Y
https://www.amazon.co.jp/dp/B0761LTJML
https://www.amazon.co.jp/dp/B077GQL19W
https://www.amazon.co.jp/dp/B076HQGKKP
https://www.amazon.co.jp/dp/B07796N6LJ
https://www.amazon.co.jp/dp/B077K1K9YT
https://www.amazon.co.jp/dp/B07796Z3P9
https://www.amazon.co.jp/dp/B077G1LLT2
https://www.amazon.co.jp/dp/B077NG7R9R
https://www.amazon.co.jp/dp/B0777BR4KY
https://www.amazon.co.jp/dp/B077MB2GW8
https://www.amazon.co.jp/dp/B06XK8D5BX
https://www.amazon.co.jp/dp/B075L3CH1W
https://www.amazon.co.jp/dp/B073QQ7X5H
https://www.amazon.co.jp/dp/B078GL51L2
https://www.amazon.co.jp/dp/B07869YXJN
https://www.amazon.co.jp/dp/B07874M5MW
https://www.amazon.co.jp/dp/B0787VJPHZ`.split('\n');
(async () => {
const browser = await puppeteer.launch();
const page = await browser.newPage();
let result = []
for (let url of urls) {
console.log(url)
await page.goto(url)
const desc = await page.evaluate(() => {
const desc = document.querySelector('#bookDesc_iframe').contentWindow.document.querySelector('#iframeContent').textContent;
return desc
})
result.push(desc)
}
console.log(result.join('\n'))
await browser.close();
})();
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment