Skip to content

Instantly share code, notes, and snippets.

@koh110
Last active November 7, 2017 14:07
Show Gist options
  • Save koh110/55399e3d8c4c169712ca6fc73aaac29e to your computer and use it in GitHub Desktop.
Save koh110/55399e3d8c4c169712ca6fc73aaac29e to your computer and use it in GitHub Desktop.
scraping
const puppeteer = require('puppeteer')
;(async () => {
const browser = await puppeteer.launch()
const page = await browser.newPage()
await page.goto('https://google.com')
await page.screenshot({path: 'example.png'})
await browser.close()
})()
const puppeteer = require('puppeteer')
;(async () => {
const browser = await puppeteer.launch()
const page = await browser.newPage()
await page.goto('http://www.jreast-timetable.jp/1711/timetable/tt1295/1295010.html')
const ev = await page.evaluate(() => {
const timetable = Array.from(document.querySelectorAll('.timetable tr')).splice(2).map((line) => {
const minutes = Array.from(line.querySelectorAll('.timetable_time .time_link_black .minute')).map((time) => {
return {
minute: parseInt(time.innerHTML, 10)
}
})
return {
hour: parseInt(line.querySelector('td').innerHTML, 10),
minutes
}
})
return {
timetable
}
})
console.log(ev)
await browser.close()
})()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment