Skip to content

Instantly share code, notes, and snippets.

@hiyosi
Created March 6, 2017 11:09
Show Gist options
  • Save hiyosi/6a70caa9c4767eb36aafe50138ad5b70 to your computer and use it in GitHub Desktop.
Save hiyosi/6a70caa9c4767eb36aafe50138ad5b70 to your computer and use it in GitHub Desktop.
var Crawler = require("js-crawler");
new Crawler().configure({depth: 3})
.crawl("http://www.google.com", function onSuccess(page) {
console.log(page.url);
});
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment