Gaurav Kakkar gauravkakkar87
imjared
/ scraping-with-casperjs.js
Created
March 20, 2013 00:33
A CasperJS script that crawled a list of links on then scraped the relevant content on each page and output it to a nicely formatted XML file. Sure beats database dumps/SQL manipulation, in my opinion.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /*jshint strict:false*/ | |
| /*global CasperError console phantom require*/ | |
| /** | |
| * grab links and push them into xml | |
| */ | |
| var casper = require("casper").create({ | |
| }); |