Vincent M vmosoti

☕

Code

Crafted Systems

14 followers · 22 following

View GitHub Profile

Recently created

Least recently created

Recently updated

Least recently updated

imjared / scraping-with-casperjs.js

Created March 20, 2013 00:33

A CasperJS script that crawled a list of links on then scraped the relevant content on each page and output it to a nicely formatted XML file. Sure beats database dumps/SQL manipulation, in my opinion.

	/jshint strict:false/
	/global CasperError console phantom require/

	/**
	* grab links and push them into xml
	*/
	var casper = require("casper").create({

	});

mickaelandrieu / quotes_json.js

Created November 26, 2013 12:50

Scrap a website with CasperJs, JSON output.

	var links = [];
	var quotes = [];
	var tempUrl = [];
	var infos = [];

	var maxLinks = 10;
	var firstUrl = 'http://www.imdb.com/search/title?at=0&num_votes=5000,&sort=user_rating,desc&start=1&title_type=tv_infoss';

	var newUrl;
	var x = require('casper').selectXPath;

jakzal / crawler-edit.php

Last active January 22, 2024 13:18

Removing nodes with DomCrawler

	<?php
	<<<CONFIG
	packages:
	- "symfony/dom-crawler: ~2.3"
	- "symfony/css-selector: ~2.3"
	CONFIG;

	use Symfony\Component\DomCrawler\Crawler;

	$html = <<<HTML