Ronan McHugh ronan-mch

ronan-mch / StackOverflow.py

Created October 24, 2011 20:35

This is a script for scraping the site Stack Overflow's user pages and returning relevant data from the html doc as a csv

	#Stack Overflow scraper script

	#imports necessary modules

	from urllib2 import urlopen
	from BeautifulSoup import BeautifulSoup
	import time

	username = raw_input("Username: ")

ronan-mch / JobsRetrievalScript.sh

Created October 24, 2011 20:11

This script uses bash commands to retrieve data from the Jobs.ie front page and process it into a spreadsheet friendly format

	#!/bin/bash
	#jobs.ie retrieval script

	# This command invokes wget and saves the output file to temp1.txt

	wget www.jobs.ie -O source-file.txt

	# Prints current date to file

	date >> scraper-dir/results.txt