rhzs’s gists

rhzs / RhezaSatriaHerokuLogReportStatistic.py

Last active August 29, 2015 14:12

Heroku Log Report Statistic (Num of called urls, Response time, and dyno)

	#!/usr/bin/python
	import time
	import resource
	import re

	from collections import Counter
	from threading import Thread


	class ThreadLogFile(Thread):

rhzs / gist:ecababd669caa3327451

Last active August 29, 2015 14:21

	Collection.metaClass.eachWithPeek = { closure ->
	def last = null
	delegate?.each { current ->
	if (last) closure(last, current)
	last = current
	}
	if (last) closure(last, null)
	}

rhzs / gist:c1cfa8c6f6fa6a7f068d

Created May 20, 2015 18:17

	[].eachWithPeek { current, peek ->
	assert false // shouldn't get here, nothing to iterate through
	}

	[1].eachWithPeek { current, peek ->
	assert current == 1
	assert peek == null // only 1 element, nothing to peek at
	}

	def results = []

rhzs / lazada_puller.rb

Last active August 29, 2015 14:26

Using capybara and poltergeist to pull lazada site

	# This is an example - the usage of capybara and poltergeist to take screenshot of e-commerce website
	# Later the implementation can be extended to pull data from the e-commerce website.
	require 'rubygems'
	require 'capybara'
	require 'capybara/dsl'
	require 'capybara/poltergeist'

	Capybara.run_server = false
	Capybara.current_driver = :poltergeist
	Capybara.app_host = 'http://www.lazada.co.id' # Indonesia e-commerce Lazada Site

rhzs / lazada_take_screenshot.js

Last active August 29, 2015 14:26

Using phantomjs to take lazada landing page screenshot (and pull data later on)

	// To run type:
	// phantomjs lazada_take_screenshot.js
	// Output:
	// see lazada.png
	// Gotchas: not all AJAX are fully loaded!
	var page = require('webpage').create();
	page.open('http://www.lazada.co.id/', function(status) {
	console.log("Status: " + status);
	if(status === "success") {
	page.render('lazada.png');

rhzs / lazada_watir.rb

Created August 8, 2015 13:12

Using ruby & watir webdriver to take website screenshot

	# Ecommerce Website Scrapping using ruby, watir webdriver and firefox
	# To run:
	# => ruby lazada_watir.rb
	# Requirement:
	# => gem install watir-webdriver
	# => (all web driver dependencies)
	require 'watir-webdriver'

	browser = Watir::Browser.new :firefox
	browser.goto "http://www.lazada.co.id/"

rhzs / lazada_crawl.groovy

Last active August 29, 2015 14:26

Simple java groovy example for data and web scrapping via import.io API

	// Author: Rheza Satria (2015), Indonesia
	// Purpose:
	// Simple groovy example for data and web crawler/scrapping via import.io API.
	// Note:
	// Lazada is Indonesian e-commerce. Feel free to change with other e-commerce.
	// Run:
	// groovy lazada_crawl.groovy
	import java.io.BufferedReader;
	import java.io.InputStreamReader;
	import java.io.OutputStreamWriter;

rhzs / zalora_jsoup.groovy

Last active August 8, 2018 00:56

Very Simple Example Java/Groovy and Jsoup library -- Crawler for Zalora Indonesia (e-commerce site)

	// Download JSOUP library
	@Grab('org.jsoup:jsoup:1.7.1')

	// Connect and get Zalora URL via Jsoup
	def doc = org.jsoup.Jsoup.connect("http://www.zalora.co.id/women/pakaian/dress/").get()

	// Since the page loaded using AJAX we can't just crawl the CSS tag.
	def script = doc.select("script")
	def p = java.util.regex.Pattern.compile(/(?is)app.settings =(.*)app.i18n/);
	def m = p.matcher(script.html());

rhzs / terminal_progress_bar.rb

Created August 8, 2015 18:20

Ruby Terminal Progress Bar Example

rhzs / index.html

Created August 9, 2015 13:56

Go - Demonstrate simple HTML5 Server Side Events Example without Redis / RabbitMQ / anykind

	<!DOCTYPE html>
	<html>
	<head>
	<title>HTML5 Server Side Event Example in Go</title>
	</head>
	<body>

	Yey! {{.}}, here are some new messages about the
	current time:<br>

Ryuici rhzs