Skip to content

Instantly share code, notes, and snippets.

@vitorbaptista
vitorbaptista / gist:4063793
Created November 13, 2012 03:38
Decaptcher.org API in Ruby
require 'net/http'
require 'uri'
require 'base64'
require 'pry'
KEY = "YOUR API KEY"
class Decaptcher
def initialize(file_name)
@file_name = file_name
@vitorbaptista
vitorbaptista / Makefile
Last active August 29, 2015 14:08
Gera CSV com parlamentares eleitos a partir dos dados do TSE
# Baixa resultados do TSE desde 1989 e cria um CSV com os parlamentares eleitos com colunas:
# ano, uf, nome, cargo, situação, partido
ANOS_UF := 1989 1990
ANOS_MUNZONA := 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014
ARQUIVOS_UF := $(patsubst %, VOTACAO_CANDIDATO_UF_%.ZIP, $(ANOS_UF))
ARQUIVOS_MUNZONA := $(patsubst %, votacao_candidato_munzona_%.zip, $(ANOS_MUNZONA))
ARQUIVOS_MUNZONA_DEPENDENCIES := $(patsubst %, votacao_candidato_munzona_%_SP.txt, $(ANOS_MUNZONA))
ARQUIVOS_UF_DEPENDENCIES := $(patsubst %, VOTACAO_CANDIDATO_UF_%, $(ANOS_UF))
@vitorbaptista
vitorbaptista / ping-iax2.pl
Last active August 29, 2015 14:24
Ping IAX2 server
#!/usr/bin/perl -w
# udp ping tool
# http://www.voip-info.org/wiki/index.php?page_id=2654&comments_page=1
use IO::Socket;
$target = shift; #"192.168.0.255";
$target_port = shift; # 4569
socket(PING, PF_INET, SOCK_DGRAM, getprotobyname("udp"));
@vitorbaptista
vitorbaptista / error.log
Created July 26, 2015 11:08
Full log of the error with using knitr + changing OutDec options to ",". I filed the issue on https://github.com/yihui/knitr/issues/1081
processing file: teste.Rnw
|
| | 0%
|
|...................... | 33%
ordinary text without R code
@vitorbaptista
vitorbaptista / generate-data.sh
Last active August 29, 2015 14:26
Generates CSV with name, id, email and image of the politicians on https://github.com/everypolitician/everypolitician-data
#!/bin/bash
echo "name,id,email,image"
for file in `find . -name ep-popolo-v1.0.json`
do
cat $file | jq -r ".persons[] | [\"$file\", .id, .email, .image] | @csv"
done
@vitorbaptista
vitorbaptista / newschallenge-2015-teams-countries.csv
Last active October 2, 2015 17:40
The NewsChallenge 2015 teams' countries
url country
https://www.newschallenge.org/challenge/data/entries/improve-openrefine-s-extensibility-with-data-repository-and-processing-services Canada
https://www.newschallenge.org/challenge/data/entries/microfilm-digitization USA
https://www.newschallenge.org/challenge/data/entries/crime-needs-a-new-box-score USA
https://www.newschallenge.org/challenge/data/entries/beautiful-map UK
https://www.newschallenge.org/challenge/data/entries/open-referral USA
https://www.newschallenge.org/challenge/data/entries/checking-up-on-the-fiscal-health-of-california-cities-counties-and-special-districts-a-tool-for-concerned-residents USA
https://www.newschallenge.org/challenge/data/entries/open-source-election-results-public-vote-counting USA
https://www.newschallenge.org/challenge/data/entries/designing-data-inclusion-mapping-detroit-s-data-ecosystem-to-catalyze-connectivity-engagement-and-impact-for-all USA
https://www.newschallenge.org/challenge/data/entries/tracking-gender-based-violence-while-protecting-privacy Congo
@vitorbaptista
vitorbaptista / keybase.md
Created October 8, 2016 22:02
Verifyng myself on Keybase.io

Keybase proof

I hereby claim:

  • I am vitorbaptista on github.
  • I am vitorbaptista (https://keybase.io/vitorbaptista) on keybase.
  • I have a public key ASCzHuiG5mXAuFZmosmpdpi4kLA8YpficoW3o3cmzrpYiAo

To claim this, I am signing this object:

@vitorbaptista
vitorbaptista / guide.py
Created April 25, 2017 19:29
Simplest DAG for OpenTrials's Airflow
from datetime import datetime
import airflow.models
from airflow.operators.latest_only_operator import LatestOnlyOperator
import utils.helpers as helpers
args = {
'owner': 'airflow',
'depends_on_past': False,
'start_date': datetime(2017, 4, 1),
'retries': 1,
@vitorbaptista
vitorbaptista / Makefile
Last active June 15, 2017 16:51
Extract reimbursements from Serenata de Amor's Jarbas API
.PHONY: clean
all: reimbursements.csv
clean:
rm -f reimbursements.csv reimbursements.json
reimbursements.csv: reimbursements.json
@echo 'issue_date,term_id,term,applicant_id,congressperson_id,congressperson_name,congressperson_document,party,state,subquota_id,subquota_description,subquota_group_id,subquota_group_description,supplier,cnpj_cpf,passenger,leg_of_the_trip,document_type,document_number,installment,batch_number,document_id,document_value,remark_value,total_net_value,total_reimbursement_value,probability,receipt.url,receipt.fetched,last_update,available_in_latest_dataset,suspicions.irregular_companies_classifier,suspicions.meal_price_outlier,suspicions.election_expenses,suspicions.invalid_cnpj_cpf,suspicions.over_monthly_subquota_limit,suspicions.suspicious_traveled_speed_day,suspicions.meal_price_outlier,suspicions.irregular_companies_classifier' > $@
jq -r '.results[] | [.issue_date, .term_id, .term, .applicant_id, .congressperson_id, .congressperson_name, .congressperson_document, .party, .s
@vitorbaptista
vitorbaptista / README.md
Created October 24, 2017 20:55
Remuneração dos servidores e comissionados da Câmara de SP (Referente a 09/2017)