Skip to content

Instantly share code, notes, and snippets.

@holgerd77
holgerd77 / fs_split.sh
Created November 27, 2014 12:07
Farmsubsidy data (recipient, payment) CSV split script
#!/bin/bash
#Usage : ./split.sh COUNTRY_CODE FILE_TYPE_WITHOUT_ENDING LINES_PER_FILE
#Author : Holger Drewes
#Last edit : 2014-11-27
echo -e "Script for splitting payment or recipient files into chunks"
echo -e "***********************************************************\n"
#Check for number of arguments
if [ "$#" -ne 3 ]; then
echo "Usage: $0 COUNTRY_CODE FILE_TYPE_WITHOUT_ENDING LINES_PER_FILE"
@holgerd77
holgerd77 / get_farmsubsidy_data.sh
Last active August 29, 2015 14:01 — forked from stefanw/get_farmsubsidy_data.sh
Fixes for Farmsubsidy data files
# Fixes for Farmsubsidy data
# Order of countries is taken form the website:
# http://farmsubsidy.openspending.org/countries/
set -x verbose
#wget -O AT.zip "http://data.farmsubsidy.org/web/at20130501.zip"
#unzip -d AT AT.zip
# Generic fixes/helpers
# HTML encoding fix
sed 's/\&ouml;/ö/g; s/&Ouml;/Ö/g; s/&uuml;/ü/g; s/&Uuml;/Ü/g; s/&auml;/ä/g; s/&Auml;/Ä/g; s/&szlig;/ß/g; s/&quot;/"/g; s/&lt;/</g; s/&gt;/>/g; s/&amp;/\&/g; s/&#[0-9]*;//g' [COUNTRY_CODE]/recipient_bad.txt > [COUNTRY_CODE]/recipient.txt

Keybase proof

I hereby claim:

  • I am holgerd77 on github.
  • I am holgerd77 (https://keybase.io/holgerd77) on keybase.
  • I have a public key whose fingerprint is C4BF EF8B AE8E D0AD 7389 2974 18E1 3335 5A8A 2F45

To claim this, I am signing this object: