Skip to content

Instantly share code, notes, and snippets.

View tsuyo's full-sized avatar
💭
Where there is a will, there is a way

Tsuyoshi Miyake tsuyo

💭
Where there is a will, there is a way
46 followers · 0 following
View GitHub Profile
@tsuyo
tsuyo / ncdc.sh
Last active February 14, 2022 14:42 — forked from aligusnet/ncdc.sh
Download a weather dataset from the National Climatic Data Center (NCDC, http://www .ncdc.noaa.gov/). Prepare it for examples of "Hadoop: The Definitive Guide" book by Tom White. http://www.amazon.com/Hadoop-Definitive-Guide-Tom-White/dp/1449311520Usage:./ncdc.sh 1901 1930 # download wheather datasets for period from 1901 to 1930.
#!/usr/bin/env bash
# global parameters
g_tmp_folder="ncdc_tmp";
g_output_folder="ncdc_data";
g_remote_host="ftp.ncdc.noaa.gov";
g_remote_path="pub/data/noaa";