Skip to content

Instantly share code, notes, and snippets.

@ducchetrongminh
Last active July 24, 2023 15:22
Show Gist options
  • Save ducchetrongminh/2cd5649d24563251b5dbb554172ebc06 to your computer and use it in GitHub Desktop.
Save ducchetrongminh/2cd5649d24563251b5dbb554172ebc06 to your computer and use it in GitHub Desktop.
Upload movielens_25m to bigquery
curl -O 'http://files.grouplens.org/datasets/movielens/ml-25m.zip'
unzip ml-25m.zip
bq --location asia-southeast1 mk --dataset movielens_25m
bq load --source_format=CSV --autodetect --skip_leading_rows=1 \
movielens_25m.genome_scores ml-25m/genome-scores.csv
bq load --source_format=CSV --autodetect --skip_leading_rows=1 \
movielens_25m.genome_tags ml-25m/genome-tags.csv
bq load --source_format=CSV --autodetect --skip_leading_rows=1 \
movielens_25m.links ml-25m/links.csv
bq load --source_format=CSV --autodetect --skip_leading_rows=1 \
movielens_25m.movies ml-25m/movies.csv
bq load --source_format=CSV --autodetect --skip_leading_rows=1 \
movielens_25m.ratings ml-25m/ratings.csv
bq load --source_format=CSV --autodetect --skip_leading_rows=1 \
movielens_25m.tags ml-25m/tags.csv
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment