Skip to content

Instantly share code, notes, and snippets.

@raecoo

raecoo/export-parquet.py

Created July 30, 2018 01:27
Show Gist options
  • Save raecoo/73a21e83c1933b63b9bc00632853bef2 to your computer and use it in GitHub Desktop.
Save raecoo/73a21e83c1933b63b9bc00632853bef2 to your computer and use it in GitHub Desktop.
Download ZIP
Export parquet file schema
Raw
export-parquet.py
import io, json
from pyarrow.parquet import ParquetFile
data = ParquetFile("/Users/raecoo/Desktop/data-0.gz.parquet").schema
with io.open('data.txt', 'w', encoding='utf-8') as f:
f.write(str(data))
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment