Skip to content

Instantly share code, notes, and snippets.

View ncoop57's full-sized avatar
🤓
I'm a nerd.

Nathan Cooper ncoop57

🤓
I'm a nerd.
View GitHub Profile
use arrow::{
file::{writer::FileWriter, write_all, Writer},
record_batch::RecordBatch,
util::hash::XXHash64,
};
use std::fs::File;
fn hash_text_column(input_path: &str, output_path: &str) {
let mut input_reader = FileReader::try_new(input_path).unwrap();
let input_schema = input_reader.schema().clone();