sqlite3 to parse csv files

csv-2-sqlite3.sh

#!/usr/bin/env bash

## Christian Ştefănescu @stchris_  2022 Jun 17
## Handy pattern to put metadata from photos into a #sqlite database for easy querying:
exiftool -csv *.JPG > photos.csv

## Convert the csv to sqlite3
sqlite3 photos.db -cmd \
".mode csv" ".import photos.csv photos" "select filename, imagewidth, imageheight from photos;" ".quit"

## You can do the same thing with my sqlite-utils tool, 
## it's just MASSIVELY slower 
## (due to parsing the CSV in Python as opposed to SQLite's optimized C parser)
## expected output: (often full with NULLS returned as "")
# IMG_0976.JPG,2048,1536
# LACK-reagl-gfz.JPG,3264,2448

## this syntax is how you read from stdin:
# -cmd ".import '|cat -' mytable"

## You also have process redirection in bash and zsh:
# sqlite3 … “.import <( jq … ) jqtable”


#  duckdb -c 'select a,sum(b) from "/tmp/a.csv" group by a;'