Fix CSV files with array data

fix-csv-array.py

import csv
import os
import sys
sourcefile = os.path.expanduser(sys.argv[1])
targetfile = sourcefile.replace('.', '-fixed.', 1)
with open(sourcefile) as csvfile, open(targetfile, 'w') as fixfile:
    reader = csv.DictReader(csvfile)
    writer = csv.DictWriter(fixfile, reader.fieldnames)
    writer.writeheader()
    for row in reader:
        for k,v in row.items():
            if v and v[0] == '[' and v[-1] == ']':
                row[k] = row[k].replace("'",'"')
        writer.writerow(row)

Requires Python 3.5+

Download the file, then execute:

python3 ./fix-csv-array.py ~/source-file.csv

This script will create a new file (e.g. source-file-fixed.csv) in the same folder as the source. It will correct any arrays that have single-apostrophes wrapping values, converting them to proper JSON-encoded arrays.