Dan Nguyen dannguyen

This is a guide that basically combines protolium's very helpful ffmpeg cheatsheet with the spleeter library.

Here's a tweet thread that shows a video snippet, with separate bass, vocals, and drums track:

https://twitter.com/dancow/status/1191068710968209408

Installing stuff

Does Excel correctly open utf8-encoded CSV files?

(using Office for Mac 16.16.15)

printf "hello,world\nNǐ hǎo,shìjiè\n你好,世界\n" > nihao.csv
# or:
# curl -o nihao.csv https://gist.githubusercontent.com/dannguyen/13d5c39d499e4bbec622e055283fbb19/raw/f1c50ced36033b9a3aed36ebbbf0cf8734a98809/nihao.csv
  
open -a 'Microsoft Excel' nihao.csv

Replacements

grep
- rg (ripgrep)
- ack
find
- fd; HN discussion
cut (extracting delimited data)
- xsv
- csvkit

The full raw file can be downloaded from this WaPo article page (direct link here]

Here's a link to the Drug Enforcement Agency Office of Diversion Control's ARCOS Registrant Handbook

$ curl -Lo arcos_all_washpost.tsv.gz \
  https://d2ty8gaf6rmowa.cloudfront.net/dea-pain-pill-database/bulk/arcos_all_washpost.tsv.gz

$ gunzip arcos_all_washpost.tsv.gz

AWS Textract -- sample document image and data from the offical demo

AWS Textract is now out of closed beta. You can read the features page here, and you can also read about its limits here (e.g. no handwriting). Basically, if you've ever had to deal with the hell of getting structured data out of a PDF (scanned image or not), Textract is aiming for your business:

This short gist contains some of my brief observations about Textract and its demo, as well as direct links to the most relevant and important files, such as the Textract demo sample image and the resulting data files from Textract's API. If you have an AWS account, I h

[Ignore this gist, checkout the github] Testing AWS Textract's ability to correctly extract data tables from a difficult FBI stats report PDF

Update: I've since realized that this writeup would be far easier to do as its own Github repo, given the number of files involved. Please ignore this gist which I'm keeping here as a backup, and instead, visit: https://github.com/dannguyen/aws-textract-pdf-to-csv-demo

tl;dr: pretty good table structure overall, given the issues with the original PDF. However, there were inexplicable and critical data errors, as if Textract converted the PDF to an image, OCRed it, and then attempted to extract the data tables.

Amazon Textract was announced about 6 months ago but was made public today (May 29). If have an AWS account, you can check out Textract's point-and-click demo, which allows you to upload an image or PDF for T

Bulk Census data work

2016 geo summary level code list:

https://factfinder.census.gov/help/en/summary_level_code_list.htm

Landing page for ACS5-2016 Summary File

Bulk Census data work

2016 geo summary level code list:

https://factfinder.census.gov/help/en/summary_level_code_list.htm

Landing page for ACS5-2016 Summary File

	"""
	bashfoo.yaml

	https://gist.github.com/dannguyen/ad80b9d03f755822d3cc03174bcbef74

	Dan Nguyen's personally curated list of bash/command-line commands and snippets
	that are useful but yet he keeps forgetting

	"""
	# gist: https://gist.github.com/dannguyen/ad80b9d03f755822d3cc03174bcbef74

	ID,Posted at,Screen name,Text
	1123212586919419905,2019-04-30 13:08:43 +0000,shinya1720777,"妙にテンションの高いまーちゃんにあおられた
	キビナゴりせ

	#今日のりせ活 https://t.co/qabC3PQi7m"
	1123212591109672961,2019-04-30 13:08:44 +0000,inesteiixeira,RT @lunaaaaa20: acho que a coisa mais linda é acompanhar o crescimento da pessoa que gostamos e contribuir para isso
	1123212591109689348,2019-04-30 13:08:44 +0000,BTS20520283,#BBMAsTopSocial BTS @BTS_twt kalp
	1123212591139045381,2019-04-30 13:08:44 +0000,Dipendr80247123,"RT @YL511: #البتكوين
	📌اش الحكاية :
	-