Skip to content

Instantly share code, notes, and snippets.

View mjpost's full-sized avatar

Matt Post mjpost

View GitHub Profile
@mjpost
mjpost / parallel.sh
Last active October 27, 2022 13:19
Command line use of GNU parallel
# I can never remember syntax for GNU parallel
## Treat STDIN as a pool of commands to run, running the command for each, at most j in parallel
cat commands.txt | parallel -j 10
## Download a long list of files in parallel
cat files.txt | parallel -j 10 wget -q {}
## Start 10 parallel instances of COMMAND with FLAGS. Feed STDIN in 10k blocks to these commands. Assemble the outputs in order (-k).
cat large_input.txt | parallel -j 10 --pipe -k --block-size 10m COMMAND FLAGS > output.txt
@emjotde
emjotde / nele.doc-level.txt
Created November 7, 2019 16:02
Totally cherry-picked doc-level MT output vs. sent-level MT output translated from https://www.zeit.de/gesellschaft/zeitgeschehen/2018-11/chronische-schmerzen-borreliose-diagnose-ungeklaert with a long-sequence translation system vs. normal sentence-level translation system.
Chronic Pain: Nele Has Pain
Ever since Nele was seven, her legs and joints have been aching.
Every single day.
To this day, doctors don't quite understand why.
Some believe it's simulated.
Someone hits Nele's knee with a hammer, with full force, over and over again.
"It's a dull pain," she says, not knowing if "dull" is a good word.
She's known this feeling for 26 years.
Every hour, every minute, it's there.
On bad days, it feels as if a backhoe is driving over Nele's legs.