Skip to content

Instantly share code, notes, and snippets.

View pi0's full-sized avatar
๐Ÿ‘€

Pooya Parsa pi0

๐Ÿ‘€
View GitHub Profile
@pi0
pi0 / WikipediaDump.md
Last active February 27, 2020 14:16
A Dummy Way to Extract Clean Wikipedia Contents

Dump Wikipedia

  • Go to https://dumps.wikimedia.org/backup-index.html
  • Go to language and download -pages-meta-current.xml.bz2 version
  • Extract
  • Flatten with pv file.xml | xml2 > file.flat
  • Exrtract text with pv file.flat| grep -oP "(?<=^/mediawiki/page/revision/text=).*" > file.txt
  • Clean with pv fawiki-20200220-pages-articles.txt | node clean.js
  • Enjoy using out.txt
@pi0
pi0 / README.md
Last active November 10, 2020 12:45
doNotTrack polyFill

Tiny (230 char) Polyfill for window.doNotTrack. Checks for:

  • window.doNotTrack == 1
  • navigator.doNotTrack == 'yes'
  • navigator.doNotTrack == 1
  • navigator.msDoNotTrack == 1'
  • window.external.msTrackingProtectionEnabled()

And sets value to either 1 (do not track) or 0 (track)

@pi0
pi0 / git_commit.js
Last active November 18, 2019 14:48
Get git commit in one line!
const gitCommit = process.env.GIT_COMMIT || require('child_process')
.spawnSync('git', ['rev-parse', '--short', 'HEAD'], { encoding: 'utf8' })
.stdout.slice(0, -1)
console.log(gitCommit)
{
// Editor
"diffEditor.renderSideBySide": true,
"editor.fontFamily": "Anonymous, InputMono, Menlo, Monaco, 'Courier New', monospace",
"editor.find.autoFindInSelection": true,
"editor.fontLigatures": true,
"editor.formatOnSave": false,
"editor.formatOnType": true,
"editor.formatOnPaste": true,
function substractIdArrays(a, b) {
return a.filter(x => !b.find(y => y + '' === x + ''))
}
async function updateArea(areaCode) {
const area = await Area.findOne({ areaCode })
const associatedHotels = await Hotel.find({ areaCode }).then(hotels => hotels.map(h => h._id))
const hotelsInArea = await Hotel.find({
@pi0
pi0 / clean-node-modules.sh
Last active May 26, 2019 16:52
Clean all `node_modules` to save disk space
for d in `find -name node_modules -type d` ; do [ -d "$d" ] && echo "$d" && rm -rf "$d" ; done
const Agent = require('agentkeepalive')
require('http').globalAgent = new Agent()
require('https').globalAgent = new Agent.HttpsAgent()
{
// Editor
"diffEditor.renderSideBySide": true,
"editor.fontFamily": "Anonymous, InputMono, Menlo, Monaco, 'Courier New', monospace",
"editor.find.autoFindInSelection": true,
"editor.fontLigatures": true,
"editor.formatOnSave": false,
"editor.formatOnType": true,
"editor.formatOnPaste": true,
@pi0
pi0 / pagespeed_nginx_ubuntu.sh
Last active July 6, 2023 21:58
Install PageSpeed on Ubuntu Nginx Extras
# Deps
sed -i "s|# deb-src|deb-src|" /etc/apt/sources.list
apt update
export DEPS=" \
build-essential zlib1g-dev libpcre3-dev unzip uuid-dev \
debhelper po-debconf libexpat-dev libgd-dev libgeoip-dev libhiredis-dev \
libluajit-5.1-dev libmhash-dev libpam0g-dev libperl-dev libssl-dev libxslt1-dev quilt"
apt install -y $DEPS
# NXG Pagespeed
@pi0
pi0 / ssh-proxy.sh
Created September 20, 2018 16:06
SSH-SSH
ssh -vo ProxyCommand='ssh -W %h:%p root@proxy_host' root@dst_host