AoJ’s gists

AoJ / conda-repo-clone

Created June 24, 2021 10:28 — forked from kalefranz/conda-repo-clone

Conda Repo Clone

	#!/usr/bin/env python
	import hashlib
	import json
	import logging
	import logging.handlers
	import os
	import shutil
	import sys
	import tempfile
	import urllib

AoJ / Digital-Green-Certificate-Dump.py

Created June 2, 2021 10:24 — forked from zajdee/Digital-Green-Certificate-Dump.py

A simple tool to dump the European Union's COVID passports (Digital Green Certificates)

	#!/usr/bin/env python3

	# install dependencies:
	# pip install base45 cbor2 (cwt - not used here)

	import sys
	import zlib

	from base45 import b45decode
	from cbor2 import loads

AoJ / CountSerDe.scala

Created February 25, 2021 01:00 — forked from erikerlandson/CountSerDe.scala

	package org.apache.spark.countSerDe

	import org.apache.spark.sql.catalyst.util._
	import org.apache.spark.sql.types._
	import org.apache.spark.sql.Row
	import org.apache.spark.sql.catalyst.InternalRow
	import org.apache.spark.sql.catalyst.expressions.GenericInternalRow
	import org.apache.spark.sql.expressions.MutableAggregationBuffer
	import org.apache.spark.sql.expressions.UserDefinedAggregateFunction

AoJ / benchmark.zig

Created February 6, 2021 17:03 — forked from lithdew/benchmark.zig

zig: open-addressing robinhood hashmap w/ backward shift deletion

	// zig run benchmark.zig -lc -O ReleaseFast

	const std = @import("std");

	usingnamespace @import("hashmap.zig");

	pub fn main() !void {
	const allocator = std.heap.c_allocator;

	var map = try HashMap(

AoJ / [GUIDE] Optimus laptop dGPU passthrough.md

Created December 28, 2020 14:58 — forked from Misairu-G/[GUIDE] Optimus laptop dGPU passthrough.md

[GUIDE] Optimus laptop dGPU passthrough

Reddit post (Archived)

Table of Content

What to expect?
- Some TLDR about the idea behind
Prerequisites
- Hardware
- System & Software
Update: Attention for MUXless laptop

AoJ / patch-CVE-2020-15227.php

Created October 19, 2020 20:50 — forked from dg/patch-CVE-2020-15227.php

CVE-2020-15227 nette/application RCE in-place patch

	<?php

	# In-place apply the CVE-2020-15227 nette/application patch
	# This is a universal patcher for all affected versions.

	# Run with `php patch-CVE-2020-15227.php`

	# Inspiration: @spazef0rze

AoJ / hash_comp.groovy

Created October 12, 2020 09:48 — forked from scoroberts/hash_comp.groovy

Test of different Java based SHA-256 hash implementations

	@Grab(group='com.google.guava', module='guava', version='19.0')
	@Grab(group='commons-codec', module='commons-codec', version='1.13')
	@Grab(group='bouncycastle', module='bcprov-jdk15', version='140')

	import groovy.transform.CompileStatic
	import java.security.MessageDigest
	import java.nio.charset.StandardCharsets
	import com.google.common.hash.Hashing
	import org.apache.commons.codec.digest.DigestUtils
	import org.bouncycastle.crypto.digests.SHA256Digest

AoJ / README.md

Created August 4, 2020 07:33

Spark - dump sql create into files

mkdir /tmp/sqltables
spark2-shell

val dbname = "some_db"
val targetdir = "/tmp/sqltables"
spark.sql(s"show tables in `${dbname}`").collect.foreach(r =&gt; {

AoJ / parallel.py

Created August 4, 2020 07:30

Python parallel threads

	#!/usr/bin/env python3

	"""Summary

	Attributes:
	format_logger (str): Description
	logger (TYPE): Description
	"""
	import os
	import sys

AoJ / README.md

Created August 4, 2020 07:25

HDFS - Thousands json files

Create binary text file with json files inside. Ideally about 500MB - 1GB size.

CREATE TABLE if not exists json_files
(
   `filename`           STRING,
   `modified_dt`        DOUBLE,
   `content_size`       INT,
   `content`            STRING
)