Achim Staebler asmod3us

Pipeline multiprocessing in Python with generators

Similar to mpipe, this short module lets you string together tasks so that they are executed in parallel.

The difference is that it lets you use generators, functions which yield results instead of returning them. Each yielded item gets passed to the next stage.

You can specify that one or more copies of the workers operate on the input queue.

Things that can be in a stage

Enable mouse support

/mouse enable

Encrypted password in sec.conf

TrueNAS

I will be moving from FreeNAS jails to ubuntu with docker, docker compose, and portainer. FreeNAS support and updates are lacking. There are many advantages to making the switch and with ZFS on linux I think FreeNAS may be a thing of the past. Stay tuned for a new guide of my latest setup. Check out my other gists for progress on the switch. https://gist.github.com/mow4cash/626275e095f7f90898944a85d66b3be6

WARNING READ THIS: This page contains incomplete and possibly incorrect info. The page is constantly being edited and worked on. Many of these should work but some may be broken. Read the code carefully to understand what you are doing, stuff may be need to be changed for your own use. This includes but not limited too JAIL AND ROUTER IPs, YOUR FREENAS MAIN VOLUME,THE MOST RECENT RELEASE OF DOWNLOADED FILES Use at your own risk.There may be helpful info in the comments.

Find me in the FreeNAS forums

GPG and git on macOS

Setup

No need for homebrew or anything like that. Works with https://www.git-tower.com and the command line.

Install https://gpgtools.org -- I'd suggest to do a customized install and deselect GPGMail.
Create or import a key -- see below for https://keybase.io
Run gpg --list-secret-keys and look for sec, use the key ID for the next step
Configure git to use GPG -- replace the key with the one from gpg --list-secret-keys

	import numpy as np
	import time
	from sklearn.preprocessing import OneHotEncoder
	from scipy.io import loadmat
	from scipy.optimize import minimize


	def load_data(filename):
	""" Loads the MNIST data from the given Matlab file name. """
	try:

	from threading import Thread
	from multiprocessing import Process
	from os import remove

	from time import time

	class IOTest:
	max_workers = 10
	max_lines = 10000000

	#!/usr/bin/env python3

	# # This python script provides a function to query the pfsense (+v2.4) dhcp leases status page and return a list of tuples including
	# ip, hostname, and mac address. To use, ensure LXML is installed via package manager or via pip.
	#
	# 16-Dec-2016 - Original release
	# 3-Sep-2020 - Minor update to match formatting of leases page in latest pfSense version (2.4.5).
	# 9-Sep-2020 - Backported improvements to handle table rows with missing data, use global variables for user/pass/server_ip,
	# and return list from scrape function as implemented by fryguy04 in fork here:
	# https://gist.github.com/fryguy04/7d12b789260c47c571f42e5bc733a813

	# LICENSE: MIT, wtfpl or whatever OSS license you like
	function get_stack () {
	STACK=""
	local i message="${1:-""}"
	local stack_size=${#FUNCNAME[@]}
	# to avoid noise we start with 1 to skip the get_stack function
	for (( i=1; i<$stack_size; i++ )); do
	local func="${FUNCNAME[$i]}"
	[ x$func = x ] && func=MAIN
	local linen="${BASH_LINENO[$(( i - 1 ))]}"

	.popup-overlay {
	position: fixed;
	top: 0;
	left: 0;
	right: 0;
	bottom: 0;
	background-color: rgba(0, 0, 0, 0.2);
	}

	.popup-cnt {

	Gist title: "BASH: ISO 8601 Timestamp with Milliseconds"

	Summary: How to get an ISO 8601 timestamp with milliseconds in BASH