Cqshinn enixdark

Golang Workers / Job Queue

A running example of the code from:

This gist creates a working example from blog post, and a alternate example using simple worker pool.

TLDR: if you want simple and controlled concurrency use a worker pool.

以下の作業はすべて docker コンテナ内
- podman に --network=none をつけるなら --cap-add NET_ADMIN は不要

$ docker run --rm -it --cap-add SYS_ADMIN --cap-add NET_ADMIN alpine:latest sh

Python

Install required packages:

apt-get install libxinerama-dev libx11-dev

Customization of [dwm], which base code of dwm may be found under:

git clone http://git.suckless.org/dwm

	#!/usr/bin/env python
	"""Split large file into multiple pieces for upload to S3.

	S3 only supports 5Gb files for uploading directly, so for larger CloudBioLinux
	box images we need to use boto's multipart file support.

	This parallelizes the task over available cores using multiprocessing.

	Usage:
	s3_multipart_upload.py <file_to_transfer> <bucket_name> [<s3_key_name>]

	#!/usr/bin/env python
	# coding=utf-8
	#
	# s3up.py
	# 2010-2011, Mike Tigas
	# https://mike.tig.as/
	#
	# Usage:
	# s3up filename
	# Uploads the given file to the DEFAULT_BUCKET (see below)

	# -- coding: utf-8 --

	import requests
	from io import BytesIO, SEEK_SET, SEEK_END

	class ResponseStream(object):
	def __init__(self, request_iterator):
	self._bytes = BytesIO()
	self._iterator = request_iterator

	KataContainers
	- image coupled with kernel
	- light vm layer
	- can run in nested virturalization environments if hardware supports and you can enable it in bios (ex. only bare metal EC2 instances, limits many cloud providers)
	- slower startup time
	- OCI compliant
	- previously known as ClearContainers by Intel

	gvisor
	- kernel implemented in userspace

	#include <stdlib.h>
	#include <string.h>
	#include <wchar.h>


	static char* utf16_to_utf8 (const wchar_t *src)
	{
	size_t len = wcslen(src), si, di;

	char dst = (char)malloc(sizeof(dst)(3*len+1));