Leif Denby leifdenby

DiffEqFlux.jl (Julia) vs Jax on an Epidemic Model

The Jax developers optimized a differential equation benchmark in this issue which used DiffEqFlux.jl as a performance baseline. The Julia code from there was updated to include some standard performance tricks and is the benchmark code here. Thus both codes have been optimized by the library developers.

Results

Forward Pass

⚠️ The following instruction is written on 25 Jul 2020 (= old).

4 steps to get a docker running with GPU on Ubuntu 20.04

Environment

Ubuntu 20.04
CUDA 10.2
Docker Latest

In most of deep learning projects, the training scripts always start with lines to load in data, which can easily take a handful minutes. Only after data ready can start testing my buggy code. It is so frustratingly often that I wait for ten minutes just to find I made a stupid typo, then I have to restart and wait for another ten minutes hoping no other typos are made.

In order to make my life easy, I devote lots of effort to reduce the overhead of I/O loading. Here I list some useful tricks I found and hope they also save you some time.

use Numpy Memmap to load array and say goodbye to HDF5.

I used to relay on HDF5 to read/write data, especially when loading only sub-part of all data. Yet that was before I realized how fast and charming Numpy Memmapfile is. In short, Memmapfile does not load in the whole array at open, and only later "lazily" load in the parts that are required for real operations.

Sometimes I may want to copy the full array to memory at once, as it makes later operations

Julia Cartopy Examples

Last Update: 2024-09-13

	#EXTM3U
	#EXTINF:-1,BBC - Radio 1
	http://as-hls-ww-live.akamaized.net/pool_01505109/live/ww/bbc_radio_one/bbc_radio_one.isml/bbc_radio_one-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 1Xtra
	http://as-hls-ww-live.akamaized.net/pool_92079267/live/ww/bbc_1xtra/bbc_1xtra.isml/bbc_1xtra-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 1Dance
	http://as-hls-ww-live.akamaized.net/pool_62063831/live/ww/bbc_radio_one_dance/bbc_radio_one_dance.isml/bbc_radio_one_dance-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 1 Anthems (UK Only)
	http://as-hls-uk-live.akamaized.net/pool_904/live/uk/bbc_radio_one_anthems/bbc_radio_one_anthems.isml/bbc_radio_one_anthems-audio%3d96000.norewind.m3u8
	#EXTINF:-1,BBC - Radio 2

	%% AMS pandoc template.
	%% https://gist.github.com/naught101/f369e9796c36965b0cf6
	%% Converts pandoc to a latex file along the lines of the templates from
	%% https://www2.ametsoc.org/ams/index.cfm/publications/authors/journal-and-bams-authors/author-resources/latex-author-info/preparing-a-latex-manuscript-for-submission/
	%% The results of this template should work with ametsoc.cls and ametsoc2014.bst
	%% out of the box.


	%% amssamp1.tex is nearly identical to amssamp2.tex, except
	%% that amssamp2.tex uses the [twocol] option to produce

	Based on this page:

	http://askubuntu.com/questions/72812/how-to-disable-nolisten

	How to display an X11 application on remote Ubuntu system

	display-host: ubuntu linux running X11 server
	app-host: other linux with an X11 application

	On the display-host:

	#!/usr/bin/env bash

	#
	# This is sp, the command-line Spotify controller. It talks to a running
	# instance of the Spotify Linux client over dbus, providing an interface not
	# unlike mpc.
	#
	# Put differently, it allows you to control Spotify without leaving the comfort
	# of your command line, and without a custom client or Premium subscription.
	#

	#!/usr/bin/python2


	# Copyright (C) 2016 Sixten Bergman
	# License WTFPL
	#
	# This program is free software. It comes without any warranty, to the extent
	# permitted by applicable law.
	# You can redistribute it and/or modify it under the terms of the Do What The
	# Fuck You Want To Public License, Version 2, as published by Sam Hocevar. See