Skip to content

Instantly share code, notes, and snippets.

View marrabld's full-sized avatar
🤪

Dan Marrable marrabld

🤪
  • Conservation Innovation Pty Ltd
  • Perth Western Australia
  • 14:38 (UTC +08:00)
View GitHub Profile
<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<title>todo</title>
<!-- 2016-03-16 Wed 16:22 -->
<meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
<meta name="generator" content="Org-mode" />
<meta name="author" content="Daniel Marrable" />
<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<title>160511_notes</title>
<!-- 2016-05-11 Wed 16:31 -->
<meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
<meta name="generator" content="Org-mode" />
<meta name="author" content="Daniel Marrable" />
<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<title>160512_notes</title>
<!-- 2016-05-12 Thu 14:12 -->
<meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
<meta name="generator" content="Org-mode" />
<meta name="author" content="Daniel Marrable" />
399.086732283,402.331102362,405.575472441,408.81984252,412.064212598,415.308582677,418.552952756,421.797322835,425.041692913,428.286062992,431.530433071,434.77480315,438.019173228,441.263543307,444.507913386,447.752283465,450.996653543,454.241023622,457.485393701,460.72976378,463.974133858,467.218503937,470.462874016,473.707244094,476.951614173,480.195984252,483.440354331,486.684724409,489.929094488,493.173464567,496.417834646,499.662204724,502.906574803,506.150944882,509.395314961,512.639685039,515.884055118,519.128425197,522.372795276,525.617165354,528.861535433,532.105905512,535.350275591,538.594645669,541.839015748,545.083385827,548.327755906,551.572125984,554.816496063,558.060866142,561.30523622,564.549606299,567.793976378,571.038346457,574.282716535,577.527086614,580.771456693,584.015826772,587.26019685,590.504566929,593.748937008,596.993307087,600.237677165,603.482047244,606.726417323,609.970787402,613.21515748,616.459527559,619.703897638,622.948267717,626.192637795,629.437007874,632.681377953,635.9257
+proj=aea +lat_1=-18 +lat_2=-36 +lat_0=0 +lon_0=132 +x_0=0 +y_0=0 +datum=WGS84 +units=m +no_defs

The Challenge

Subset a list of files from NCI and transfer them to Pawsey. The directory structure needs to be preserved from NCI to Pawsey. The subset is a few hundres TB and needs to be publicly accessable.

Challenge 1.

You can't use pshell in the following way.

pshell cp  
@marrabld
marrabld / costfunction.md
Last active September 26, 2018 06:06
Choosing the right cost function
Problem type Last-layer activation Loss function
Binary classification sigmoid binary_crossentropy
Multiclass, single-label classification softmax categorical_crossentropy
Multiclass, multilabel classification sigmoid binary_crossentropy
Regression to arbitrary values None mse
Regression to values between 0 and 1 sigmoid mse or binary_crossentropy
{
"type": "FeatureCollection",
"name": "mca_windfarm",
"crs": { "type": "name", "properties": { "name": "urn:ogc:def:crs:EPSG::32754" } },
"features": [
{ "type": "Feature", "properties": { "ID": 1, "Northing": 5795091.5247953897, "Easting": 604812.60372430005 }, "geometry": { "type": "Point", "coordinates": [ 604812.603724300046451, 5795091.524795389734209 ] } },
{ "type": "Feature", "properties": { "ID": 2, "Northing": 5794830.9781577298, "Easting": 604533.47479951102 }, "geometry": { "type": "Point", "coordinates": [ 604533.474799511022866, 5794830.978157729841769 ] } },
{ "type": "Feature", "properties": { "ID": 3, "Northing": 5795063.2064649798, "Easting": 604076.20076956705 }, "geometry": { "type": "Point", "coordinates": [ 604076.200769567047246, 5795063.206464979797602 ] } },
{ "type": "Feature", "properties": { "ID": 4, "Northing": 5794608.0463918401, "Easting": 603827.12204071903 }, "geometry": { "type": "Point", "coordinates": [ 603827.1220407190267, 5794608.046391840092838 ] } },
{ "type": "Featur
@marrabld
marrabld / directory_permissions.sh
Created March 27, 2020 07:20
set the correct permissions for ssh et al
chmod 700 ~/.ssh
chmod 644 ~/.ssh/authorized_keys
chmod 644 ~/.ssh/known_hosts
chmod 644 ~/.ssh/config
chmod 600 ~/.ssh/id_rsa
chmod 644 ~/.ssh/id_rsa.pub
chmod 600 ~/.ssh/github_rsa
chmod 644 ~/.ssh/github_rsa.pub
chmod 600 ~/.ssh/mozilla_rsa
chmod 644 ~/.ssh/mozilla_rsa.pub
@marrabld
marrabld / common-git.md
Last active March 30, 2020 03:24
common github commands

Git Commands

--

Getting & Creating Projects

Command Description
git init Initialize a local Git repository