- no upfront installation/agents on remote/slave machines - ssh should be enough
- application components should use third-party software, e.g. HDFS, Spark's cluster, deployed separately
- configuration templating
- environment requires/asserts, i.e. we need a JVM in a given version before doing deployment
- deployment process run from Jenkins
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env python3 | |
import subprocess | |
import sys | |
path = sys.argv[-1] | |
if path.startswith('/path/to/my/local/source/folder/'): | |
path = path.replace('/path/to/my/local/source/folder/', '/app/folder/') | |
subprocess.run(['docker-compose', 'exec', '-T', 'cross', 'sh', '-c', |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from __future__ import unicode_literals | |
from django.db import models | |
from django.db.models.fields.related_descriptors import ForwardManyToOneDescriptor # noqa | |
class RelationNotLoaded(Exception): | |
pass | |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
""" | |
Logical deletion for Django models. Uses is_void flag | |
to hide discarded items from queries. Overrides delete | |
methods to set flag and soft-delete instead of removing | |
rows from the database. | |
""" | |
from django.apps import apps | |
from django.contrib.admin.utils import NestedObjects | |
from django.db import models | |
from django.db.models import signals |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import base64 | |
from django.http import HttpResponse | |
from django.contrib.auth import authenticate | |
from django.conf import settings | |
def view_or_basicauth(view, request, *args, **kwargs): | |
# Check for valid basic auth header | |
if 'HTTP_AUTHORIZATION' in request.META: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
def paginate(ctx_name): | |
""" | |
View decorator that handles pagination of a ListObject. Expects to find it | |
in the TemplateResponse context under the name ``ctx_name``. | |
This needs to not force delivery of the ListObject. | |
""" | |
def decorator(view_func): | |
@wraps(view_func) |
Copyright © 2017 Fantasyland Institute of Learning. All rights reserved.
A function is a mapping from one set, called a domain, to another set, called the codomain. A function associates every element in the domain with exactly one element in the codomain. In Scala, both domain and codomain are types.
val square : Int => Int = x => x * x
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
/// Code to bind mailbox processors to azure storage queues. | |
module AzureMailboxProcessor | |
open System | |
module private Async = | |
let AwaitTaskEmpty = Async.AwaitIAsyncResult >> Async.Ignore | |
module private Option = | |
let fromNullable (nullable:Nullable<_>) = if nullable.HasValue then Some nullable.Value else None | |
let toNullable = function |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#Make sure 7za is installed | |
choco install 7zip.commandline | |
# Create mongodb and data directory | |
md $env:temp\mongo\data | |
# Go to mongodb dir | |
Push-Location $env:temp\mongo | |
# Download zipped mongodb binaries to mongodbdir |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
namespace Newtonsoft.Json.Converters | |
open Microsoft.FSharp.Reflection | |
open Newtonsoft.Json | |
open System | |
type IdiomaticDuConverter() = | |
inherit JsonConverter() | |
[<Literal>] |