Skip to content

Instantly share code, notes, and snippets.

### SlateDB Individual Contributor License Agreement
Thank you for your interest in contributing to open source software projects (“Projects”) made available by SlateDB. This Individual Contributor License Agreement (“Agreement”) sets out the terms governing any source code, object code, bug fixes, configuration changes, tools, specifications, documentation, data, materials, feedback, information or other works of authorship that you submit or have submitted, in any form and in any manner, to SlateDB in respect of any of the Projects (collectively “Contributions”). If you have any questions respecting this Agreement, please contact the SlateDB's maintainers.
You agree that the following terms apply to all of your past, present and future Contributions. Except for the licenses granted in this Agreement, you retain all of your right, title and interest in and to your Contributions.
**Copyright License.** You hereby grant, and agree to grant, to SlateDB a non-exclusive, perpetual, irrevocable, worldwide, fu
@criccomini
criccomini / test_dags.py
Created June 22, 2016 15:18
test_dags.py
import os
import unittest
from airflow.models import DagBag
class TestDags(unittest.TestCase):
"""
Generic tests that all DAGs in the repository should be able to pass.
"""
@criccomini
criccomini / run-tests.sh
Created June 22, 2016 15:16
run-tests.sh
#!/bin/bash
# Runs airflow-dags tests.
# Set Nose defaults if no arguments are passed from CLI.
CWD="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
NOSE_ARGS=$@
if [ -z "$NOSE_ARGS" ]; then
NOSE_ARGS=" \
--with-coverage \
@criccomini
criccomini / airflow.cfg
Created June 22, 2016 15:09
airflow.cfg
# A redacted version of airflow.cfg
[core]
airflow_home = /etc/airflow
dags_folder = /etc/airflow/dags
base_log_folder = /var/log/airflow
s3_log_folder = None
remote_base_log_folder = gs://some-bucket
remote_log_conn_id = gcp_di
executor = LocalExecutor
@criccomini
criccomini / airflow-supervisord.conf
Created June 22, 2016 14:54
airflow-supervisord.conf
; Configuration for Airflow webserver and scheduler in Supervisor
[program:airflow]
command=/bin/airflow webserver
stopsignal=QUIT
stopasgroup=true
user=airflow
stdout_logfile=/var/log/airflow/airflow-stdout.log
stderr_logfile=/var/log/airflow/airflow-stderr.log
environment=HOME="/home/airflow",AIRFLOW_HOME="/etc/airflow",TMPDIR="/storage/airflow_tmp"
@criccomini
criccomini / gist:71bd7e0a80b2be987d38d841ae3d5634
Created June 3, 2016 20:08
MySQL replication, GTIDs, and MySQL HA
From MySQL's docs:
* [Switching Masters During Failover](https://dev.mysql.com/doc/refman/5.5/en/replication-solutions-switch.html)
* [mysqlfailover — Automatic replication health monitoring and failover](https://dev.mysql.com/doc/mysql-utilities/1.5/en/mysqlfailover.html)
* [Replication with Global Transaction Identifiers](https://dev.mysql.com/doc/refman/5.6/en/replication-gtids.html)
* [MySQL Multi-Source Replication](https://dev.mysql.com/doc/refman/5.7/en/replication-multi-source.html)
* [Improving Replication Performance](https://dev.mysql.com/doc/refman/5.7/en/replication-solutions-performance.html)
* [Using Replication for Backups](https://dev.mysql.com/doc/refman/5.7/en/replication-solutions-backups.html)
From Facebook:

Keybase proof

I hereby claim:

  • I am criccomini on github.
  • I am criccomini (https://keybase.io/criccomini) on keybase.
  • I have a public key whose fingerprint is 54CB C4FA 61B3 1BC0 2D5F E9F5 980A F123 CF97 30D3

To claim this, I am signing this object:

<p>I am very excited to announce that Apache Incubator Samza 0.7.0 has been released. In all, 156 JIRAs were <a href="https://issues.apache.org/jira/browse/SAMZA-309?jql=project%20%3D%20SAMZA%20AND%20fixVersion%20%3D%200.7.0%20AND%20status%20in%20(Resolved%2C%20Closed)">resolved</a> in this release. Notable work done includes:</p>
<ul>
<li>Initial import of code into Apache. (<a href="https://issues.apache.org/jira/browse/SAMZA-1">SAMZA-1</a>)</li>
<li>Upgraded to YARN 2.2 from YARN 2.05-alpha. (<a href="https://issues.apache.org/jira/browse/SAMZA-9">SAMZA-9</a>)</li>
<li><a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20fixVersion%20%3D%200.7.0%20AND%20status%20in%20(Resolved%2C%20Closed)%20and%20component%20%3D%20kv">Numerous</a> state management bug fixes.</li>
<li>Java 7 support. (<a href="https://issues.apache.org/jira/browse/SAMZA-16">SAMZA-16</a>)</li>
<li>A <a href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20fixVersion%20%3D%200.7.0%20AND%
$ yum install cmake
$ mvn clean package -Dcontainer-executor.conf.dir=/etc/hadoop/ -DskipTests -Pnative