Skip to content

Instantly share code, notes, and snippets.

View yu-iskw's full-sized avatar

Yu Ishikawa yu-iskw

View GitHub Profile
@yu-iskw
yu-iskw / Makefile.md
Created August 14, 2015 02:19
A Makefile to Install Apache NiFi
SUB_PROJECTS=nifi-parent nifi-nar-maven-plugin nifi

clean:
	_PWD=`pwd`; \
	for sub in $(SUB_PROJECTS); do \
		echo $$sub; \
		cd "$$_PWD/$$sub" && mvn clean; \
	done
@yu-iskw
yu-iskw / functions.Rd
Created August 21, 2015 04:16
functions.Rd at dcfe0c5cde953b31c5bfeb6e41d1fc9b333241eb
% Generated by roxygen2 (4.1.1): do not edit by hand
% Please edit documentation in R/functions.R, R/generics.R
\docType{methods}
\name{lit,ANY-method}
\alias{add_months}
\alias{add_months,Column,numeric-method}
\alias{approxCountDistinct,Column-method}
\alias{ascii}
\alias{avg}
\alias{base64}
@yu-iskw
yu-iskw / floor.Rd
Created August 24, 2015 22:56
floor.Rd without `@name`
% Generated by roxygen2 (4.1.1): do not edit by hand
% Please edit documentation in R/functions.R
\docType{methods}
\name{floor,Column-method}
\alias{floor,Column-method}
\title{floor}
\usage{
\S4method{floor}{Column}(x)
}
\description{
@yu-iskw
yu-iskw / floor.Rd
Last active August 29, 2015 14:28
floor.Rd with `@name`
% Generated by roxygen2 (4.1.1): do not edit by hand
% Please edit documentation in R/functions.R
\docType{methods}
\name{floor}
\alias{floor}
\title{floor}
\usage{
\S4method{floor}{Column}(x)
}
\description{
@yu-iskw
yu-iskw / test-spark-package.sh
Created September 2, 2015 06:20
An idea to test a spark package
#!/usr/bin/env bash
#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
@yu-iskw
yu-iskw / aws-credentials.properties
Created September 7, 2015 13:30
AWS Oauth PropertiesCredentials Format
accessKey = xxxxxxxxxxxxxxxxxxxxxx
secretKey = xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
@yu-iskw
yu-iskw / inspect.py
Last active September 8, 2015 02:15
Inspecting script for PySpark
import sys
import pkgutil
import inspect
import json
module_name = sys.argv[1]
__import__(module_name)
## Gets the reference of the target module
module = sys.modules[module_name]
@yu-iskw
yu-iskw / method-inspection.md
Last active September 9, 2015 04:40
Mthod Inspection in Python 2.7
import sys

class Foo():
    @staticmethod
    def sm():
        return 1

    @classmethod
    def cm(cls):
@yu-iskw
yu-iskw / test.py
Created September 9, 2015 08:37
Check @SInCE
def since(version):
"""
A decorator that annotates a function to append the version of Spark the function was added.
"""
import re
indent_p = re.compile(r'\n( +)')
def deco(f):
if f.__doc__ is None:
f.__doc__ = ".. versionadded:: %s" % (version)
@yu-iskw
yu-iskw / file0.txt
Created September 17, 2015 10:44
JVM の言語とロケールの設定方法 ref: http://qiita.com/yu-iskw/items/f2b3a1e22e16b0076e12
export _JAVA_OPTIONS="-Duser.language=en -Duser.country=US"