Skip to content

Instantly share code, notes, and snippets.

View nagataka's full-sized avatar

Takashi Nagata nagataka

7 followers · 3 following
View GitHub Profile
@nagataka
nagataka / httpd_switch_log.sh
Last active August 29, 2015 13:57
#!/bin/sh
##############################
source /opt/conf/httpd_switch_log.conf
##############################
DATE=`date +%Y%m%d`
echo "switch httpd log"+`date` >> $LOG_FILE
mv $HTTPD_LOG_DIR/access_log $HTTPD_LOG_DIR/access_log.$DATE
@nagataka
nagataka / authorize_ssh_local.sh
Last active August 29, 2015 14:08
authorize_ssh_local.sh
#!/bin/sh
ip=`curl http://www.ugtop.com/spill.shtml | grep -o "[0-9]*\.[0-9]*\.[0-9]*\.[0-9]*"`
echo "your ip is: $ip"
# add rule to security group
aws ec2 authorize-security-group-ingress --group-id sg-xxxxxxxx --protocol tcp --port 22 --cidr ${ip}'/32'
@nagataka
nagataka / KeyCountDriver.java
Last active August 29, 2015 14:11
Count the number of requests associated with each verb from apache like log file
import java.io.IOException;
import org.apache.hadoop.conf.Configured;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.LongWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.Reducer;
import org.apache.hadoop.mapreduce.Reducer.Context;
@nagataka
nagataka / KeyCountDriver_with_Combiner.java
Created December 8, 2014 21:38
Example of calculating the average object size from apache like log file.
import java.io.IOException;
import org.apache.hadoop.conf.Configured;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.LongWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;
import org.apache.hadoop.mapreduce.Reducer;
import org.apache.hadoop.mapreduce.Reducer.Context;
@nagataka
nagataka / user-data
Created January 2, 2015 10:54
User data for EC2(see http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/user-data.html#user-data-shell-scripts)
#!/bin/bash
sudo curl -L http://www.opscode.com/chef/install.sh | sudo bash
sudo /opt/chef/embedded/bin/gem install chef --no-ri --no-rdoc
sudo /opt/chef/embedded/bin/gem install knife-solo --no-ri --no-rdoc
mkdir -p ~/workspace/chef-repo
cd ~/workspace/chef-repo
sudo apt-get -y install git
git clone https://github.com/nagataka/cookbooks.git
@nagataka
nagataka / primitive_perceptron.py
Created January 3, 2015 13:29
My first python script for learning very primitive perceptron
import numpy as np
#test script for implementing perceptron
N = 4
complete = False
def calc(test, weight):
array_after = weight * test
res = np.zeros(N)
index = 0
num = 0
@nagataka
nagataka / send_email.php
Created February 12, 2015 01:53
send message by AWS SES using AWS SDK for PHP 1
#!/usr/bin/php
<?php
require_once("sdk-1.6.2/sdk.class.php");
$ses = new AmazonSES();
$response = $ses->send_email(
'from_addr@example.co.jp', // Source (aka From)
array('ToAddresses' => array( // Destination (aka To)
'to_adde@test.com'
)),
@nagataka
nagataka / sendEmail.php
Created February 12, 2015 01:53
send message by AWS SES using AWS SDK for PHP 2
#!/usr/bin/php
<?php
require 'AWS_SDK_PHP2/aws-autoloader.php';
use Aws\Ses\SesClient;
$client = SesClient::factory(array(
'key' => "XXXXXXXXXXXXXXXXXXXX",
'secret' => "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX",
'region' => "us-east-1"
@nagataka
nagataka / standing_ovation.py
Last active August 29, 2015 14:19
Google Code Jam 2015 Problem A. Standing Ovation - https://code.google.com/codejam/contest/6224486/dashboard#s=p0
def calc(max_shyness, data_list):
if max_shyness == 0:
return 0
else:
total_count, required_count = 0, 0
for i in range(0, max_shyness+1):
if data_list[i] != 0:
if total_count >= i:
total_count += data_list[i]
else:
@nagataka
nagataka / HbaseConnector.java
Created April 21, 2015 15:02
HBase Java API test
package hbase;
import java.io.IOException;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.hbase.HBaseConfiguration;
import org.apache.hadoop.hbase.HColumnDescriptor;
import org.apache.hadoop.hbase.HTableDescriptor;
import org.apache.hadoop.hbase.client.HBaseAdmin;
import org.apache.hadoop.hbase.client.HTable;