Skip to content

Instantly share code, notes, and snippets.

View sakama's full-sized avatar
🎯
🍺

Satoshi Akama sakama

🎯
🍺
  • Treasure Data
  • Tokyo, Japan
View GitHub Profile
@sakama
sakama / jawiki-latest-pages-articles_to_xml2sql.txt
Last active August 29, 2015 13:57
jawiki-latest-pages-articles.xmlをxml2sqlコマンドに流せるように変換する
cat jawiki-latest-pages-articles.xml | sed -e 's/<ns>.*<\/ns>\|<ns.*\/>\|<sha1>.*<\/sha1>\|<sha1.*\/>\|<parentid>.*<\/parentid>\|<parentid.*\/>\|<model>.*<\/model>\|<model.*\/>\|<format>.*<\/format>\|<format.*\/>\|<redirect>.*<\/redirect>\|<redirect.*\/>//' | xml2sql
@sakama
sakama / .gitconfig
Created January 21, 2014 08:39
gitconfig
[user]
[color]
ui = auto
[core]
editor = vim
excludesfile = ~/.gitignore
[alias]
ad = add
br = branch
@sakama
sakama / percona-yum-install.rb
Created January 15, 2014 06:34
Perconaのレポジトリからpercona-extrabackup、percona-toolkitをインストールして、インストール完了後にレポジトリをenabled=falseにするためのChefの記述
arch = node['kernel']['machine']
arch = 'i386' unless arch == 'x86_64'
pversion = node['platform_version'].split('.').first
yum_repository 'percona' do
repo_name 'Percona'
description 'Percona Repo'
url "http://repo.percona.com/centos/#{pversion}/os/#{arch}/"
key 'RPM-GPG-KEY-percona'
action :add
@sakama
sakama / check_memory.sql
Created December 25, 2013 11:26
MySQLのメモリ使用量を調べるSQL
select
@@GLOBAL.KEY_BUFFER_SIZE + @@GLOBAL.INNODB_BUFFER_POOL_SIZE + @@GLOBAL.INNODB_LOG_BUFFER_SIZE + @@GLOBAL.INNODB_ADDITIONAL_MEM_POOL_SIZE + @@GLOBAL.NET_BUFFER_LENGTH as GLOBAL_BUFFER_SIZE,
@@GLOBAL.SORT_BUFFER_SIZE + @@GLOBAL.MYISAM_SORT_BUFFER_SIZE + @@GLOBAL.READ_BUFFER_SIZE + @@GLOBAL.JOIN_BUFFER_SIZE + @@GLOBAL.READ_RND_BUFFER_SIZE as THREAD_BUFFER_SIZE,
@@GLOBAL.KEY_BUFFER_SIZE + @@GLOBAL.INNODB_BUFFER_POOL_SIZE + @@GLOBAL.INNODB_LOG_BUFFER_SIZE + @@GLOBAL.INNODB_ADDITIONAL_MEM_POOL_SIZE + @@GLOBAL.NET_BUFFER_LENGTH
+ (@@GLOBAL.SORT_BUFFER_SIZE + @@GLOBAL.MYISAM_SORT_BUFFER_SIZE + @@GLOBAL.READ_BUFFER_SIZE + @@GLOBAL.JOIN_BUFFER_SIZE + @@GLOBAL.READ_RND_BUFFER_SIZE) * @@GLOBAL.MAX_CONNECTIONS AS TOTAL_MEMORY_SIZE,
(@@GLOBAL.KEY_BUFFER_SIZE + @@GLOBAL.INNODB_BUFFER_POOL_SIZE + @@GLOBAL.INNODB_LOG_BUFFER_SIZE + @@GLOBAL.INNODB_ADDITIONAL_MEM_POOL_SIZE + @@GLOBAL.NET_BUFFER_LENGTH
+ (@@GLOBAL.SORT_BUFFER_SIZE + @@GLOBAL.MYISAM_SORT_BUFFER_SIZE + @@GLOBAL.READ_BUFFER_SIZE + @@GLOBAL.JOIN_BUFFER_SIZE +
@sakama
sakama / tcpdump_mysql.log
Created December 17, 2013 03:51
MySQLの通信をtcpdumpでキャプチャする
■SELECT文
tcpdump -l -i eth1 -A -n -s 0 dst port 3306 | grep SELECT
■UPDATE文
tcpdump -l -i eth1 -A -n -s 0 dst port 3306 | grep UPDATE
■INSERT文
tcpdump -l -i eth1 -A -n -s 0 dst port 3306 | grep INSERT
@sakama
sakama / check_memory_highest_process.sh
Created October 28, 2013 13:18
メモリ使用率トップ10のプロセスを表示
ps alx | awk '{printf ("%d\t%s\n", $8,$13)}' | sort -nr | head -10
@sakama
sakama / apache_memory.sh
Created October 28, 2013 08:51
Apache子プロセスのメモリ使用量を調べるときに使う
ps aux | grep [h]ttpd | grep [a]pache | awk 'BEGIN{x=0}{x+=$6}END{ print x/NR }'
Server:Apache/2.2.3 (Red Hat) DAV/2 mod_auth_kerb/5.1 mod_auth_pgsql/2.0.3 PHP/5.1.6 mod_python/3.2.8 Python/2.4.3 mod_ssl/2.2.3 OpenSSL/0.9.8e-fips-rhel5 SVN/1.6.11 mod_perl/2.0.4 Perl/v5.8.8
X-Powered-By:PHP/5.1.6
@sakama
sakama / start_mysql_cluster.sh
Last active December 15, 2015 22:00
MySQL Cluster起動手順
#管理ノードで実行
ndb_mgmd -f /var/lib/mysql-cluster/config.ini --initial
#データノードで実行
ndbmtd --initial(シングルスレッド版で起動する場合はndbd --initial)
#SQLノードで実行
service mysql start
/usr/bin/mysql_secure_installation
#権限テーブルがMyISAMのため、ndbclusterエンジンに変更する
@sakama
sakama / mysql_cluster_error.sh
Last active May 10, 2019 08:45
MySQL Clusterでエラーが出た場合の対処
ERROR 1297 (HY000) at line 1207: Got temporary error 410 'REDO log files overloaded (decrease TimeBetweenLocalCheckpoints or increase NoOfFragmentLogFiles)' from NDBCLUSTER
#NoOfFragmentLogFiles=4にしていたのをNoOfFragmentLogFiles=16(デフォルト値)に戻した
ERROR 1114 (HY000) at line 1213: The table 'sample_table' is full
#→通常のMySQLでも出るが一旦以下のようにして回避
#innodb_data_file_path=ibdata1:10M:autoextend→ダメだった
#config.iniの[NDBD_DEFAULT]セクション内のDataMemory、IndexMemoryを増やす必要がある
#IndexMemory=100M
#DataMemory=1024M
#※本来はndb_size.pl(http://dev.mysql.com/doc/refman/5.1/ja/mysql-cluster-utilities-ndb-size.html)や