Yao Ren Jie姚仁捷 frankyaorenjie

🎯

Focusing

frankyaorenjie / es

Last active October 13, 2017 17:21

es env

	ulimit
	vm.max_map_count via sysctl to be at least 262144.
	sudo swapoff -a

	http.cors.enabled : true
	http.cors.allow-origin : "*"
	index.number_of_replicas: 0

	curl -XPUT 'localhost:9200/_template/logstash_template' -d '
	{

frankyaorenjie / yoyo.sh

Last active October 9, 2017 12:55

install fluentd on gcp

	set ulimit
	set sysctl.conf
	apt-get install build-essential
	sudo apt-get update
	sudo apt-get install -y ruby2.3-dev

frankyaorenjie / brew_install_octave.sh

Created September 23, 2017 08:17

brew_install_octave.sh

	sudo chown -R $(whoami) /usr/local
	brew update && brew upgrade # it will take some time
	brew cask install xquartz
	brew install octave # it will take a lot of time…

frankyaorenjie / octave_error.log

Last active September 23, 2017 08:17

Octave error

	Error: uninitialized constant Formulary::FormulaNamespacefe4ce29a01455f41d6d0b08c39f76615::Octave::DevelopmentTools
	Please report this bug:
	https://git.io/brew-troubleshooting
	/usr/local/Library/Taps/homebrew/homebrew-science/octave.rb:31:in `<class:Octave>’
	/usr/local/Library/Taps/homebrew/homebrew-science/octave.rb:1:in `load_formula’
	/usr/local/Library/Homebrew/formulary.rb:21:in `module_eval’
	/usr/local/Library/Homebrew/formulary.rb:21:in `load_formula’
	/usr/local/Library/Homebrew/formulary.rb:38:in `load_formula_from_path’
	/usr/local/Library/Homebrew/formulary.rb:87:in `load_file’
	/usr/local/Library/Homebrew/formulary.rb:78:in `klass’

frankyaorenjie / 132

Last active November 9, 2017 11:13

mirgation from bq to mysql

	bq
	===
	SELECT
	*
	FROM
	[data-platform-163807:visearch_stats.access_logs_stats_hourly]
	where date_hour >= '2014-01-01 00:00:00' and date_hour < '2015-01-01 00:00:00'

	image
	====

frankyaorenjie / do.sql

Created September 8, 2017 08:18

mysql partition by month

	ALTER TABLE dashboard.search_stats_hourly_2018
	PARTITION BY RANGE ( MONTH(date_hour) ) (
	PARTITION p01 VALUES LESS THAN (2),
	PARTITION p02 VALUES LESS THAN (3),
	PARTITION p03 VALUES LESS THAN (4),
	PARTITION p04 VALUES LESS THAN (5),
	PARTITION p05 VALUES LESS THAN (6),
	PARTITION p06 VALUES LESS THAN (7),
	PARTITION p07 VALUES LESS THAN (8),
	PARTITION p08 VALUES LESS THAN (9),

frankyaorenjie / do.sh

Last active February 27, 2018 03:36

update all pip packages

pip freeze --local | grep -v '^\-e' | cut -d = -f 1  | xargs -n1 pip install --upgrade --user

frankyaorenjie / snippet.java

Created August 11, 2017 03:26

aws s3 v4 sign

	import com.amazonaws.HttpMethod;
	import com.amazonaws.auth.AWSStaticCredentialsProvider;
	import com.amazonaws.auth.BasicAWSCredentials;
	import com.amazonaws.services.s3.AmazonS3;
	import com.amazonaws.services.s3.AmazonS3ClientBuilder;
	import com.amazonaws.services.s3.model.GeneratePresignedUrlRequest;

	import java.net.URL;

	public class Test {

frankyaorenjie / .vimrc

Created June 16, 2017 02:37

vim setting

frankyaorenjie / deploy_cloud_function.sh

Last active August 4, 2017 03:17

deploy cloud functions

gcloud beta functions deploy dashboardRecHistoryFunction --stage-bucket visenze-data_platform-cloud_function --trigger-topic rec_history --memory 128