Dash Shi bxshi

Doing deep learning & data mining on Knowledge Graphs/Networks, sometimes play with natural language processing.

bxshi / NLTK's list of english stopwords

Created October 5, 2017 19:49 — forked from sebleier/NLTK's list of english stopwords

bxshi / d-cat0716-3dx.txt

Created September 25, 2017 00:04

Business 41202 Homework01 processed dataset. This could be loaded by pandas.

	PERMNO date VOL RET vwretd ewretd sprtrn
	18542 20070103 6138900 -0.002772 -0.001347 -0.000159 -0.001199
	18542 20070104 4060000 -0.002616 0.000547 0.000591 0.001228
	18542 20070105 6267100 -0.012787 -0.007288 -0.009809 -0.006085
	18542 20070108 3977500 0.001162 0.002567 0.001731 0.002220
	18542 20070109 3929100 0.005474 -0.000001 0.000262 -0.000517
	18542 20070110 6825100 -0.004949 0.002096 0.001338 0.001940
	18542 20070111 7440900 -0.005305 0.007322 0.007760 0.006340
	18542 20070112 6560800 -0.004333 0.006142 0.006821 0.004853
	18542 20070116 6842100 -0.008370 0.000314 0.000561 0.000818

bxshi / q-gnp4791.txt

Created August 31, 2017 05:20

aka dgnp82.txt

bxshi / m-gm3dx7508.txt

Created August 27, 2017 21:12

Cleaned up version.

bxshi / d-3stocks9908.txt

Created August 27, 2017 06:26

Cleaned up version of d-3stocks9908.txt.

bxshi / d-ibm3dx7008.txt

Created August 27, 2017 05:39

Cleaned up version of d-ibm3dx7008.txt, this can be read by `np.loadtxt` or `pd.read_csv`.

	Date rtn vwretd ewretd sprtrn
	19700102 0.000686 0.012137 0.033450 0.010211
	19700105 0.009596 0.006375 0.018947 0.004946
	19700106 0.000679 -0.007233 -0.005776 -0.006848
	19700107 0.000678 -0.001272 0.003559 -0.002047
	19700108 0.002034 0.000564 0.002890 0.000540
	19700109 -0.001353 -0.002797 -0.002923 -0.003021
	19700112 -0.003388 -0.007766 -0.009646 -0.007576
	19700113 0.017335 0.000737 -0.001090 0.000981
	19700114 -0.001002 -0.002005 -0.005280 -0.001525

bxshi / tmux_local_install.sh

Last active December 3, 2021 15:17 — forked from smsharma/ tmux_local_install.sh

Install tmux locally without root access

	#!/bin/bash

	# Script for installing tmux on systems where you don't have root access.
	# tmux will be installed in $INSTALL_DIR/local/bin.
	# It's assumed that wget and a C/C++ compiler are installed.

	# exit on error
	set -e

	TMUX_VERSION=2.3

bxshi / gpu_runner.py

Last active February 15, 2017 18:14

Select GPU and run command

	#!/usr/bin/env python3
	import argparse
	import subprocess


	def gpu_ok(gpu_usage, mem_usage, max_gpu_usage, max_mem_usage):
	return gpu_usage <= max_gpu_usage and mem_usage < max_mem_usage


	if __name__ == '__main__':

bxshi / mr_hits.py

Created January 19, 2017 18:36

Calculate MeanRank and Hits@K using TensorFlow. From github.com/nddsg/ProjC (private repo right now)

	def create_eval_ops(model_input, pred_y, all_triples, eval_triples, n_entity,
	top_k, idx_1=0, idx_2=1, idx_3=2):
	""" Evaluation operations for any model.

	For given <h,r> predict t, idx_1 = 0, idx_2 = 1, idx_3 = 2
	For given <t,r> predict h, idx_1 = 2, idx_2 = 1, idx_3 = 0

	:param model_input: N by 3 matrix, each row is a h,r,t pair
	:param pred_y: N by ENTITY_VOCAB matrix
	:param all_triples: M by 3 matrix, contains all triples in the KG

bxshi / Hits_at_K_TensorFlow.py

Created January 12, 2017 21:34

Implement Hits@K evaluation metric for Knowledge Graph Completion tasks.