Aki Ariga chezou
chezou
/ as_msgpack_stream.R
Last active
October 26, 2019 13:05
Convert R data frame to msgpack stream
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| devtools::install_github("crowding/msgpack-r") | |
| library(msgpack) | |
| x <- data.frame(a=1:3, b=4:6) | |
| conn <- gzfile("test.msgpack.gz", open="w+b") | |
| apply(x, 1, function(x) {writeMsg(c(x, time=as.integer(Sys.time())), conn)}) | |
| flush(conn) | |
| close(conn) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| +t1_1: | |
| py>: rand.rand_params | |
| docker: | |
| image: 'digdag/digdag-python:3.6.8-stretch' | |
| n_iter: 5 | |
| +t1_2: | |
| echo>: ${param_list} | |
| +t1_3: |
chezou
/ calc_multiclass_precision_recall.sql
Last active
March 15, 2019 06:26
Calculate multiclass micro/macro precision and recall in SQL
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| with agg as ( | |
| select | |
| p.label, p.probability, t.survived | |
| from | |
| prediction_rf p | |
| join | |
| test t on (p.rowid = t.rowid) | |
| order by | |
| probability desc | |
| ), |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: R_env | |
| channels: | |
| - conda-forge | |
| - defaults | |
| dependencies: | |
| - arrow-cpp=0.12.0=py37h0e61e49_0 | |
| - attrs=18.2.0=py_0 | |
| - backcall=0.1.0=py_0 | |
| - binutils_impl_linux-64=2.31.1=h6176602_1 | |
| - binutils_linux-64=2.31.1=h6176602_3 |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
chezou
/ backspace_stats_2.ipynb
Last active
January 28, 2019 14:44
Backspace.fm 統計学 inspired by rebuild.fm 統計学 https://github.com/ikedaosushi/python-sandbox/blob/master/analytics/rebuild_analytics/rebuild.fm%E3%81%AE%E7%B5%B1%E8%A8%88%E5%AD%A6.ipynb データ提供 what_alnk さん
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
chezou
/ Visualizing data with Python.ipynb
Created
January 19, 2019 00:57
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
chezou
/ backspace_stats.ipynb
Last active
December 22, 2018 15:46
backspace.fm のtitleとshow noteのword cloudによる可視化
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
chezou
/ Getting started with Machine Learning for Python users on Treasure Data.ipynb
Created
December 4, 2018 08:33
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ENV["MECAB_PATH"]='C:\\mecab\\libmecab.dll' | |
| require 'natto' | |
| nm = Natto::MeCab.new | |
| puts nm.parse('俺の名前は星野豊だ！！そこんとこヨロシク！') |