Skip to content

Instantly share code, notes, and snippets.

View myui's full-sized avatar

Makoto YUI myui

View GitHub Profile
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@myui
myui / test.ipynb
Last active February 19, 2024 09:08
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
name: base
channels:
- defaults
- conda-forge
dependencies:
- _libgcc_mutex=0.1=main
- arrow-cpp=0.15.1=py37had5782a_4
- asn1crypto=1.2.0=py37_0
- binutils_impl_linux-64=2.31.1=h6176602_1
- binutils_linux-64=2.31.1=h6176602_8
@myui
myui / constraints.txt
Created February 26, 2021 02:13
constraints.txt for digdag-python:3.9.1
alembic==1.5.3
attrs==20.3.0
boto3==1.15.18
botocore==1.18.18
certifi==2020.12.5
chardet==4.0.0
click==7.1.2
cliff==3.5.0
cloudpickle==1.6.0
cmaes==0.7.0
@myui
myui / pget.sh
Last active February 25, 2021 06:42
#!/usr/bin/env bash
# based on https://github.com/z3r0n3t/pkget
# copyright 2020 enp0s10
# Licensed under GNU GPLv3
echo "starting install..."
USER=`whoami`
echo "curent user is $USER"
#!/bin/bash
# Set up CPAN
# Append the following lines to .bashrc / .profile
# PERL_DIR=$HOME/.perl
# export PERL_LOCAL_LIB_ROOT=$PERL_DIR:${PERL_LOCAL_LIB_ROOT}
# export PATH=$PERL_DIR/bin:$PATH
# export PERL5LIB=$PERL_DIR/lib/perl5
# PERL_MB_OPT="--install_base \"${PERL_DIR}\""; export PERL_MB_OPT;
# PERL_MM_OPT="INSTALL_BASE=${PERL_DIR}"; export PERL_MM_OPT;
Deletion from a leaf node
 1. search for the key to delete
 2. if the key in leaf nodes, simply delete it
 3. if underflow happens, rebalancing
    Rebalancing starts from a leaf toward the root until the tree is balanced.
Triggered when underflow happens through remove()
from memory_profiler import profile
@profile()
def my_func():
a = [1] * (10 ** 6)
b = [2] * (2 * 10 ** 7)
del b
return a
my_func()
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

Hivemall v0.6.0 update

Hivemall version is updated to v0.6.0-201912-r03 based on Apache Hivemall v0.6.0.

Major new features in this release includes:

  • xgboost (v0.90) support (find usage)
  • Improvements on tokenize_ja
    • Part-of-Speech (PoS) support in tokenze_ja (find usage)
    • new stoptag_excludes UDF (find usage)