Skip to content

Instantly share code, notes, and snippets.

View myui's full-sized avatar

Makoto YUI myui

View GitHub Profile
ble to execute method public boolean hivemall.fm.FMPredictUDAF$Evaluator.iterate(org.apache.hadoop.hive.serde2.io.DoubleWritable,java.util.List,org.apache.hadoop.hive.serde2.io.DoubleWritable) throws org.apache.hadoop.hive.ql.metadata.HiveException on object hivemall.fm.FMPredictUDAF$Evaluator@3272e5d6 of class hivemall.fm.FMPredictUDAF$Evaluator with arguments {1.3495872020721436:org.apache.hadoop.hive.serde2.io.DoubleWritable, []:java.util.ArrayList, 1.0:org.apache.hadoop.hive.serde2.io.DoubleWritable} of size 3
at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1253)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFBridge$GenericUDAFBridgeEvaluator.iterate(GenericUDAFBridge.java:170)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:184)
at org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:641)
at org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:838)
@myui
myui / kaggle_dataget.sh
Last active October 28, 2015 01:54
Kaggle data get script
curl -s https://www.kaggle.com/c/titanic/data | pup 'tbody tr td a attr{href}' | awk '{print "https://kaggle.com" $1}' > urls.txt
# pup is required
# https://github.com/ericchiang/pup
for f in `cat urls.txt`;
do
echo "downloading file: ${f}"
wget -O `basename ${f}` https://www.kaggle.com/account/login?ReturnUrl=${f} --post-data "username=${KAGGLE_USER}&password=${KAGGLE_PASSWD}"
echo
done
/*
* Hivemall: Hive scalable Machine Learning Library
*
* Copyright (C) 2015 Makoto YUI
* Copyright (C) 2013-2015 National Institute of Advanced Industrial Science and Technology (AIST)
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
/*******************************************************************************
* Copyright (c) 2010 Haifeng Li
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
/*
* Hivemall: Hive scalable Machine Learning Library
*
* Copyright (C) 2015 Makoto YUI
* Copyright (C) 2013-2015 National Institute of Advanced Industrial Science and Technology (AIST)
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
rowid weight specific_heat reflectance
1 69.613 129.070 52.111
2 70.670 128.161 52.446
3 72.303 128.450 52.853
4 73.759 127.522 51.786
5 74.085 129.067 53.352
6 74.561 134.031 50.992
7 74.911 134.944 50.744
8 75.205 129.162 52.800
9 75.395 129.711 52.844
@relation weather.symbolic
@attribute outlook {sunny, overcast, rainy}
@attribute temperature {hot, mild, cool}
@attribute humidity {high, normal}
@attribute windy {TRUE, FALSE}
@attribute play {yes, no}
@data
sunny,hot,high,FALSE,no
%
% As used by Kilpatrick, D. & Cameron-Jones, M. (1998). Numeric prediction
% using instance-based learning with encoding length selection. In Progress
% in Connectionist-Based Information Systems. Singapore: Springer-Verlag.
%
% Deleted "vendor" attribute to make data consistent with with what we
% used in the data mining book.
%
@relation 'cpu'
@attribute MYCT real
% 1. Title: Iris Plants Database
%
% 2. Sources:
% (a) Creator: R.A. Fisher
% (b) Donor: Michael Marshall (MARSHALL%PLU@io.arc.nasa.gov)
% (c) Date: July, 1988
%
% 3. Past Usage:
% - Publications: too many to mention!!! Here are a few.
% 1. Fisher,R.A. "The use of multiple measurements in taxonomic problems"
@myui
myui / vmtest01.txt
Last active September 1, 2015 09:26
push x[10]; push 10.0; ifeq 205; push x[5]; push 275.5; ifle 68; push x[1]; push 7.0; ifeq 11; push 1; goto last; push x[15]; push 2.0; ifeq 26; push x[14]; push 2.5; ifle 24; push x[0]; push 49.5; ifle 22; push 0; goto last; push 1; goto last; push 1; goto last; push x[11]; push 327.5; ifle 66; push x[11]; push 265.5; ifle 64; push x[1]; push 6.0; ifeq 37; push 0; goto last; push x[11]; push 87.5; ifle 42; push 0; goto last; push x[11]; push 190.0; ifle 62; push x[9]; push 15.0; ifle 60; push x[3]; push 0.0; ifeq 58; push x[13]; push 264.0; ifle 56; push 1; goto last; push 0; goto last; push 0; goto last; push 1; goto last; push 0; goto last; push 1; goto last; push 0; goto last; push x[9]; push 18.5; ifle 128; push x[0]; push 25.0; ifle 76; push 1; goto last; push x[2]; push 2.0; ifeq 96; push x[11]; push 619.0; ifle 94; push x[6]; push 0.0; ifeq 87; push 1; goto last; push x[14]; push 3.5; ifle 92; push 0; goto last; push 1; goto last; push 0; goto last; push x[11]; push 153.0; ifle 101; push 0; goto last;