Makoto YUI myui
myui
/ csr_matrix.py
Last active
December 17, 2015 13:21
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| >>> d.toarray() | |
| array([[2, 1, 0, 0], | |
| [0, 1, 1, 1]]) | |
| >>> c.toarray() | |
| array([[2, 1, 0, 0], | |
| [0, 1, 1, 1]]) | |
| >>> d | |
| <2x4 sparse matrix of type '<type 'numpy.int64'>' | |
| with 5 stored elements in Compressed Sparse Row format> |
myui
/ Iris_RandomForests.ipynb
Created
December 11, 2015 06:09
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
myui
/ hadoop-nodemanager
Created
November 25, 2015 16:45
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # Licensed to the Apache Software Foundation (ASF) under one or more | |
| # contributor license agreements. See the NOTICE file distributed with | |
| # this work for additional information regarding copyright ownership. | |
| # The ASF licenses this file to You under the Apache License, Version 2.0 | |
| # (the "License"); you may not use this file except in compliance with | |
| # the License. You may obtain a copy of the License at | |
| # | |
| # http://www.apache.org/licenses/LICENSE-2.0 |
myui
/ hadoop-datanode
Created
November 25, 2015 16:43
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # Licensed to the Apache Software Foundation (ASF) under one or more | |
| # contributor license agreements. See the NOTICE file distributed with | |
| # this work for additional information regarding copyright ownership. | |
| # The ASF licenses this file to You under the Apache License, Version 2.0 | |
| # (the "License"); you may not use this file except in compliance with | |
| # the License. You may obtain a copy of the License at | |
| # | |
| # http://www.apache.org/licenses/LICENSE-2.0 |
myui
/ quantitative_features.txt
Created
November 4, 2015 06:23
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Caused by: java.lang.NumberFormatException: empty String | |
| at sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1020) | |
| at java.lang.Double.parseDouble(Double.java:540) | |
| at org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorUtils.getDouble(PrimitiveObjectInspectorUtils.java:744) | |
| at hivemall.ftvec.trans.QuantitativeFeaturesUDF.evaluate(QuantitativeFeaturesUDF.java:91) | |
| at hivemall.ftvec.trans.QuantitativeFeaturesUDF.evaluate(QuantitativeFeaturesUDF.java:41) | |
| at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:166) | |
| at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:77) | |
| at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:77) | |
| at hivemall.tools.array.ConcatArrayUDF.evaluate(ConcatArrayUDF.java:86) |
myui
/ fmpredict_bug2.txt
Created
October 29, 2015 23:24
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Hive history file=/mnt/hive/tmp/1/hive_job_log_eb8582f1-0cc1-4fdc-99fc-52b4896e5f74_1231952821.txt | |
| ** | |
| ** WARNING: time index filtering is not set! | |
| ** This query could be very slow as a result. | |
| ** If you used 'unix_timestmap' please modify your query to use TD_SCHEDULED_TIME instead | |
| ** or rewrite the condition using TD_TIME_RANGE | |
| ** Please see http://docs.treasure-data.com/articles/performance-tuning#leveraging-time-based-partitioning | |
| ** | |
| ** | |
| ** WARNING: time index filtering is not set! |
myui
/ fmpredit_bug.txt
Created
October 29, 2015 22:50
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ble to execute method public boolean hivemall.fm.FMPredictUDAF$Evaluator.iterate(org.apache.hadoop.hive.serde2.io.DoubleWritable,java.util.List,org.apache.hadoop.hive.serde2.io.DoubleWritable) throws org.apache.hadoop.hive.ql.metadata.HiveException on object hivemall.fm.FMPredictUDAF$Evaluator@3272e5d6 of class hivemall.fm.FMPredictUDAF$Evaluator with arguments {1.3495872020721436:org.apache.hadoop.hive.serde2.io.DoubleWritable, []:java.util.ArrayList, 1.0:org.apache.hadoop.hive.serde2.io.DoubleWritable} of size 3 | |
| at org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:1253) | |
| at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFBridge$GenericUDAFBridgeEvaluator.iterate(GenericUDAFBridge.java:170) | |
| at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:184) | |
| at org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:641) | |
| at org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:838) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| curl -s https://www.kaggle.com/c/titanic/data | pup 'tbody tr td a attr{href}' | awk '{print "https://kaggle.com" $1}' > urls.txt | |
| # pup is required | |
| # https://github.com/ericchiang/pup | |
| for f in `cat urls.txt`; | |
| do | |
| echo "downloading file: ${f}" | |
| wget -O `basename ${f}` https://www.kaggle.com/account/login?ReturnUrl=${f} --post-data "username=${KAGGLE_USER}&password=${KAGGLE_PASSWD}" | |
| echo | |
| done |
myui
/ EachTopKUDTF.java
Created
September 25, 2015 03:27
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /* | |
| * Hivemall: Hive scalable Machine Learning Library | |
| * | |
| * Copyright (C) 2015 Makoto YUI | |
| * Copyright (C) 2013-2015 National Institute of Advanced Industrial Science and Technology (AIST) | |
| * | |
| * Licensed under the Apache License, Version 2.0 (the "License"); | |
| * you may not use this file except in compliance with the License. | |
| * You may obtain a copy of the License at | |
| * |
myui
/ DecisionTree2.java
Created
September 10, 2015 10:49
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| /******************************************************************************* | |
| * Copyright (c) 2010 Haifeng Li | |
| * | |
| * Licensed under the Apache License, Version 2.0 (the "License"); | |
| * you may not use this file except in compliance with the License. | |
| * You may obtain a copy of the License at | |
| * | |
| * http://www.apache.org/licenses/LICENSE-2.0 | |
| * | |
| * Unless required by applicable law or agreed to in writing, software |