Skip to content

Instantly share code, notes, and snippets.

@winse
winse / tar.test.sh
Created June 20, 2014 05:28
tar解压(过滤)部分文件: --exclude=XXX, XXX
[hadoop@localhost tmp]$ tar zcvf test.tar.gz .
./
./c/
./c/1/
./c/1/2/
./b/
./b/1/
./b/1/2/
./a/
./a/1/
@winse
winse / ha.active.sh
Created June 18, 2014 10:58
hadoop-ha一台master挂了后,强制active另一台机
[hadoop@hadoop-master1 ~]$ hdfs haadmin -transitionToActive --forcemanual nn1
You have specified the forcemanual flag. This flag is dangerous, as it can induce a split-brain scenario that WILL CORRUPT your HDFS namespace, possibly irrecoverably.
It is recommended not to use this flag, but instead to shut down the cluster and disable automatic failover if you prefer to manually manage your HA state.
You may abort safely by answering 'n' or hitting ^C now.
Are you sure you want to continue? (Y or N) Y
14/06/18 10:43:18 WARN ha.HAAdmin: Proceeding with manual HA state management even though
automatic failover is enabled for NameNode at hadoop-master1/192.168.32.11:8020
@winse
winse / filesystem-cache-find-bug.btrace.java
Last active August 29, 2015 14:02
查找hive-0.12.0的filesystem问题的btrace的类。[HIVE-4501](https://issues.apache.org/jira/browse/HIVE-4501)
package com.github.winse.btrace;
/* BTrace Script Template */
import static com.sun.btrace.BTraceUtils.jstack;
import static com.sun.btrace.BTraceUtils.name;
import static com.sun.btrace.BTraceUtils.print;
import static com.sun.btrace.BTraceUtils.printArray;
import static com.sun.btrace.BTraceUtils.println;
import static com.sun.btrace.BTraceUtils.probeClass;
import static com.sun.btrace.BTraceUtils.probeMethod;
@winse
winse / hbaseshell.FirstKeyOnlyFilter.log
Last active December 3, 2015 08:30
hbase命令行使用SingleColumnValueFilter(V0.96.0)
014-07-10 20:04:19,384 INFO LogHbaseService: 过滤的条件为: FilterList AND (2/2): [SingleColumnValueFilter (cf, logType, EQUAL, 3), KeyOnlyFilter]
2014-07-10 20:04:19,384 INFO LogHbaseService: Page FirstResult : 0
2014-07-10 20:04:19,385 INFO LogHbaseService: Page MaxResult : 100
2014-07-10 20:04:19,397 INFO LogHbaseService: 获取总数请求成功, 计算总数量...
2014-07-10 20:05:23,595 INFO LogHbaseService: 获取总数耗时: 64198, 数量: 557574
- - - -
2014-07-10 20:00:46,093 INFO LogHbaseService: 过滤的条件为: FilterList AND (2/2): [FirstKeyOnlyFilter, KeyOnlyFilter]
2014-07-10 20:00:46,093 INFO LogHbaseService: Page FirstResult : 0
@winse
winse / OpenJDK-Build-README.md
Last active May 11, 2017 06:38
win32编译openjdk7u60环境变量设置

编译jdk7u60过程中的注意点:

  1. 先看目录下的README-builds.html,不要太认真看个大概就行
  2. 下载最新的Microsoft DirectX SDK,安装时路径不要带括号
  3. 安装procps代替free.exe(检查可用内存是会用到,没有应该也可以就是多个警告而已)
  4. cygwin-make的版本问题,使用3.81 snapshot
  5. VS2010的cl命令显示的信息一直是中文的话,需要修改源码跳过版本号的检查 snapshot
  6. 语言问题,导致编译corba失败!而后面有需要用到这个工程! snapshot
  7. PATH顺序问题,link.exe和find.exe snapshot
  8. 编译时间有点长! snapshot java-version
@winse
winse / PurePrime.java
Created May 31, 2014 09:56
求单纯质因数的合数
package com.github.winse;
import java.util.Arrays;
import java.util.BitSet;
import java.util.LinkedList;
import java.util.List;
/**
*
* 单纯质因数的合数
@winse
winse / excel.deleteSameAsRowFirstCell.vb
Last active August 29, 2015 14:01
excel行数据处理,去掉行内与第一列数据相同的单元格
Sub 处理行内去掉与第一列相同的数据()
' 整个过程使用:
'
' 1. 选中需要转换的数据区域
' 2. 点击宏
'
Dim sel As Variant
Set sel = Selection
@winse
winse / run-on-hadoop
Last active August 29, 2015 13:57
Ant实现run-on-hadoop的功能。先打包jar,然后把jar路径赋值给mapred.jar。
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<project basedir="." default="run" name="run-on-hadoop">
<property environment="env"/>
<property name="fs.default.name" value="hdfs://192.168.0.205:9000" />
<property name="mapred.job.tracker" value="h205:9001" />
<property name="HADOOP_HOME" value="C:/cygwin/home/Winseliu/hadoop-1.0.0" />
@winse
winse / BaseExcelExportHandler.java
Created March 14, 2014 16:05
将数据库的层级结构导出为excel
package com.gdcn.bpaf.urms.web.handle;
import java.io.Closeable;
import java.io.IOException;
import java.io.OutputStream;
import java.text.DateFormat;
import java.text.SimpleDateFormat;
import java.util.Calendar;
import java.util.Date;
@winse
winse / XMLTransform
Last active July 31, 2018 03:09
调整XML的的结构。增加属性/节点,调整节点层次,转多配置文件等。
package com.importconfig
import groovy.util.XmlNodePrinter;
import groovy.util.XmlNodePrinter.NamespaceContext;
import java.io.PrintWriter;
import java.util.Map;
import org.codehaus.groovy.runtime.InvokerHelper;