Home

Commonly Used Maven Plugins

Backgrounds我们都知道Maven本质上是一个插件框架,它的核心并不执行任何具体的构建任务,所有这些任务都交给插件来完成,例如编译源代码是由maven-compiler-plugin完成的。进一步说,每个任务对应了一个插件目标(goal),每个插件会有一个或者多个目标,例如maven-compiler-plugin的compile目标用来编译位于src/main/java/目录下的主源码

Hadoop Counter

hadoop counter is to help developers and users to have overall status of running jobs. There are three type of counters, MapReduce related, File systems related, and job related. The details can be s

Hadoop DistributedCache

DistributedCache UsageThe usage of DistributedCache is as follows Share data files/meta data/binary files among map and reduce tasks Add 3rd party packages to the classpath DistributedCache APIBasic

Install Jekyll in MacOS

In this year, I have changed blog engines I used from blog.com to GitHub. The main reason is avaliability. The blog.com has so frequent downsite time particularlly when I start using it. For the other

Git Catchup Changes

There are following ways to catch up/revert changes in GIT Catchup changes from remote Pull out from remote again and you lost all of your local changes as well as hisory rm -Rf working_folders git c

GIT Tips At Weekend - Sunday

Cherry-Picking git cherry-pick [--edit] [-n] [-m parent-number] [-s] [-x] <commit> Selectively merge a single commit from another local branchExample: git cherry-pick 7300a6130d9447e18a931e898b

GIT Tips At Weekend - Saturday

Info git reflog Use this to recover from major fuck ups! It’s basically a log of thelast few actions and you might have luck and find old commits thathave been lost by doing a complex merge. git diff

GIT Tips At Weekend - Friday

Git Setup Git Clonegit clone [repo] clone the repository specified by [repo]. It defaully run git init and git remote add origin [repo] Add colors by setting ~/.gitconfig file:[color] ui = auto [colo

Hadoop Multiple Input and Output

The following is an example of using multiple inputs (org.apache.hadoop.mapreduce.lib.input.MultipleInputs) with different input formats and different mapper implementations. MultipleInputs.addInputP

Hadoop Customize Data Type

Customize Data Type - As ValueTo create a customized data type used as a value, the data type must implement the org.apache.hadoop.io.Writable interface which consists of the two methods, readFields(