archive: 2014

Hive Get the Max/Min Value Rows

Most of time, we need to find the max or min value of particular columns as well as other columns. For example, we have following employee table. 1234567891011> SELECT name,sex_age.sex AS sex,sex_

Moving to the Spark

It has been a while that the blog is now updated since 2014 is a ready busy year. After I almost completed my first book recently, I think it is the right time to start new journey in big data for rea

Hive and Hadoop Exceptions

I installed Hive 1.0.0 on Hadoop 1.2.1. When I try to enter the Hive CLI, it reports following exceptions 1org.apache.hadoop.hive.ql.metadata.HiveException:java.io.IOException:Filesystem closed Accor

Steps to setup EC2 cluster for Hadoop

Get the Access Key ID and Secret Access Key and store it in a notepad. The keys will be used when creating EC2 instances. If not there, then generate a new set of keys. Go to the PVC Management con