com.splout.db.benchmark
Class IdentityJob

java.lang.Object
  extended by com.splout.db.benchmark.IdentityJob
All Implemented Interfaces:
org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class IdentityJob
extends java.lang.Object
implements org.apache.hadoop.util.Tool

This Job implements a identity Map/Reduce in two ways: one using the plain Hadoop API and the other one using the Pangool API for parsing CSV files. With this Job we can measure 1) The overhead of using Splout store generator tools against a plain Indetity Hadoop Job and 2) Which part of this overhead is only due to parsing CSV files with Pangool.


Constructor Summary
IdentityJob()
           
 
Method Summary
 org.apache.hadoop.conf.Configuration getConf()
           
static void main(java.lang.String[] args)
           
 int run(java.lang.String[] params)
           
 void setConf(org.apache.hadoop.conf.Configuration conf)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

IdentityJob

public IdentityJob()
Method Detail

getConf

public org.apache.hadoop.conf.Configuration getConf()
Specified by:
getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)
Specified by:
setConf in interface org.apache.hadoop.conf.Configurable

run

public int run(java.lang.String[] params)
        throws java.lang.Exception
Specified by:
run in interface org.apache.hadoop.util.Tool
Throws:
java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception
Throws:
java.lang.Exception


Copyright © 2012-2013 Datasalt Systems S.L.. All Rights Reserved.