com.splout.db.benchmark
Class IdentityJob

java.lang.Object
  com.splout.db.benchmark.IdentityJob

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class IdentityJob
extends java.lang.Object
implements org.apache.hadoop.util.Tool

This Job implements a identity Map/Reduce in two ways: one using the plain Hadoop API and the other one using the Pangool API for parsing CSV files. With this Job we can measure 1) The overhead of using Splout store generator tools against a plain Indetity Hadoop Job and 2) Which part of this overhead is only due to parsing CSV files with Pangool.

Constructor Summary

IdentityJob()

Method Summary

org.apache.hadoop.conf.Configuration	getConf()
static void	main(java.lang.String[] args)
int	run(java.lang.String[] params)
void	setConf(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IdentityJob

public IdentityJob()

Method Detail

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

run

public int run(java.lang.String[] params)
        throws java.lang.Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

java.lang.Exception

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception