com.splout.db.benchmark
Class IdentityJob
java.lang.Object
com.splout.db.benchmark.IdentityJob
- All Implemented Interfaces:
- org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool
public class IdentityJob
- extends java.lang.Object
- implements org.apache.hadoop.util.Tool
This Job implements a identity Map/Reduce in two ways: one using the plain Hadoop API and the other one using the Pangool API
for parsing CSV files. With this Job we can measure 1) The overhead of using Splout store generator tools against a plain Indetity Hadoop Job
and 2) Which part of this overhead is only due to parsing CSV files with Pangool.
Method Summary |
org.apache.hadoop.conf.Configuration |
getConf()
|
static void |
main(java.lang.String[] args)
|
int |
run(java.lang.String[] params)
|
void |
setConf(org.apache.hadoop.conf.Configuration conf)
|
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
IdentityJob
public IdentityJob()
getConf
public org.apache.hadoop.conf.Configuration getConf()
- Specified by:
getConf
in interface org.apache.hadoop.conf.Configurable
setConf
public void setConf(org.apache.hadoop.conf.Configuration conf)
- Specified by:
setConf
in interface org.apache.hadoop.conf.Configurable
run
public int run(java.lang.String[] params)
throws java.lang.Exception
- Specified by:
run
in interface org.apache.hadoop.util.Tool
- Throws:
java.lang.Exception
main
public static void main(java.lang.String[] args)
throws java.lang.Exception
- Throws:
java.lang.Exception
Copyright © 2012-2013 Datasalt Systems S.L.. All Rights Reserved.