org.apache.hadoop.hbase.mapreduce

Class IntegrationTestBulkLoad.LinkedListCheckingReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<IntegrationTestBulkLoad.LinkKey,IntegrationTestBulkLoad.LinkChain,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.NullWritable>

org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad.LinkedListCheckingReducer

Enclosing class:

IntegrationTestBulkLoad

public static class IntegrationTestBulkLoad.LinkedListCheckingReducer
extends org.apache.hadoop.mapreduce.Reducer<IntegrationTestBulkLoad.LinkKey,IntegrationTestBulkLoad.LinkChain,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.NullWritable>

Class that does the actual checking of the links. All links in the chain should be grouped and sorted when sent to this class. Then the chain will be traversed making sure that no link is missing and that the chain is the correct length. This will throw an exception if anything is not correct. That causes the job to fail if any data is corrupt.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

Constructors

Constructor and Description
LinkedListCheckingReducer()

Method Summary

Modifier and Type	Method and Description
private static void	logError(String msg, org.apache.hadoop.mapreduce.Reducer.Context context)
protected void	reduce(IntegrationTestBulkLoad.LinkKey key, Iterable<IntegrationTestBulkLoad.LinkChain> values, org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LinkedListCheckingReducer

public LinkedListCheckingReducer()

Method Detail

reduce

protected void reduce(IntegrationTestBulkLoad.LinkKey key,
                      Iterable<IntegrationTestBulkLoad.LinkChain> values,
                      org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<IntegrationTestBulkLoad.LinkKey,IntegrationTestBulkLoad.LinkChain,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.NullWritable>

Throws:

IOException

InterruptedException

logError

private static void logError(String msg,
                             org.apache.hadoop.mapreduce.Reducer.Context context)
                      throws IOException

Throws:

IOException