org.apache.hadoop.hbase.test

Class IntegrationTestBigLinkedList.Verify

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList.Verify

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

Direct Known Subclasses:

IntegrationTestBigLinkedListWithVisibility.VisibilityVerify

Enclosing class:

IntegrationTestBigLinkedList

static class IntegrationTestBigLinkedList.Verify
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

A Map Reduce job that verifies that the linked lists generated by IntegrationTestBigLinkedList.Generator do not have any holes.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	IntegrationTestBigLinkedList.Verify.Counts Don't change the order of these enums.
static class	IntegrationTestBigLinkedList.Verify.VerifyMapper
static class	IntegrationTestBigLinkedList.Verify.VerifyReducer Per reducer, we output problem rows as byte arrasy so can be used as input for subsequent investigative mapreduce jobs.

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.apache.hadoop.io.BytesWritable	DEF
protected static org.apache.hadoop.io.BytesWritable	DEF_LOST_FAMILIES
protected org.apache.hadoop.mapreduce.Job	job
private static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
Verify()

Method Summary

Modifier and Type	Method and Description
protected void	handleFailure(org.apache.hadoop.mapreduce.Counters counters)
int	run(org.apache.hadoop.fs.Path outputDir, int numReducers)
int	run(String[] args)
int	run(String outputDir, int numReducers)
boolean	verify(long expectedReferenced)
protected boolean	verifyExpectedValues(long expectedReferenced, org.apache.hadoop.mapreduce.Counters counters) Verify the values in the Counters against the expected number of entries written.
protected boolean	verifyUnexpectedValues(org.apache.hadoop.mapreduce.Counters counters) Verify that the Counters don't contain values which indicate an outright failure from the Reducers.

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

LOG

private static final org.slf4j.Logger LOG

DEF

protected static final org.apache.hadoop.io.BytesWritable DEF

DEF_LOST_FAMILIES

protected static final org.apache.hadoop.io.BytesWritable DEF_LOST_FAMILIES

job

protected org.apache.hadoop.mapreduce.Job job

Constructor Detail

Verify

Verify()

Method Detail

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

run

public int run(String outputDir,
               int numReducers)
        throws Exception

Throws:

Exception

run

public int run(org.apache.hadoop.fs.Path outputDir,
               int numReducers)
        throws Exception

Throws:

Exception

verify

public boolean verify(long expectedReferenced)
               throws Exception

Throws:

Exception

verifyExpectedValues

protected boolean verifyExpectedValues(long expectedReferenced,
                                       org.apache.hadoop.mapreduce.Counters counters)

Verify the values in the Counters against the expected number of entries written.

Parameters:

expectedReferenced - Expected number of referenced entrires

counters - The Job's Counters object

Returns:

True if the values match what's expected, false otherwise

verifyUnexpectedValues

protected boolean verifyUnexpectedValues(org.apache.hadoop.mapreduce.Counters counters)

Verify that the Counters don't contain values which indicate an outright failure from the Reducers.

Parameters:

counters - The Job's counters

Returns:

True if the "bad" counter objects are 0, false otherwise

handleFailure

protected void handleFailure(org.apache.hadoop.mapreduce.Counters counters)
                      throws IOException

Throws:

IOException