org.apache.hadoop.hbase.mapreduce

Class TestTableMapReduceBase

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestTableMapReduceBase

Direct Known Subclasses:

TestTableMapReduce, TestTableMapReduce

public abstract class TestTableMapReduceBase
extends Object

A base class for a test Map/Reduce job over HBase tables. The map/reduce process we're testing on our tables is simple - take every row in the table, reverse the value of a particular cell, and write it back to the table. Implements common components between mapred and mapreduce implementations.

Field Summary

Fields

Modifier and Type	Field and Description
protected static byte[][]	columns
protected static byte[]	INPUT_FAMILY
protected static org.apache.hadoop.hbase.TableName	MULTI_REGION_TABLE_NAME
protected static byte[]	OUTPUT_FAMILY
protected static org.apache.hadoop.hbase.TableName	TABLE_FOR_NEGATIVE_TESTS
protected static HBaseTestingUtility	UTIL

Constructor Summary

Constructors

Constructor and Description
TestTableMapReduceBase()

Method Summary

Modifier and Type	Method and Description
static void	afterClass()
static void	beforeClass()
protected abstract org.slf4j.Logger	getLog() Retrieve my logger instance.
protected static org.apache.hadoop.hbase.client.Put	map(org.apache.hadoop.hbase.io.ImmutableBytesWritable key, org.apache.hadoop.hbase.client.Result value) Implements mapper logic for use across APIs.
protected abstract void	runTestOnTable(org.apache.hadoop.hbase.client.Table table) Handles API-specifics for setting up and executing the job.
void	testCombiner()
void	testMultiRegionTable() Test a map/reduce against a multi-region table
protected void	verify(org.apache.hadoop.hbase.TableName tableName)
private void	verifyAttempt(org.apache.hadoop.hbase.client.Table table) Looks at every value of the mapreduce output and verifies that indeed the values have been reversed.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

UTIL

protected static final HBaseTestingUtility UTIL

MULTI_REGION_TABLE_NAME

protected static final org.apache.hadoop.hbase.TableName MULTI_REGION_TABLE_NAME

TABLE_FOR_NEGATIVE_TESTS

protected static final org.apache.hadoop.hbase.TableName TABLE_FOR_NEGATIVE_TESTS

INPUT_FAMILY

protected static final byte[] INPUT_FAMILY

OUTPUT_FAMILY

protected static final byte[] OUTPUT_FAMILY

columns

protected static final byte[][] columns

Constructor Detail

TestTableMapReduceBase

public TestTableMapReduceBase()

Method Detail

getLog

protected abstract org.slf4j.Logger getLog()

Retrieve my logger instance.

runTestOnTable

protected abstract void runTestOnTable(org.apache.hadoop.hbase.client.Table table)
                                throws IOException

Handles API-specifics for setting up and executing the job.

Throws:

IOException

beforeClass

public static void beforeClass()
                        throws Exception

Throws:

Exception

afterClass

public static void afterClass()
                       throws Exception

Throws:

Exception

testMultiRegionTable

public void testMultiRegionTable()
                          throws IOException

Test a map/reduce against a multi-region table

Throws:

IOException

testCombiner

public void testCombiner()
                  throws IOException

Throws:

IOException

map

protected static org.apache.hadoop.hbase.client.Put map(org.apache.hadoop.hbase.io.ImmutableBytesWritable key,
                                                        org.apache.hadoop.hbase.client.Result value)
                                                 throws IOException

Implements mapper logic for use across APIs.

Throws:

IOException

verify

protected void verify(org.apache.hadoop.hbase.TableName tableName)
               throws IOException

Throws:

IOException

verifyAttempt

private void verifyAttempt(org.apache.hadoop.hbase.client.Table table)
                    throws IOException,
                           NullPointerException

Looks at every value of the mapreduce output and verifies that indeed the values have been reversed.

Parameters:

table - Table to scan.

Throws:

IOException

NullPointerException - if we failed to find a cell value