org.apache.hadoop.hbase.mapreduce

Class TestMultithreadedTableMapper

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper

public class TestMultithreadedTableMapper
extends Object

Test Map/Reduce job over HBase tables. The map/reduce process we're testing on our tables is simple - take every row in the table, reverse the value of a particular cell, and write it back to the table.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestMultithreadedTableMapper.ProcessContentsMapper Pass the given key and processed record reduce

Field Summary

Fields

Modifier and Type	Field and Description
static HBaseClassTestRule	CLASS_RULE
(package private) static byte[]	INPUT_FAMILY
private static org.slf4j.Logger	LOG
(package private) static org.apache.hadoop.hbase.TableName	MULTI_REGION_TABLE_NAME
(package private) static int	NUMBER_OF_THREADS
(package private) static byte[]	OUTPUT_FAMILY
private static HBaseTestingUtility	UTIL

Constructor Summary

Constructors

Constructor and Description
TestMultithreadedTableMapper()

Method Summary

Modifier and Type	Method and Description
static void	afterClass()
static void	beforeClass()
private void	runTestOnTable(org.apache.hadoop.hbase.client.Table table)
void	testMultithreadedTableMapper() Test multithreadedTableMappper map/reduce against a multi-region table
private void	verify(org.apache.hadoop.hbase.TableName tableName)
private void	verifyAttempt(org.apache.hadoop.hbase.client.Table table) Looks at every value of the mapreduce output and verifies that indeed the values have been reversed.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtility UTIL

MULTI_REGION_TABLE_NAME

static final org.apache.hadoop.hbase.TableName MULTI_REGION_TABLE_NAME

INPUT_FAMILY

static final byte[] INPUT_FAMILY

OUTPUT_FAMILY

static final byte[] OUTPUT_FAMILY

NUMBER_OF_THREADS

static final int NUMBER_OF_THREADS

See Also:

Constant Field Values

Constructor Detail

TestMultithreadedTableMapper

public TestMultithreadedTableMapper()

Method Detail

beforeClass

public static void beforeClass()
                        throws Exception

Throws:

Exception

afterClass

public static void afterClass()
                       throws Exception

Throws:

Exception

testMultithreadedTableMapper

public void testMultithreadedTableMapper()
                                  throws IOException,
                                         InterruptedException,
                                         ClassNotFoundException

Test multithreadedTableMappper map/reduce against a multi-region table

Throws:

IOException

ClassNotFoundException

InterruptedException

runTestOnTable

private void runTestOnTable(org.apache.hadoop.hbase.client.Table table)
                     throws IOException,
                            InterruptedException,
                            ClassNotFoundException

Throws:

IOException

InterruptedException

ClassNotFoundException

verify

private void verify(org.apache.hadoop.hbase.TableName tableName)
             throws IOException

Throws:

IOException

verifyAttempt

private void verifyAttempt(org.apache.hadoop.hbase.client.Table table)
                    throws IOException,
                           NullPointerException

Looks at every value of the mapreduce output and verifies that indeed the values have been reversed.

Parameters:

table - Table to scan.

Throws:

IOException

NullPointerException - if we failed to find a cell value