Package org.apache.hadoop.hbase.mapreduce

Class TestMultithreadedTableMapper

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestMultithreadedTableMapper

@Tag("org.apache.hadoop.hbase.testclassification.MapReduceTests") @Tag("org.apache.hadoop.hbase.testclassification.LargeTests")
public class TestMultithreadedTableMapper
extends Object

Test Map/Reduce job over HBase tables. The map/reduce process we're testing on our tables is simple - take every row in the table, reverse the value of a particular cell, and write it back to the table.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	TestMultithreadedTableMapper.ProcessContentsMapper	Pass the given key and processed record reduce

Field Summary

Fields

Modifier and Type	Field	Description
(package private) static final byte[]	INPUT_FAMILY
private static final org.slf4j.Logger	LOG
(package private) static final org.apache.hadoop.hbase.TableName	MULTI_REGION_TABLE_NAME
(package private) static final int	NUMBER_OF_THREADS
(package private) static final byte[]	OUTPUT_FAMILY
private static final HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
TestMultithreadedTableMapper()

Method Summary

Modifier and Type	Method	Description
static void	afterClass()
static void	beforeClass()
private void	runTestOnTable(org.apache.hadoop.hbase.client.Table table)
void	testMultithreadedTableMapper()	Test multithreadedTableMappper map/reduce against a multi-region table
private void	verify(org.apache.hadoop.hbase.TableName tableName)
private void	verifyAttempt(org.apache.hadoop.hbase.client.Table table)	Looks at every value of the mapreduce output and verifies that indeed the values have been reversed.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtil UTIL

MULTI_REGION_TABLE_NAME

static final org.apache.hadoop.hbase.TableName MULTI_REGION_TABLE_NAME

INPUT_FAMILY

static final byte[] INPUT_FAMILY

OUTPUT_FAMILY

static final byte[] OUTPUT_FAMILY

NUMBER_OF_THREADS

static final int NUMBER_OF_THREADS

See Also:

• Constant Field Values

Constructor Details

TestMultithreadedTableMapper

public TestMultithreadedTableMapper()

Method Details

beforeClass

@BeforeAll
public static void beforeClass()
                        throws Exception

Throws:

Exception

afterClass

@AfterAll
public static void afterClass()
                       throws Exception

Throws:

Exception

testMultithreadedTableMapper

@Test
public void testMultithreadedTableMapper()
                                  throws IOException,
InterruptedException,
ClassNotFoundException

Test multithreadedTableMappper map/reduce against a multi-region table

Throws:

IOException

InterruptedException

ClassNotFoundException

runTestOnTable

private void runTestOnTable(org.apache.hadoop.hbase.client.Table table)
                     throws IOException,
InterruptedException,
ClassNotFoundException

Throws:

IOException

InterruptedException

ClassNotFoundException

verify

private void verify(org.apache.hadoop.hbase.TableName tableName)
             throws IOException

Throws:

IOException

verifyAttempt

private void verifyAttempt(org.apache.hadoop.hbase.client.Table table)
                    throws IOException,
NullPointerException

Looks at every value of the mapreduce output and verifies that indeed the values have been reversed.

Parameters:

table - Table to scan.

Throws:

NullPointerException - if we failed to find a cell value

IOException