Package org.apache.hadoop.hbase.mapreduce

Class TestTableInputFormatScanBase

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScanBase

Direct Known Subclasses:

TestTableInputFormatScan, TestTableInputFormatScanEmptyToAPP, TestTableInputFormatScanEmptyToBBA, TestTableInputFormatScanEmptyToBBB, TestTableInputFormatScanEmptyToEmpty, TestTableInputFormatScanEmptyToOPP, TestTableInputFormatScanOBBToOPP, TestTableInputFormatScanOBBToQPP, TestTableInputFormatScanOPPToEmpty, TestTableInputFormatScanYYXToEmpty, TestTableInputFormatScanYYYToEmpty, TestTableInputFormatScanYZYToEmpty

public abstract class TestTableInputFormatScanBase
extends Object

Tests various scan start and stop row scenarios. This is set in a scan and tested in a MapReduce job to see if that is handed over and done properly too.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	TestTableInputFormatScanBase.ScanMapper	Pass the key and value to reduce.
static class	TestTableInputFormatScanBase.ScanReducer	Checks the last and first key seen against the scanner boundaries.

Field Summary

Fields

Modifier and Type	Field	Description
(package private) static final byte[][]	INPUT_FAMILYS
(package private) static final String	KEY_LASTROW
(package private) static final String	KEY_STARTROW
private static final org.slf4j.Logger	LOG
private static org.apache.hadoop.hbase.client.Table	table
(package private) static final org.apache.hadoop.hbase.TableName	TABLE_NAME
(package private) static final HBaseTestingUtil	TEST_UTIL

Constructor Summary

Constructors

Constructor	Description
TestTableInputFormatScanBase()

Method Summary

Modifier and Type	Method	Description
static void	setUpBeforeClass()
static void	tearDownAfterClass()
protected void	testAutobalanceNumOfSplit()	Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job
protected void	testNumOfSplits(int splitsPerRegion, int expectedNumOfSplits)	Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job
protected void	testNumOfSplitsMR(int splitsPerRegion, int expectedNumOfSplits)	Run MR job to check the number of mapper = expectedNumOfSplits
protected void	testScan(String start, String stop, String last)	Tests a MR scan using specific start and stop rows.
protected void	testScanFromConfiguration(String start, String stop, String last)	Tests an MR Scan initialized from properties set in the Configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

static final HBaseTestingUtil TEST_UTIL

TABLE_NAME

static final org.apache.hadoop.hbase.TableName TABLE_NAME

INPUT_FAMILYS

static final byte[][] INPUT_FAMILYS

KEY_STARTROW

static final String KEY_STARTROW

See Also:

• Constant Field Values

KEY_LASTROW

static final String KEY_LASTROW

See Also:

• Constant Field Values

table

private static org.apache.hadoop.hbase.client.Table table

Constructor Details

TestTableInputFormatScanBase

public TestTableInputFormatScanBase()

Method Details

setUpBeforeClass

public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

testScanFromConfiguration

protected void testScanFromConfiguration(String start,
 String stop,
 String last)
                                  throws IOException,
InterruptedException,
ClassNotFoundException

Tests an MR Scan initialized from properties set in the Configuration.

Throws:

IOException

InterruptedException

ClassNotFoundException

testScan

protected void testScan(String start,
 String stop,
 String last)
                 throws IOException,
InterruptedException,
ClassNotFoundException

Tests a MR scan using specific start and stop rows.

Throws:

IOException

InterruptedException

ClassNotFoundException

testNumOfSplits

protected void testNumOfSplits(int splitsPerRegion,
 int expectedNumOfSplits)
                        throws IOException,
InterruptedException,
ClassNotFoundException

Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job

Throws:

IOException

InterruptedException

ClassNotFoundException

testNumOfSplitsMR

protected void testNumOfSplitsMR(int splitsPerRegion,
 int expectedNumOfSplits)
                          throws IOException,
InterruptedException,
ClassNotFoundException

Run MR job to check the number of mapper = expectedNumOfSplits

Throws:

IOException

InterruptedException

ClassNotFoundException

testAutobalanceNumOfSplit

protected void testAutobalanceNumOfSplit()
                                  throws IOException

Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job

Throws:

IOException