org.apache.hadoop.hbase.mapreduce

Class TestTableInputFormatScanBase

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScanBase

Direct Known Subclasses:

TestTableInputFormatScan, TestTableInputFormatScanEmptyToAPP, TestTableInputFormatScanEmptyToBBA, TestTableInputFormatScanEmptyToBBB, TestTableInputFormatScanEmptyToEmpty, TestTableInputFormatScanEmptyToOPP, TestTableInputFormatScanOBBToOPP, TestTableInputFormatScanOBBToQPP, TestTableInputFormatScanOPPToEmpty, TestTableInputFormatScanYYXToEmpty, TestTableInputFormatScanYYYToEmpty, TestTableInputFormatScanYZYToEmpty

public abstract class TestTableInputFormatScanBase
extends Object

Tests various scan start and stop row scenarios. This is set in a scan and tested in a MapReduce job to see if that is handed over and done properly too.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestTableInputFormatScanBase.ScanMapper Pass the key and value to reduce.
static class	TestTableInputFormatScanBase.ScanReducer Checks the last and first key seen against the scanner boundaries.

Field Summary

Fields

Modifier and Type	Field and Description
(package private) static byte[][]	INPUT_FAMILYS
(package private) static String	KEY_LASTROW
(package private) static String	KEY_STARTROW
private static org.slf4j.Logger	LOG
private static org.apache.hadoop.hbase.client.Table	table
(package private) static org.apache.hadoop.hbase.TableName	TABLE_NAME
(package private) static HBaseTestingUtil	TEST_UTIL

Constructor Summary

Constructors

Constructor and Description
TestTableInputFormatScanBase()

Method Summary

Modifier and Type	Method and Description
static void	setUpBeforeClass()
static void	tearDownAfterClass()
protected void	testAutobalanceNumOfSplit() Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job
protected void	testNumOfSplits(int splitsPerRegion, int expectedNumOfSplits) Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job
protected void	testNumOfSplitsMR(int splitsPerRegion, int expectedNumOfSplits) Run MR job to check the number of mapper = expectedNumOfSplits
protected void	testScan(String start, String stop, String last) Tests a MR scan using specific start and stop rows.
protected void	testScanFromConfiguration(String start, String stop, String last) Tests an MR Scan initialized from properties set in the Configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

static final HBaseTestingUtil TEST_UTIL

TABLE_NAME

static final org.apache.hadoop.hbase.TableName TABLE_NAME

INPUT_FAMILYS

static final byte[][] INPUT_FAMILYS

KEY_STARTROW

static final String KEY_STARTROW

See Also:

Constant Field Values

KEY_LASTROW

static final String KEY_LASTROW

See Also:

Constant Field Values

table

private static org.apache.hadoop.hbase.client.Table table

Constructor Detail

TestTableInputFormatScanBase

public TestTableInputFormatScanBase()

Method Detail

setUpBeforeClass

public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

testScanFromConfiguration

protected void testScanFromConfiguration(String start,
                                         String stop,
                                         String last)
                                  throws IOException,
                                         InterruptedException,
                                         ClassNotFoundException

Tests an MR Scan initialized from properties set in the Configuration.

Throws:

IOException

InterruptedException

ClassNotFoundException

testScan

protected void testScan(String start,
                        String stop,
                        String last)
                 throws IOException,
                        InterruptedException,
                        ClassNotFoundException

Tests a MR scan using specific start and stop rows.

Throws:

IOException

InterruptedException

ClassNotFoundException

testNumOfSplits

protected void testNumOfSplits(int splitsPerRegion,
                               int expectedNumOfSplits)
                        throws IOException,
                               InterruptedException,
                               ClassNotFoundException

Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job

Throws:

IOException

InterruptedException

ClassNotFoundException

testNumOfSplitsMR

protected void testNumOfSplitsMR(int splitsPerRegion,
                                 int expectedNumOfSplits)
                          throws IOException,
                                 InterruptedException,
                                 ClassNotFoundException

Run MR job to check the number of mapper = expectedNumOfSplits

Throws:

IOException

InterruptedException

ClassNotFoundException

testAutobalanceNumOfSplit

protected void testAutobalanceNumOfSplit()
                                  throws IOException

Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job

Throws:

IOException