org.apache.hadoop.hbase.mapreduce

Class TestTableInputFormatScanBase

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScanBase

Direct Known Subclasses:

TestTableInputFormatScan1, TestTableInputFormatScan2

public abstract class TestTableInputFormatScanBase
extends Object

Tests various scan start and stop row scenarios. This is set in a scan and tested in a MapReduce job to see if that is handed over and done properly too.

This test is broken into two parts in order to side-step the test timeout period of 900, as documented in HBASE-8326.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestTableInputFormatScanBase.ScanMapper Pass the key and value to reduce.
static class	TestTableInputFormatScanBase.ScanReducer Checks the last and first key seen against the scanner boundaries.

Field Summary

Fields

Modifier and Type	Field and Description
(package private) static byte[][]	INPUT_FAMILYS
(package private) static String	KEY_LASTROW
(package private) static String	KEY_STARTROW
private static org.slf4j.Logger	LOG
private static org.apache.hadoop.hbase.client.Table	table
(package private) static org.apache.hadoop.hbase.TableName	TABLE_NAME
(package private) static HBaseTestingUtility	TEST_UTIL

Constructor Summary

Constructors

Constructor and Description
TestTableInputFormatScanBase()

Method Summary

Modifier and Type	Method and Description
static void	setUpBeforeClass()
static void	tearDownAfterClass()
void	testAutobalanceNumOfSplit() Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job
void	testNumOfSplits(int splitsPerRegion, int expectedNumOfSplits) Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job
void	testNumOfSplitsMR(int splitsPerRegion, int expectedNumOfSplits) Run MR job to check the number of mapper = expectedNumOfSplits
protected void	testScan(String start, String stop, String last) Tests a MR scan using specific start and stop rows.
protected void	testScanFromConfiguration(String start, String stop, String last) Tests an MR Scan initialized from properties set in the Configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

static final HBaseTestingUtility TEST_UTIL

TABLE_NAME

static final org.apache.hadoop.hbase.TableName TABLE_NAME

INPUT_FAMILYS

static final byte[][] INPUT_FAMILYS

KEY_STARTROW

static final String KEY_STARTROW

See Also:

Constant Field Values

KEY_LASTROW

static final String KEY_LASTROW

See Also:

Constant Field Values

table

private static org.apache.hadoop.hbase.client.Table table

Constructor Detail

TestTableInputFormatScanBase

public TestTableInputFormatScanBase()

Method Detail

setUpBeforeClass

public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

testScanFromConfiguration

protected void testScanFromConfiguration(String start,
                                         String stop,
                                         String last)
                                  throws IOException,
                                         InterruptedException,
                                         ClassNotFoundException

Tests an MR Scan initialized from properties set in the Configuration.

Throws:

IOException

ClassNotFoundException

InterruptedException

testScan

protected void testScan(String start,
                        String stop,
                        String last)
                 throws IOException,
                        InterruptedException,
                        ClassNotFoundException

Tests a MR scan using specific start and stop rows.

Throws:

IOException

ClassNotFoundException

InterruptedException

testNumOfSplits

public void testNumOfSplits(int splitsPerRegion,
                            int expectedNumOfSplits)
                     throws IOException,
                            InterruptedException,
                            ClassNotFoundException

Tests Number of inputSplits for MR job when specify number of mappers for TableInputFormatXXX This test does not run MR job

Throws:

IOException

ClassNotFoundException

InterruptedException

testNumOfSplitsMR

public void testNumOfSplitsMR(int splitsPerRegion,
                              int expectedNumOfSplits)
                       throws IOException,
                              InterruptedException,
                              ClassNotFoundException

Run MR job to check the number of mapper = expectedNumOfSplits

Throws:

IOException

InterruptedException

ClassNotFoundException

testAutobalanceNumOfSplit

public void testAutobalanceNumOfSplit()
                               throws IOException

Run MR job to test autobalance for setting number of mappers for TIF This does not run real MR job

Throws:

IOException