org.apache.hadoop.hbase.mapreduce

Class TestTableInputFormat

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestTableInputFormat

public class TestTableInputFormat
extends Object

This tests the TableInputFormat and its recovery semantics

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestTableInputFormat.ExampleDeprecatedTIF
static class	TestTableInputFormat.ExampleJobConfigurableTIF
static class	TestTableInputFormat.ExampleTIF
static class	TestTableInputFormat.ExampleVerifier

Field Summary

Fields

Modifier and Type	Field and Description
static HBaseClassTestRule	CLASS_RULE
private static byte[][]	columns
(package private) static byte[]	FAMILY
private static org.slf4j.Logger	LOG
private static org.apache.hadoop.mapred.MiniMRCluster	mrCluster
private static HBaseTestingUtility	UTIL

Constructor Summary

Constructors

Constructor and Description
TestTableInputFormat()

Method Summary

Modifier and Type	Method and Description
static void	afterClass()
void	before()
static void	beforeClass()
(package private) static boolean	checkResult(org.apache.hadoop.hbase.client.Result r, org.apache.hadoop.hbase.io.ImmutableBytesWritable key, byte[] expectedKey, byte[] expectedValue) Verify that the result and key have expected values.
(package private) static org.apache.hadoop.hbase.client.Table	createDNRIOEScannerTable(byte[] name, int failCnt) Create a table that throws a NotServingRegionException on first scanner next call
(package private) static org.apache.hadoop.hbase.client.Table	createIOEScannerTable(byte[] name, int failCnt) Create a table that IOE's on first scanner next call
static org.apache.hadoop.hbase.client.Table	createTable(byte[] tableName) Setup a table with two rows and values.
static org.apache.hadoop.hbase.client.Table	createTable(byte[] tableName, byte[][] families) Setup a table with two rows and values per column family.
(package private) static void	runTestMapreduce(org.apache.hadoop.hbase.client.Table table) Create table data and run tests on specified htable using the o.a.h.hbase.mapreduce API.
void	testDeprecatedExtensionOfTableInputFormatBase()
void	testExtensionOfTableInputFormatBase() Verify the example we present in javadocs on TableInputFormatBase
(package private) void	testInputFormat(Class<? extends org.apache.hadoop.mapreduce.InputFormat> clazz)
void	testJobConfigurableExtensionOfTableInputFormatBase()
void	testTableRecordReaderMapreduce() Run test assuming no errors using newer mapreduce api
void	testTableRecordReaderScannerFailMapreduce() Run test assuming Scanner IOException failure using newer mapreduce api
void	testTableRecordReaderScannerFailMapreduceTwice() Run test assuming Scanner IOException failure using newer mapreduce api
void	testTableRecordReaderScannerTimeoutMapreduce() Run test assuming NotServingRegionException using newer mapreduce api
void	testTableRecordReaderScannerTimeoutMapreduceTwice() Run test assuming NotServingRegionException using newer mapreduce api

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtility UTIL

mrCluster

private static org.apache.hadoop.mapred.MiniMRCluster mrCluster

FAMILY

static final byte[] FAMILY

columns

private static final byte[][] columns

Constructor Detail

TestTableInputFormat

public TestTableInputFormat()

Method Detail

beforeClass

public static void beforeClass()
                        throws Exception

Throws:

Exception

afterClass

public static void afterClass()
                       throws Exception

Throws:

Exception

before

public void before()
            throws IOException

Throws:

IOException

createTable

public static org.apache.hadoop.hbase.client.Table createTable(byte[] tableName)
                                                        throws IOException

Setup a table with two rows and values.

Parameters:

tableName -

Returns:

A Table instance for the created table.

Throws:

IOException

createTable

public static org.apache.hadoop.hbase.client.Table createTable(byte[] tableName,
                                                               byte[][] families)
                                                        throws IOException

Setup a table with two rows and values per column family.

Parameters:

tableName -

Returns:

A Table instance for the created table.

Throws:

IOException

checkResult

static boolean checkResult(org.apache.hadoop.hbase.client.Result r,
                           org.apache.hadoop.hbase.io.ImmutableBytesWritable key,
                           byte[] expectedKey,
                           byte[] expectedValue)

Verify that the result and key have expected values.

Parameters:

r - single row result

key - the row key

expectedKey - the expected key

expectedValue - the expected value

Returns:

true if the result contains the expected key and value, false otherwise.

runTestMapreduce

static void runTestMapreduce(org.apache.hadoop.hbase.client.Table table)
                      throws IOException,
                             InterruptedException

Create table data and run tests on specified htable using the o.a.h.hbase.mapreduce API.

Parameters:

table -

Throws:

IOException

InterruptedException

createIOEScannerTable

static org.apache.hadoop.hbase.client.Table createIOEScannerTable(byte[] name,
                                                                  int failCnt)
                                                           throws IOException

Create a table that IOE's on first scanner next call

Throws:

IOException

createDNRIOEScannerTable

static org.apache.hadoop.hbase.client.Table createDNRIOEScannerTable(byte[] name,
                                                                     int failCnt)
                                                              throws IOException

Create a table that throws a NotServingRegionException on first scanner next call

Throws:

IOException

testTableRecordReaderMapreduce

public void testTableRecordReaderMapreduce()
                                    throws IOException,
                                           InterruptedException

Run test assuming no errors using newer mapreduce api

Throws:

IOException

InterruptedException

testTableRecordReaderScannerFailMapreduce

public void testTableRecordReaderScannerFailMapreduce()
                                               throws IOException,
                                                      InterruptedException

Run test assuming Scanner IOException failure using newer mapreduce api

Throws:

IOException

InterruptedException

testTableRecordReaderScannerFailMapreduceTwice

public void testTableRecordReaderScannerFailMapreduceTwice()
                                                    throws IOException,
                                                           InterruptedException

Run test assuming Scanner IOException failure using newer mapreduce api

Throws:

IOException

InterruptedException

testTableRecordReaderScannerTimeoutMapreduce

public void testTableRecordReaderScannerTimeoutMapreduce()
                                                  throws IOException,
                                                         InterruptedException

Run test assuming NotServingRegionException using newer mapreduce api

Throws:

InterruptedException

org.apache.hadoop.hbase.DoNotRetryIOException

IOException

testTableRecordReaderScannerTimeoutMapreduceTwice

public void testTableRecordReaderScannerTimeoutMapreduceTwice()
                                                       throws IOException,
                                                              InterruptedException

Run test assuming NotServingRegionException using newer mapreduce api

Throws:

InterruptedException

org.apache.hadoop.hbase.NotServingRegionException

IOException

testExtensionOfTableInputFormatBase

public void testExtensionOfTableInputFormatBase()
                                         throws IOException,
                                                InterruptedException,
                                                ClassNotFoundException

Verify the example we present in javadocs on TableInputFormatBase

Throws:

IOException

InterruptedException

ClassNotFoundException

testJobConfigurableExtensionOfTableInputFormatBase

public void testJobConfigurableExtensionOfTableInputFormatBase()
                                                        throws IOException,
                                                               InterruptedException,
                                                               ClassNotFoundException

Throws:

IOException

InterruptedException

ClassNotFoundException

testDeprecatedExtensionOfTableInputFormatBase

public void testDeprecatedExtensionOfTableInputFormatBase()
                                                   throws IOException,
                                                          InterruptedException,
                                                          ClassNotFoundException

Throws:

IOException

InterruptedException

ClassNotFoundException

testInputFormat

void testInputFormat(Class<? extends org.apache.hadoop.mapreduce.InputFormat> clazz)
              throws IOException,
                     InterruptedException,
                     ClassNotFoundException

Throws:

IOException

InterruptedException

ClassNotFoundException