Package org.apache.hadoop.hbase.mapred

Class TestTableInputFormat

java.lang.Object

org.apache.hadoop.hbase.mapred.TestTableInputFormat

@Tag("org.apache.hadoop.hbase.testclassification.MapReduceTests") @Tag("org.apache.hadoop.hbase.testclassification.LargeTests")
public class TestTableInputFormat
extends Object

This tests the TableInputFormat and its recovery semantics

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	TestTableInputFormat.ExampleDeprecatedTIF
static class	TestTableInputFormat.ExampleJobConfigurableTIF
static class	TestTableInputFormat.ExampleTIF
static class	TestTableInputFormat.ExampleVerifier

Field Summary

Fields

Modifier and Type	Field	Description
private static final byte[][]	columns
(package private) static final byte[]	FAMILY
private static final org.slf4j.Logger	LOG
private static final HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
TestTableInputFormat()

Method Summary

Modifier and Type	Method	Description
static void	afterClass()
void	before()
static void	beforeClass()
(package private) static boolean	checkResult(org.apache.hadoop.hbase.client.Result r, org.apache.hadoop.hbase.io.ImmutableBytesWritable key, byte[] expectedKey, byte[] expectedValue)	Verify that the result and key have expected values.
(package private) static org.apache.hadoop.hbase.client.Table	createDNRIOEScannerTable(byte[] name, int failCnt)	Create a table that throws a DoNoRetryIOException on first scanner next call
(package private) static org.apache.hadoop.hbase.client.Table	createIOEScannerTable(byte[] name, int failCnt)	Create a table that IOE's on first scanner next call
static org.apache.hadoop.hbase.client.Table	createTable(byte[] tableName)	Setup a table with two rows and values.
static org.apache.hadoop.hbase.client.Table	createTable(byte[] tableName, byte[][] families)	Setup a table with two rows and values per column family.
(package private) static void	runTestMapred(org.apache.hadoop.hbase.client.Table table)	Create table data and run tests on specified htable using the o.a.h.hbase.mapred API.
void	testDeprecatedExtensionOfTableInputFormatBase()
void	testExtensionOfTableInputFormatBase()	Verify the example we present in javadocs on TableInputFormatBase
(package private) void	testInputFormat(Class<? extends org.apache.hadoop.mapred.InputFormat> clazz)
void	testJobConfigurableExtensionOfTableInputFormatBase()
void	testTableRecordReader()	Run test assuming no errors using mapred api.
void	testTableRecordReaderScannerFail()	Run test assuming Scanner IOException failure using mapred api,
void	testTableRecordReaderScannerFailTwice()	Run test assuming Scanner IOException failure using mapred api,
void	testTableRecordReaderScannerTimeout()	Run test assuming NotServingRegionException using mapred api.
void	testTableRecordReaderScannerTimeoutTwice()	Run test assuming NotServingRegionException using mapred api.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtil UTIL

FAMILY

static final byte[] FAMILY

columns

private static final byte[][] columns

Constructor Details

TestTableInputFormat

public TestTableInputFormat()

Method Details

beforeClass

@BeforeAll
public static void beforeClass()
                        throws Exception

Throws:

Exception

afterClass

@AfterAll
public static void afterClass()
                       throws Exception

Throws:

Exception

before

@BeforeEach
public void before()
            throws IOException

Throws:

IOException

createTable

public static org.apache.hadoop.hbase.client.Table createTable(byte[] tableName)
                                                        throws IOException

Setup a table with two rows and values.

Parameters:

tableName - the name of the table to create

Returns:

A Table instance for the created table.

Throws:

IOException

createTable

public static org.apache.hadoop.hbase.client.Table createTable(byte[] tableName,
 byte[][] families)
                                                        throws IOException

Setup a table with two rows and values per column family.

Returns:

A Table instance for the created table.

Throws:

IOException

checkResult

static boolean checkResult(org.apache.hadoop.hbase.client.Result r,
 org.apache.hadoop.hbase.io.ImmutableBytesWritable key,
 byte[] expectedKey,
 byte[] expectedValue)

Verify that the result and key have expected values.

Parameters:

r - single row result

key - the row key

expectedKey - the expected key

expectedValue - the expected value

Returns:

true if the result contains the expected key and value, false otherwise.

runTestMapred

static void runTestMapred(org.apache.hadoop.hbase.client.Table table)
                   throws IOException

Create table data and run tests on specified htable using the o.a.h.hbase.mapred API.

Throws:

IOException

createIOEScannerTable

static org.apache.hadoop.hbase.client.Table createIOEScannerTable(byte[] name,
 int failCnt)
                                                           throws IOException

Create a table that IOE's on first scanner next call

Throws:

IOException

createDNRIOEScannerTable

static org.apache.hadoop.hbase.client.Table createDNRIOEScannerTable(byte[] name,
 int failCnt)
                                                              throws IOException

Create a table that throws a DoNoRetryIOException on first scanner next call

Throws:

IOException

testTableRecordReader

@Test
public void testTableRecordReader()
                           throws IOException

Run test assuming no errors using mapred api.

Throws:

IOException

testTableRecordReaderScannerFail

@Test
public void testTableRecordReaderScannerFail()
                                      throws IOException

Run test assuming Scanner IOException failure using mapred api,

Throws:

IOException

testTableRecordReaderScannerFailTwice

@Test
public void testTableRecordReaderScannerFailTwice()
                                           throws IOException

Run test assuming Scanner IOException failure using mapred api,

Throws:

IOException

testTableRecordReaderScannerTimeout

@Test
public void testTableRecordReaderScannerTimeout()
                                         throws IOException

Run test assuming NotServingRegionException using mapred api.

Throws:

org.apache.hadoop.hbase.DoNotRetryIOException

IOException

testTableRecordReaderScannerTimeoutTwice

@Test
public void testTableRecordReaderScannerTimeoutTwice()
                                              throws IOException

Run test assuming NotServingRegionException using mapred api.

Throws:

org.apache.hadoop.hbase.DoNotRetryIOException

IOException

testExtensionOfTableInputFormatBase

@Test
public void testExtensionOfTableInputFormatBase()
                                         throws IOException

Verify the example we present in javadocs on TableInputFormatBase

Throws:

IOException

testDeprecatedExtensionOfTableInputFormatBase

@Test
public void testDeprecatedExtensionOfTableInputFormatBase()
                                                   throws IOException

Throws:

IOException

testJobConfigurableExtensionOfTableInputFormatBase

@Test
public void testJobConfigurableExtensionOfTableInputFormatBase()
                                                        throws IOException

Throws:

IOException

testInputFormat

void testInputFormat(Class<? extends org.apache.hadoop.mapred.InputFormat> clazz)
              throws IOException

Throws:

IOException