Package org.apache.hadoop.hbase.mapreduce

Class TestWALPlayer

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestWALPlayer

public class TestWALPlayer
extends Object

Basic test for the WALPlayer M/R tool

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static interface	TestWALPlayer.TestMethod

Field Summary

Fields

Modifier and Type	Field	Description
static final HBaseClassTestRule	CLASS_RULE
private static SingleProcessHBaseCluster	cluster
private static org.apache.hadoop.conf.Configuration	conf
private static org.apache.hadoop.fs.FileSystem	fs
private static org.apache.hadoop.fs.FileSystem	logFs
org.junit.rules.TestName	name
private static org.apache.hadoop.fs.Path	rootDir
private static final HBaseTestingUtil	TEST_UTIL
private static org.apache.hadoop.fs.Path	walRootDir

Constructor Summary

Constructors

Constructor	Description
TestWALPlayer()

Method Summary

Modifier and Type	Method	Description
static void	afterClass()
static void	beforeClass()
private static void	runWithDiskBasedSortingDisabledAndEnabled(TestWALPlayer.TestMethod method)
void	testMainMethod()	Test main method
void	testPlayingRecoveredEdit()	Test that WALPlayer can replay recovered.edits files.
void	testWALKeyValueMapper()	Test WALKeyValueMapper setup and map
private void	testWALKeyValueMapper(String tableConfigKey)
void	testWALKeyValueMapperWithDeprecatedConfig()
void	testWALPlayer()	Simple end-to-end test
void	testWALPlayerBulkLoadWithOverriddenTimestamps()	Tests that when you write multiple cells with the same timestamp they are properly sorted by their sequenceId in WALPlayer/CellSortReducer so that the correct one wins when querying from the resulting bulkloaded HFiles.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

TEST_UTIL

private static final HBaseTestingUtil TEST_UTIL

cluster

private static SingleProcessHBaseCluster cluster

rootDir

private static org.apache.hadoop.fs.Path rootDir

walRootDir

private static org.apache.hadoop.fs.Path walRootDir

fs

private static org.apache.hadoop.fs.FileSystem fs

logFs

private static org.apache.hadoop.fs.FileSystem logFs

conf

private static org.apache.hadoop.conf.Configuration conf

name

public org.junit.rules.TestName name

Constructor Details

TestWALPlayer

public TestWALPlayer()

Method Details

beforeClass

public static void beforeClass()
                        throws Exception

Throws:

Exception

afterClass

public static void afterClass()
                       throws Exception

Throws:

Exception

testPlayingRecoveredEdit

public void testPlayingRecoveredEdit()
                              throws Exception

Test that WALPlayer can replay recovered.edits files.

Throws:

Exception

testWALPlayerBulkLoadWithOverriddenTimestamps

public void testWALPlayerBulkLoadWithOverriddenTimestamps()
                                                   throws Exception

Tests that when you write multiple cells with the same timestamp they are properly sorted by their sequenceId in WALPlayer/CellSortReducer so that the correct one wins when querying from the resulting bulkloaded HFiles. See HBASE-27649

Throws:

Exception

testWALPlayer

public void testWALPlayer()
                   throws Exception

Simple end-to-end test

Throws:

Exception

testWALKeyValueMapper

public void testWALKeyValueMapper()
                           throws Exception

Test WALKeyValueMapper setup and map

Throws:

Exception

testWALKeyValueMapperWithDeprecatedConfig

public void testWALKeyValueMapperWithDeprecatedConfig()
                                               throws Exception

Throws:

Exception

testWALKeyValueMapper

private void testWALKeyValueMapper(String tableConfigKey)
                            throws Exception

Throws:

Exception

testMainMethod

public void testMainMethod()
                    throws Exception

Test main method

Throws:

Exception

runWithDiskBasedSortingDisabledAndEnabled

private static void runWithDiskBasedSortingDisabledAndEnabled(TestWALPlayer.TestMethod method)
                                                       throws Exception

Throws:

Exception