Package org.apache.hadoop.hbase.mttr

Class IntegrationTestMTTR

java.lang.Object

org.apache.hadoop.hbase.mttr.IntegrationTestMTTR

public class IntegrationTestMTTR
extends Object

Integration test that should benchmark how fast HBase can recover from failures. This test starts different threads:

1. Load Test Tool.
   This runs so that all RegionServers will have some load and WALs will be full.
2. Scan thread.
   This thread runs a very short scan over and over again recording how log it takes to respond. The longest response is assumed to be the time it took to recover.
3. Put thread.
   This thread just like the scan thread except it does a very small put.
4. Admin thread.
   This thread will continually go to the master to try and get the cluster status. Just like the put and scan threads, the time to respond is recorded.
5. Chaos Monkey thread.
   This thread runs a ChaosMonkey.Action.

The ChaosMonkey actions currently run are:

• Restart the RegionServer holding meta.
• Move the Regions of meta.
• Restart the RegionServer holding the table the scan and put threads are targeting.
• Move the Regions of the table used by the scan and put threads.
• Restart the master.

At the end of the test a log line is output on the INFO level containing the timing data that was collected.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) static class	IntegrationTestMTTR.ActionCallable
(package private) static class	IntegrationTestMTTR.AdminCallable	Callable that will keep going to the master for cluster status.
static class	IntegrationTestMTTR.LoadCallable	Callable used to make sure the cluster has some load on it.
(package private) static class	IntegrationTestMTTR.PutCallable	Callable that will keep putting small amounts of data into a table until the future supplied returns.
(package private) static class	IntegrationTestMTTR.ScanCallable	Callable that will keep scanning for small amounts of data until the supplied future returns.
(package private) static class	IntegrationTestMTTR.TimingCallable	Base class for actions that need to record the time needed to recover from a failure.
private static class	IntegrationTestMTTR.TimingResult	Class to store results of TimingCallable.

Field Summary

Fields

Modifier and Type	Field	Description
private static ExecutorService	executorService	Executor for test threads.
private static final byte[]	FAMILY	Constants.
private static org.apache.hadoop.hbase.TableName	loadTableName
private static org.apache.hadoop.hbase.util.LoadTestTool	loadTool	The load test tool used to create load and make sure that WALs aren't empty.
private static final org.slf4j.Logger	LOG
private static Action	moveMetaRegionsAction
private static Action	moveRegionAction
private static Action	restartMasterAction
private static Action	restartMetaAction
private static Action	restartRSAction	All of the chaos monkey actions used.
private static final long	SLEEP_TIME_DEFAULT
private static final String	SLEEP_TIME_KEY
private static long	sleepTime
private static org.apache.hadoop.hbase.TableName	tableName	Configurable table names.
private static IntegrationTestingUtility	util	Util to get at the cluster.

Constructor Summary

Constructors

Constructor	Description
IntegrationTestMTTR()

Method Summary

Modifier and Type	Method	Description
static void	after()
void	run(Callable<Boolean> monkeyCallable, String testName)
static void	setUp()
private static void	setupActions()
private static void	setupTables()
private static boolean	tablesOnMaster()
void	testKillRsHoldingMeta()
void	testMoveMeta()
void	testMoveRegion()
void	testRestartMaster()
void	testRestartRsHoldingTable()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

FAMILY

private static final byte[] FAMILY

Constants.

LOG

private static final org.slf4j.Logger LOG

sleepTime

private static long sleepTime

SLEEP_TIME_KEY

private static final String SLEEP_TIME_KEY

See Also:

• Constant Field Values

SLEEP_TIME_DEFAULT

private static final long SLEEP_TIME_DEFAULT

See Also:

• Constant Field Values

tableName

private static org.apache.hadoop.hbase.TableName tableName

Configurable table names.

loadTableName

private static org.apache.hadoop.hbase.TableName loadTableName

util

private static IntegrationTestingUtility util

Util to get at the cluster.

executorService

private static ExecutorService executorService

Executor for test threads.

restartRSAction

private static Action restartRSAction

All of the chaos monkey actions used.

restartMetaAction

private static Action restartMetaAction

moveMetaRegionsAction

private static Action moveMetaRegionsAction

moveRegionAction

private static Action moveRegionAction

restartMasterAction

private static Action restartMasterAction

loadTool

private static org.apache.hadoop.hbase.util.LoadTestTool loadTool

The load test tool used to create load and make sure that WALs aren't empty.

Constructor Details

IntegrationTestMTTR

public IntegrationTestMTTR()

Method Details

setUp

public static void setUp()
                  throws Exception

Throws:

Exception

setupActions

private static void setupActions()
                          throws IOException

Throws:

IOException

setupTables

private static void setupTables()
                         throws IOException

Throws:

IOException

after

public static void after()
                  throws IOException

Throws:

IOException

tablesOnMaster

private static boolean tablesOnMaster()

testRestartRsHoldingTable

public void testRestartRsHoldingTable()
                               throws Exception

Throws:

Exception

testKillRsHoldingMeta

public void testKillRsHoldingMeta()
                           throws Exception

Throws:

Exception

testMoveMeta

public void testMoveMeta()
                  throws Exception

Throws:

Exception

testMoveRegion

public void testMoveRegion()
                    throws Exception

Throws:

Exception

testRestartMaster

public void testRestartMaster()
                       throws Exception

Throws:

Exception

run

public void run(Callable<Boolean> monkeyCallable,
 String testName)
         throws Exception

Throws:

Exception