Package org.apache.hadoop.hbase.procedure

Class TestZKProcedureControllers

java.lang.Object

org.apache.hadoop.hbase.procedure.TestZKProcedureControllers

@Tag("org.apache.hadoop.hbase.testclassification.MasterTests") @Tag("org.apache.hadoop.hbase.testclassification.MediumTests")
public class TestZKProcedureControllers
extends Object

Test zookeeper-based, procedure controllers

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private class	TestZKProcedureControllers.StartControllers	Specify how the controllers that should be started (not spy/mockable) for the test.

Field Summary

Fields

Modifier and Type	Field	Description
private static final String	COHORT_NODE_NAME
private static final String	CONTROLLER_NODE_NAME
private static final org.slf4j.Logger	LOG
private final byte[]	memberData
private static final org.mockito.verification.VerificationMode	once
private final TestZKProcedureControllers.StartControllers	startCohortFirst	Check for the possible race condition where a cohort member starts after the controller and therefore could miss a new operation
private final TestZKProcedureControllers.StartControllers	startCoordinatorFirst
private static final HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
TestZKProcedureControllers()

Method Summary

Modifier and Type	Method	Description
static void	cleanupTest()
void	runEarlyPrepareNodes(TestZKProcedureControllers.StartControllers controllers, String operationName, byte[] data, String... cohort)
private void	runMockCommitWithOrchestratedControllers(TestZKProcedureControllers.StartControllers controllers, String operationName, byte[] data, String... cohort)
private org.apache.hadoop.hbase.procedure.ProcedureCoordinator	setupMockCoordinator(String operationName, CountDownLatch prepared, CountDownLatch committed, ArrayList<byte[]> dataFromMembers)
static void	setupTest()
void	testSimpleZKCohortMemberController()	Smaller test to just test the actuation on the cohort member
void	testZKCoordinatorControllerMultipleCohort()
void	testZKCoordinatorControllerWithNoCohort()
void	testZKCoordinatorControllerWithSingleMemberCohort()
private void	verifyCohort(org.apache.hadoop.hbase.procedure.ProcedureMember member, int cohortSize, String operationName, byte[] data)	Verify the cohort controller got called once per expected node to start the operation
private void	verifyCoordinator(String operationName, org.apache.hadoop.hbase.procedure.ProcedureCoordinator coordinator, List<String> expected)	Verify that the coordinator only got called once for each expected node
private void	verifyZooKeeperClean(String operationName, org.apache.hadoop.hbase.zookeeper.ZKWatcher watcher, org.apache.hadoop.hbase.procedure.ZKProcedureUtil controller)	Verify that the prepare, commit and abort nodes for the operation are removed from zookeeper

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtil UTIL

COHORT_NODE_NAME

private static final String COHORT_NODE_NAME

See Also:

• Constant Field Values

CONTROLLER_NODE_NAME

private static final String CONTROLLER_NODE_NAME

See Also:

• Constant Field Values

once

private static final org.mockito.verification.VerificationMode once

memberData

private final byte[] memberData

startCoordinatorFirst

private final TestZKProcedureControllers.StartControllers startCoordinatorFirst

startCohortFirst

private final TestZKProcedureControllers.StartControllers startCohortFirst

Check for the possible race condition where a cohort member starts after the controller and therefore could miss a new operation

Constructor Details

TestZKProcedureControllers

public TestZKProcedureControllers()

Method Details

setupTest

@BeforeAll
public static void setupTest()
                      throws Exception

Throws:

Exception

cleanupTest

@AfterAll
public static void cleanupTest()
                        throws Exception

Throws:

Exception

testSimpleZKCohortMemberController

@Test
public void testSimpleZKCohortMemberController()
                                        throws Exception

Smaller test to just test the actuation on the cohort member

Throws:

Exception - on failure

testZKCoordinatorControllerWithNoCohort

@Test
public void testZKCoordinatorControllerWithNoCohort()
                                             throws Exception

Throws:

Exception

testZKCoordinatorControllerWithSingleMemberCohort

@Test
public void testZKCoordinatorControllerWithSingleMemberCohort()
                                                       throws Exception

Throws:

Exception

testZKCoordinatorControllerMultipleCohort

@Test
public void testZKCoordinatorControllerMultipleCohort()
                                               throws Exception

Throws:

Exception

runMockCommitWithOrchestratedControllers

private void runMockCommitWithOrchestratedControllers(TestZKProcedureControllers.StartControllers controllers,
 String operationName,
 byte[] data,
 String... cohort)
                                               throws Exception

Throws:

Exception

runEarlyPrepareNodes

public void runEarlyPrepareNodes(TestZKProcedureControllers.StartControllers controllers,
 String operationName,
 byte[] data,
 String... cohort)
                          throws Exception

Throws:

Exception

setupMockCoordinator

private org.apache.hadoop.hbase.procedure.ProcedureCoordinator setupMockCoordinator(String operationName,
 CountDownLatch prepared,
 CountDownLatch committed,
 ArrayList<byte[]> dataFromMembers)

Returns:

a mock ProcedureCoordinator that just counts down the prepared and committed latch for called to the respective method

verifyZooKeeperClean

private void verifyZooKeeperClean(String operationName,
 org.apache.hadoop.hbase.zookeeper.ZKWatcher watcher,
 org.apache.hadoop.hbase.procedure.ZKProcedureUtil controller)
                           throws Exception

Verify that the prepare, commit and abort nodes for the operation are removed from zookeeper

Throws:

Exception

verifyCohort

private void verifyCohort(org.apache.hadoop.hbase.procedure.ProcedureMember member,
 int cohortSize,
 String operationName,
 byte[] data)

Verify the cohort controller got called once per expected node to start the operation

verifyCoordinator

private void verifyCoordinator(String operationName,
 org.apache.hadoop.hbase.procedure.ProcedureCoordinator coordinator,
 List<String> expected)

Verify that the coordinator only got called once for each expected node