Package org.apache.hadoop.hbase.rsgroup

Class TestRegexBasedRSGroupMembership

java.lang.Object

org.apache.hadoop.hbase.client.AbstractTestUpdateConfiguration

org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase

org.apache.hadoop.hbase.rsgroup.TestRegexBasedRSGroupMembership

@Tag("org.apache.hadoop.hbase.testclassification.RSGroupTests") @Tag("org.apache.hadoop.hbase.testclassification.MediumTests")
public class TestRegexBasedRSGroupMembership
extends TestRSGroupsBase

Black-box tests for regex-based automatic RSGroup membership (hbase.rsgroup.regex.<groupname>=<regex>), driven entirely through the public Admin RSGroup API, live RegionServer add/remove against the minicluster, and captured log output -- no reflection or visibility changes against RSGroupInfoManagerImpl.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	TestRegexBasedRSGroupMembership.LogCapturer

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase

TestRSGroupsBase.CPMasterObserver, TestRSGroupsBase.MethodName

Field Summary

Fields

Modifier and Type	Field	Description
private final List<org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread>	fakeRegionServers
private static final org.slf4j.Logger	LOG
private static final String	REGEX_PREFIX
private final Set<String>	regexConfigKeysSet

Fields inherited from class org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase

ADMIN, CLUSTER, GROUP_PREFIX, INIT, MASTER, name, NUM_DEAD_SERVERS, NUM_SLAVES_BASE, OBSERVER, TABLE_PREFIX, tableName, TEST_UTIL, WAIT_TIMEOUT

Constructor Summary

Constructors

Constructor	Description
TestRegexBasedRSGroupMembership()

Method Summary

Modifier and Type	Method	Description
private org.apache.hadoop.hbase.net.Address	addressOf(org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread rst)
void	afterMethod()
void	beforeMethod(org.junit.jupiter.api.TestInfo testInfo)
private static TestRegexBasedRSGroupMembership.LogCapturer	captureRSGroupInfoManagerLog()
private void	clearRegex(String groupName)
private void	killFakeRegionServer(org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread rst)
private Set<org.apache.hadoop.hbase.net.Address>	readStoredServers(String groupName)	Reads the server set of a group straight from its row in the hbase:rsgroup table.
private void	removeRegexGroup(String groupName)	Tears down a regex-governed group.
private void	restartMaster()	Fails over to a freshly started master (the minicluster's masters are threads): a backup is started, the active master is stopped, and the shared MASTER/ADMIN handles are re-pointed.
private void	setRegex(String groupName, String regex)
static void	setUp()
private org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread	startFakeHostnameRS(String hostname)	Starts a genuinely new RegionServer process (thread) in the shared minicluster that reports itself under a caller-chosen hostname, so regex membership rules can target it individually.
private void	stopFakeRegionServer(org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread rst)
static void	tearDown()
void	testAmbiguousMatchFallsBackThenResolvesOnceOverlapFixed()
void	testAutomaticMoveDoesNotFireCoprocessorHooks()
void	testCatchAllRegexMovesEveryServerAndGroupTablesStayAssigned()
void	testDanglingGroupFallsBackThenResolvesOnceGroupCreated()
void	testExplicitMoveFromDefaultToAdminGroupTriggersRandomAssignmentBackToDefault()
void	testFallbackWhenAllRegexMembersCrash()
void	testFullStringMatchSemantics()
void	testInvalidGroupNameKeyIgnoredAndWarns()
void	testInvalidRegexSyntaxIgnoredAndWarns()
void	testListenerDoesNotStickToStaleServer()
void	testMoveContradictingRegexIsRejected()
void	testNewlyJoinedRegexMemberReceivesRegionsOnBalance()
void	testNoRegexConfigBaseline()
void	testRefreshRemovesRegexMatchedServerFromStoredAdminGroup()
void	testRegexConfigDriftDoesNotBlockUnrelatedAdminOps()
void	testRegexCoveringEveryServerEmptiesDefaultAndWarns()
void	testRegexGovernedGroupMembershipIsNotPersisted()
void	testRegexTargetingDefaultGroupIsNoOpAndWarns()
void	testRegexWithQuantifiersMatches()
void	testRestartTriggeredMembershipConfinesTableToGroupServers()
void	testSingleRegexAutoJoinOnLiveAdd()
void	testUngracefulCrashOfRegexMemberReassignsRegionsOnlyToOtherGroupMembers()
void	testUnrelatedAdminOpsSucceedUnderActiveRegex()
private void	triggerListenerCycle()	Server-membership recompute happens synchronously in the serverAdded/ serverRemoved callback -- it is only ever triggered by an actual server add/remove event, a bare config mutation is not enough.

Methods inherited from class org.apache.hadoop.hbase.rsgroup.TestRSGroupsBase

addGroup, deleteGroups, deleteNamespaceIfNecessary, deleteTableIfNecessary, getGroupName, getNameWithoutIndex, getNumServers, getServerName, getTableRegionMap, getTableServerRegionMap, initialize, removeGroup, setUpBeforeMethod, setUpTestBeforeClass, tearDownAfterClass, tearDownAfterMethod, toggleQuotaCheckAndRestartMiniCluster

Methods inherited from class org.apache.hadoop.hbase.client.AbstractTestUpdateConfiguration

addResourceToRegionServerConfiguration, replaceHBaseSiteXML, restoreHBaseSiteXML, setUpConfigurationFiles

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

REGEX_PREFIX

private static final String REGEX_PREFIX

See Also:

• Constant Field Values

fakeRegionServers

private final List<org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread> fakeRegionServers

regexConfigKeysSet

private final Set<String> regexConfigKeysSet

Constructor Details

TestRegexBasedRSGroupMembership

public TestRegexBasedRSGroupMembership()

Method Details

setUp

@BeforeAll
public static void setUp()
                  throws Exception

Throws:

Exception

tearDown

@AfterAll
public static void tearDown()
                     throws Exception

Throws:

Exception

beforeMethod

@BeforeEach
public void beforeMethod(org.junit.jupiter.api.TestInfo testInfo)
                  throws Exception

Throws:

Exception

afterMethod

@AfterEach
public void afterMethod()
                 throws Exception

Throws:

Exception

startFakeHostnameRS

private org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread startFakeHostnameRS(String hostname)
                                                                                    throws Exception

Starts a genuinely new RegionServer process (thread) in the shared minicluster that reports itself under a caller-chosen hostname, so regex membership rules can target it individually. The base cluster's real RS all share one real, resolvable hostname (this machine's address); the RPC services constructor unconditionally resolves whatever hostname is configured (independent of any RPC bind-address override), so the caller-chosen hostname here must itself be a real, resolvable, bindable literal -- "127.0.0.1" and "localhost" both work and are guaranteed distinct from the base cluster's real hostname, which is exactly what every test in this class relies on to get a controllable, non-shared identity.

Throws:

Exception

stopFakeRegionServer

private void stopFakeRegionServer(org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread rst)
                           throws Exception

Throws:

Exception

killFakeRegionServer

private void killFakeRegionServer(org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread rst)
                           throws Exception

Throws:

Exception

triggerListenerCycle

private void triggerListenerCycle()
                           throws Exception

Server-membership recompute happens synchronously in the serverAdded/ serverRemoved callback -- it is only ever triggered by an actual server add/remove event, a bare config mutation is not enough. Forces such an event (add+remove a bystander RS) so a config change just made takes effect without requiring an explicit RSGroup admin RPC. Only used by tests that *want* the automatic reconciliation to run and correct things; the trigger RS's own transient membership doesn't affect assertions elsewhere since those only check for specific other servers' addresses.

Throws:

Exception

readStoredServers

private Set<org.apache.hadoop.hbase.net.Address> readStoredServers(String groupName)
                                                            throws IOException

Reads the server set of a group straight from its row in the hbase:rsgroup table.

Throws:

IOException

restartMaster

private void restartMaster()
                    throws Exception

Fails over to a freshly started master (the minicluster's masters are threads): a backup is started, the active master is stopped, and the shared MASTER/ADMIN handles are re-pointed. The base class keeps the master's embedded RS in a "master" group, whose stored address would go stale, so the master is first moved back to 'default' (whose membership is live-computed); the next cleanup places the new master in the "master" group again.

Throws:

Exception

setRegex

private void setRegex(String groupName,
 String regex)

removeRegexGroup

private void removeRegexGroup(String groupName)
                       throws Exception

Tears down a regex-governed group. Explicit moves that contradict an active regex are rejected, so the regex is first dropped on the master only -- ADMIN's copy still tells VerifyingRSGroupAdmin which servers' membership is regex-driven -- and then the group is emptied and removed.

Throws:

Exception

clearRegex

private void clearRegex(String groupName)

addressOf

private org.apache.hadoop.hbase.net.Address addressOf(org.apache.hadoop.hbase.util.JVMClusterUtil.RegionServerThread rst)

captureRSGroupInfoManagerLog

private static TestRegexBasedRSGroupMembership.LogCapturer captureRSGroupInfoManagerLog()

testNoRegexConfigBaseline

@Test
public void testNoRegexConfigBaseline()
                               throws Exception

Throws:

Exception

testSingleRegexAutoJoinOnLiveAdd

@Test
public void testSingleRegexAutoJoinOnLiveAdd()
                                      throws Exception

Throws:

Exception

testRegexWithQuantifiersMatches

@Test
public void testRegexWithQuantifiersMatches()
                                     throws Exception

Throws:

Exception

testFullStringMatchSemantics

@Test
public void testFullStringMatchSemantics()
                                  throws Exception

Throws:

Exception

testRegexTargetingDefaultGroupIsNoOpAndWarns

@Test
public void testRegexTargetingDefaultGroupIsNoOpAndWarns()
                                                  throws Exception

Throws:

Exception

testInvalidRegexSyntaxIgnoredAndWarns

@Test
public void testInvalidRegexSyntaxIgnoredAndWarns()
                                           throws Exception

Throws:

Exception

testInvalidGroupNameKeyIgnoredAndWarns

@Test
public void testInvalidGroupNameKeyIgnoredAndWarns()
                                            throws Exception

Throws:

Exception

testListenerDoesNotStickToStaleServer

@Test
public void testListenerDoesNotStickToStaleServer()
                                           throws Exception

Throws:

Exception

testDanglingGroupFallsBackThenResolvesOnceGroupCreated

@Test
public void testDanglingGroupFallsBackThenResolvesOnceGroupCreated()
                                                            throws Exception

Throws:

Exception

testAmbiguousMatchFallsBackThenResolvesOnceOverlapFixed

@Test
public void testAmbiguousMatchFallsBackThenResolvesOnceOverlapFixed()
                                                             throws Exception

Throws:

Exception

testRegexCoveringEveryServerEmptiesDefaultAndWarns

@Test
public void testRegexCoveringEveryServerEmptiesDefaultAndWarns()
                                                        throws Exception

Throws:

Exception

testCatchAllRegexMovesEveryServerAndGroupTablesStayAssigned

@Test
public void testCatchAllRegexMovesEveryServerAndGroupTablesStayAssigned()
                                                                 throws Exception

Throws:

Exception

testRegexGovernedGroupMembershipIsNotPersisted

@Test
public void testRegexGovernedGroupMembershipIsNotPersisted()
                                                    throws Exception

Throws:

Exception

testMoveContradictingRegexIsRejected

@Test
public void testMoveContradictingRegexIsRejected()
                                          throws Exception

Throws:

Exception

testUnrelatedAdminOpsSucceedUnderActiveRegex

@Test
public void testUnrelatedAdminOpsSucceedUnderActiveRegex()
                                                  throws Exception

Throws:

Exception

testAutomaticMoveDoesNotFireCoprocessorHooks

@Test
public void testAutomaticMoveDoesNotFireCoprocessorHooks()
                                                  throws Exception

Throws:

Exception

testRefreshRemovesRegexMatchedServerFromStoredAdminGroup

@Test
public void testRefreshRemovesRegexMatchedServerFromStoredAdminGroup()
                                                              throws Exception

Throws:

Exception

testRegexConfigDriftDoesNotBlockUnrelatedAdminOps

@Test
public void testRegexConfigDriftDoesNotBlockUnrelatedAdminOps()
                                                       throws Exception

Throws:

Exception

testNewlyJoinedRegexMemberReceivesRegionsOnBalance

@Test
public void testNewlyJoinedRegexMemberReceivesRegionsOnBalance()
                                                        throws Exception

Throws:

Exception

testRestartTriggeredMembershipConfinesTableToGroupServers

@Test
public void testRestartTriggeredMembershipConfinesTableToGroupServers()
                                                               throws Exception

Throws:

Exception

testUngracefulCrashOfRegexMemberReassignsRegionsOnlyToOtherGroupMembers

@Test
public void testUngracefulCrashOfRegexMemberReassignsRegionsOnlyToOtherGroupMembers()
                                                                             throws Exception

Throws:

Exception

testFallbackWhenAllRegexMembersCrash

@Test
public void testFallbackWhenAllRegexMembersCrash()
                                          throws Exception

Throws:

Exception

testExplicitMoveFromDefaultToAdminGroupTriggersRandomAssignmentBackToDefault

@Test
public void testExplicitMoveFromDefaultToAdminGroupTriggersRandomAssignmentBackToDefault()
                                                                                  throws Exception

Throws:

Exception