Package org.apache.hadoop.hbase.master.balancer

Class TestCacheAwareLoadBalancer

java.lang.Object

org.apache.hadoop.hbase.master.balancer.BalancerTestBase

org.apache.hadoop.hbase.master.balancer.TestCacheAwareLoadBalancer

@Tag("org.apache.hadoop.hbase.testclassification.LargeTests")
public class TestCacheAwareLoadBalancer
extends BalancerTestBase

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.master.balancer.BalancerTestBase

BalancerTestBase.MockMapping

Field Summary

Fields

Modifier and Type	Field	Description
private static org.apache.hadoop.hbase.master.balancer.CacheAwareLoadBalancer	loadBalancer
private static final org.slf4j.Logger	LOG
(package private) static List<org.apache.hadoop.hbase.ServerName>	servers
(package private) static List<org.apache.hadoop.hbase.client.TableDescriptor>	tableDescs
(package private) static org.apache.hadoop.hbase.TableName[]	tables

Fields inherited from class org.apache.hadoop.hbase.master.balancer.BalancerTestBase

clusterStateMocks, clusterStateMocksWithNoSlop, clusterStateMocksWithSlop, conf, largeCluster, regionId

Constructor Summary

Constructors

Constructor	Description
TestCacheAwareLoadBalancer()

Method Summary

Modifier and Type	Method	Description
static void	beforeAllTests()
private static List<org.apache.hadoop.hbase.client.TableDescriptor>	constructTableDesc(boolean hasBogusTable)
private static List<org.apache.hadoop.hbase.ServerName>	generateServers(int numServers)
private org.apache.hadoop.hbase.ServerMetrics	mockServerMetricsWithRegionCacheInfo(List<org.apache.hadoop.hbase.client.RegionInfo> regionsOnServer, float currentCacheRatio, List<org.apache.hadoop.hbase.client.RegionInfo> oldRegionCacheInfo, int oldRegionCachedSize, int regionSize)
void	testBalancerNotThrowNPEWhenBalancerPlansIsNull()
void	testLowCacheRatioNoHistoricalCacheRelocatesWhenTargetHasFreeBlockCache()	Regions on the overloaded RS report low block-cache ratio; no RS reports prefetch/historical cache for those regions (so CacheAwareLoadBalancer.CacheAwareCandidateGenerator has no "old server" to prefer).
void	testRegionPlansSortedByCacheRatioOnTarget()
void	testRegionsFullyCachedOnOldAndCurrentServers()
void	testRegionsFullyCachedOnOldServerAndNotCachedOnCurrentServers()
void	testRegionsNotCachedOnOldServerAndCurrentServer()
void	testRegionsPartiallyCachedOnOldServerAndCurrentServer()
void	testRegionsPartiallyCachedOnOldServerAndNotCachedOnCurrentServer()
void	testThrottlingCacheRatioUnknownForRegion()
void	testThrottlingCacheRatioUnknownOnTarget()
void	testThrottlingRegionBelowThreshold()
void	testThrottlingRegionBeyondThreshold()

Methods inherited from class org.apache.hadoop.hbase.master.balancer.BalancerTestBase

assertClusterAsBalanced, assertClusterOverallAsBalanced, assertRegionReplicaPlacement, convertToList, createRegions, createServerMap, mockCluster, mockClusterServers, mockClusterServers, mockClusterServers, mockClusterServersUnsorted, mockClusterServersWithTables, mockUniformClusterServers, printMock, printStats, randomRegions, randomRegions, randomServer, randomServers, reconcile, returnRegions, returnServer, returnServers, uniformRegions, updateLoad

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

loadBalancer

private static org.apache.hadoop.hbase.master.balancer.CacheAwareLoadBalancer loadBalancer

servers

static List<org.apache.hadoop.hbase.ServerName> servers

tableDescs

static List<org.apache.hadoop.hbase.client.TableDescriptor> tableDescs

tables

static org.apache.hadoop.hbase.TableName[] tables

Constructor Details

TestCacheAwareLoadBalancer

public TestCacheAwareLoadBalancer()

Method Details

generateServers

private static List<org.apache.hadoop.hbase.ServerName> generateServers(int numServers)

constructTableDesc

private static List<org.apache.hadoop.hbase.client.TableDescriptor> constructTableDesc(boolean hasBogusTable)

mockServerMetricsWithRegionCacheInfo

private org.apache.hadoop.hbase.ServerMetrics mockServerMetricsWithRegionCacheInfo(List<org.apache.hadoop.hbase.client.RegionInfo> regionsOnServer,
 float currentCacheRatio,
 List<org.apache.hadoop.hbase.client.RegionInfo> oldRegionCacheInfo,
 int oldRegionCachedSize,
 int regionSize)

beforeAllTests

@BeforeAll
public static void beforeAllTests()
                           throws Exception

Throws:

Exception

testRegionsNotCachedOnOldServerAndCurrentServer

@Test
public void testRegionsNotCachedOnOldServerAndCurrentServer()
                                                     throws Exception

Throws:

Exception

testLowCacheRatioNoHistoricalCacheRelocatesWhenTargetHasFreeBlockCache

@Test
public void testLowCacheRatioNoHistoricalCacheRelocatesWhenTargetHasFreeBlockCache()
                                                                            throws Exception

Regions on the overloaded RS report low block-cache ratio; no RS reports prefetch/historical cache for those regions (so CacheAwareLoadBalancer.CacheAwareCandidateGenerator has no "old server" to prefer). Another RS has ample free block cache. The balancer should still emit plans that shed load from the hot RS onto the idle RS with spare cache capacity.

Throws:

Exception

testRegionsPartiallyCachedOnOldServerAndNotCachedOnCurrentServer

@Test
public void testRegionsPartiallyCachedOnOldServerAndNotCachedOnCurrentServer()
                                                                      throws Exception

Throws:

Exception

testThrottlingRegionBeyondThreshold

@Test
public void testThrottlingRegionBeyondThreshold()
                                         throws Exception

Throws:

Exception

testThrottlingRegionBelowThreshold

@Test
public void testThrottlingRegionBelowThreshold()
                                        throws Exception

Throws:

Exception

testThrottlingCacheRatioUnknownOnTarget

@Test
public void testThrottlingCacheRatioUnknownOnTarget()
                                             throws Exception

Throws:

Exception

testThrottlingCacheRatioUnknownForRegion

@Test
public void testThrottlingCacheRatioUnknownForRegion()
                                              throws Exception

Throws:

Exception

testRegionPlansSortedByCacheRatioOnTarget

@Test
public void testRegionPlansSortedByCacheRatioOnTarget()
                                               throws Exception

Throws:

Exception

testRegionsFullyCachedOnOldServerAndNotCachedOnCurrentServers

@Test
public void testRegionsFullyCachedOnOldServerAndNotCachedOnCurrentServers()
                                                                   throws Exception

Throws:

Exception

testRegionsFullyCachedOnOldAndCurrentServers

@Test
public void testRegionsFullyCachedOnOldAndCurrentServers()
                                                  throws Exception

Throws:

Exception

testRegionsPartiallyCachedOnOldServerAndCurrentServer

@Test
public void testRegionsPartiallyCachedOnOldServerAndCurrentServer()
                                                           throws Exception

Throws:

Exception

testBalancerNotThrowNPEWhenBalancerPlansIsNull

@Test
public void testBalancerNotThrowNPEWhenBalancerPlansIsNull()
                                                    throws Exception

Throws:

Exception