org.apache.hadoop.hbase.master.balancer

Class FavoredStochasticBalancer

java.lang.Object

org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer

org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer

org.apache.hadoop.hbase.master.balancer.FavoredStochasticBalancer

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, ConfigurationObserver, FavoredNodesPromoter, LoadBalancer, Stoppable

@InterfaceAudience.Private
public class FavoredStochasticBalancer
extends StochasticLoadBalancer
implements FavoredNodesPromoter

An implementation of the LoadBalancer that assigns favored nodes for each region. There is a Primary RegionServer that hosts the region, and then there is Secondary and Tertiary RegionServers. Currently, the favored nodes information is used in creating HDFS files - the Primary RegionServer passes the primary, secondary, tertiary node addresses as hints to the DistributedFileSystem API for creating files on the filesystem. These nodes are treated as hints by the HDFS to place the blocks of the file. This alleviates the problem to do with reading from remote nodes (since we can make the Secondary RegionServer as the new Primary RegionServer) after a region is recovered. This should help provide consistent read latencies for the regions even when their primary region servers die. This provides two StochasticLoadBalancer.CandidateGenerator

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
(package private) class	FavoredStochasticBalancer.FavoredNodeLoadPicker
private class	FavoredStochasticBalancer.FavoredNodeLocalityPicker

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer

StochasticLoadBalancer.CandidateGenerator, StochasticLoadBalancer.CostFromRegionLoadAsRateFunction, StochasticLoadBalancer.CostFromRegionLoadFunction, StochasticLoadBalancer.CostFunction, StochasticLoadBalancer.LoadCandidateGenerator, StochasticLoadBalancer.LocalityBasedCandidateGenerator, StochasticLoadBalancer.LocalityBasedCostFunction, StochasticLoadBalancer.MemStoreSizeCostFunction, StochasticLoadBalancer.MoveCostFunction, StochasticLoadBalancer.PrimaryRegionCountSkewCostFunction, StochasticLoadBalancer.RackLocalityCostFunction, StochasticLoadBalancer.RandomCandidateGenerator, StochasticLoadBalancer.ReadRequestCostFunction, StochasticLoadBalancer.RegionCountSkewCostFunction, StochasticLoadBalancer.RegionReplicaCandidateGenerator, StochasticLoadBalancer.RegionReplicaHostCostFunction, StochasticLoadBalancer.RegionReplicaRackCandidateGenerator, StochasticLoadBalancer.RegionReplicaRackCostFunction, StochasticLoadBalancer.ServerLocalityCostFunction, StochasticLoadBalancer.StoreFileCostFunction, StochasticLoadBalancer.TableSkewCostFunction, StochasticLoadBalancer.WriteRequestCostFunction

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer

BaseLoadBalancer.Cluster

Field Summary

Fields

Modifier and Type	Field and Description
private FavoredNodesManager	fnm
private static org.slf4j.Logger	LOG

Fields inherited from class org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer

KEEP_REGION_LOADS, loads, MAX_RUNNING_TIME_KEY, MAX_STEPS_KEY, MIN_COST_NEED_BALANCE_KEY, RANDOM, RUN_MAX_STEPS_KEY, STEPS_PER_REGION_KEY

Fields inherited from class org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer

clusterStatus, config, IDLE_SERVER_PREDICATOR, maintenanceMode, masterServerName, metricsBalancer, MIN_SERVER_BALANCE, onlySystemTablesOnMaster, overallSlop, rackManager, regionFinder, services, slop, useRegionFinder

Fields inherited from interface org.apache.hadoop.hbase.favored.FavoredNodesPromoter

FAVORED_ALWAYS_ASSIGN_REGIONS

Fields inherited from interface org.apache.hadoop.hbase.master.LoadBalancer

BOGUS_SERVER_NAME, SYSTEM_TABLES_ON_MASTER, TABLES_ON_MASTER

Constructor Summary

Constructors

Constructor and Description
FavoredStochasticBalancer()

Method Summary

Modifier and Type	Method and Description
private void	addRegionToMap(Map<ServerName,List<RegionInfo>> assignmentMapForFavoredNodes, RegionInfo region, ServerName host)
private void	assignRegionToAvailableFavoredNode(Map<ServerName,List<RegionInfo>> assignmentMapForFavoredNodes, RegionInfo region, ServerName primaryHost, ServerName secondaryHost, ServerName tertiaryHost)
List<RegionPlan>	balanceCluster(Map<ServerName,List<RegionInfo>> clusterState) Given the cluster state this will try and approach an optimal balance.
protected void	configureGenerators()
void	generateFavoredNodesForDaughter(List<ServerName> servers, RegionInfo parent, RegionInfo regionA, RegionInfo regionB)
void	generateFavoredNodesForMergedRegion(RegionInfo merged, RegionInfo[] mergeParents)
private Map<ServerName,List<RegionInfo>>	generateFNForRegionsWithoutFN(FavoredNodeAssignmentHelper helper, List<RegionInfo> regions)
List<ServerName>	getFavoredNodes(RegionInfo regionInfo)
private Set<ServerName>	getInheritedFNForDaughter(FavoredNodeAssignmentHelper helper, List<ServerName> parentFavoredNodes, FavoredNodesPlan.Position primary, FavoredNodesPlan.Position secondary)
private List<ServerName>	getOnlineFavoredNodes(List<ServerName> onlineServers, List<ServerName> serversWithoutStartCodes)
private ServerName	getServerFromFavoredNode(List<ServerName> servers, ServerName fn)
void	initialize() Initialize the load balancer.
private void	mergeAssignmentMaps(Map<ServerName,List<RegionInfo>> assignmentMap, Map<ServerName,List<RegionInfo>> otherAssignments)
ServerName	randomAssignment(RegionInfo regionInfo, List<ServerName> servers) Used to assign a single region to a random server.
Map<ServerName,List<RegionInfo>>	retainAssignment(Map<RegionInfo,ServerName> regions, List<ServerName> servers) Generates a bulk assignment startup plan, attempting to reuse the existing assignment information from META, but adjusting for the specified list of available/online servers available for assignment.
Map<ServerName,List<RegionInfo>>	roundRobinAssignment(List<RegionInfo> regions, List<ServerName> servers) Generates a bulk assignment plan to be used on cluster startup using a simple round-robin assignment.
private Pair<Map<ServerName,List<RegionInfo>>,List<RegionInfo>>	segregateRegionsAndAssignRegionsWithFavoredNodes(Collection<RegionInfo> regions, List<ServerName> onlineServers)
void	setMasterServices(MasterServices masterServices) Set the master service.
private void	updateFavoredNodesForRegion(RegionInfo regionInfo, List<ServerName> newFavoredNodes)

Methods inherited from class org.apache.hadoop.hbase.master.balancer.StochasticLoadBalancer

areSomeRegionReplicasColocated, balanceCluster, composeAttributeName, computeCost, getCostFunctionNames, initCosts, needsBalance, nextAction, onConfigurationChange, setCandidateGenerators, setClusterMetrics, setConf, setSlop, updateCostsWithAction, updateMetricsSize

Methods inherited from class org.apache.hadoop.hbase.master.balancer.BaseLoadBalancer

assignMasterSystemRegions, balanceMasterRegions, createCluster, getConf, getRegionAssignmentsByServer, isStopped, postMasterStartupInitialize, regionOffline, regionOnline, setClusterLoad, setRackManager, shouldBeOnMaster, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.master.LoadBalancer

isMasterCanHostUserRegions, isSystemTablesOnlyOnMaster, isTablesOnMaster

Field Detail

LOG

private static final org.slf4j.Logger LOG

fnm

private FavoredNodesManager fnm

Constructor Detail

FavoredStochasticBalancer

public FavoredStochasticBalancer()

Method Detail

initialize

public void initialize()
                throws HBaseIOException

Description copied from interface: LoadBalancer

Initialize the load balancer. Must be called after setters.

Specified by:

initialize in interface LoadBalancer

Overrides:

initialize in class BaseLoadBalancer

Throws:

HBaseIOException

configureGenerators

protected void configureGenerators()

setMasterServices

public void setMasterServices(MasterServices masterServices)

Description copied from interface: LoadBalancer

Set the master service.

Specified by:

setMasterServices in interface LoadBalancer

Overrides:

setMasterServices in class StochasticLoadBalancer

roundRobinAssignment

public Map<ServerName,List<RegionInfo>> roundRobinAssignment(List<RegionInfo> regions,
                                                             List<ServerName> servers)
                                                      throws HBaseIOException

Description copied from class: BaseLoadBalancer

Generates a bulk assignment plan to be used on cluster startup using a simple round-robin assignment.

Takes a list of all the regions and all the servers in the cluster and returns a map of each server to the regions that it should be assigned.

Currently implemented as a round-robin assignment. Same invariant as load balancing, all servers holding floor(avg) or ceiling(avg). TODO: Use block locations from HDFS to place regions with their blocks

Specified by:

roundRobinAssignment in interface LoadBalancer

Overrides:

roundRobinAssignment in class BaseLoadBalancer

Parameters:

regions - all regions

servers - all servers

Returns:

map of server to the regions it should take, or null if no assignment is possible (ie. no regions or no servers)

Throws:

HBaseIOException

mergeAssignmentMaps

private void mergeAssignmentMaps(Map<ServerName,List<RegionInfo>> assignmentMap,
                                 Map<ServerName,List<RegionInfo>> otherAssignments)

generateFNForRegionsWithoutFN

private Map<ServerName,List<RegionInfo>> generateFNForRegionsWithoutFN(FavoredNodeAssignmentHelper helper,
                                                                       List<RegionInfo> regions)
                                                                throws IOException

Throws:

IOException

segregateRegionsAndAssignRegionsWithFavoredNodes

private Pair<Map<ServerName,List<RegionInfo>>,List<RegionInfo>> segregateRegionsAndAssignRegionsWithFavoredNodes(Collection<RegionInfo> regions,
                                                                                                                 List<ServerName> onlineServers)
                                                                                                          throws HBaseIOException

Throws:

HBaseIOException

addRegionToMap

private void addRegionToMap(Map<ServerName,List<RegionInfo>> assignmentMapForFavoredNodes,
                            RegionInfo region,
                            ServerName host)

getServerFromFavoredNode

private ServerName getServerFromFavoredNode(List<ServerName> servers,
                                            ServerName fn)

assignRegionToAvailableFavoredNode

private void assignRegionToAvailableFavoredNode(Map<ServerName,List<RegionInfo>> assignmentMapForFavoredNodes,
                                                RegionInfo region,
                                                ServerName primaryHost,
                                                ServerName secondaryHost,
                                                ServerName tertiaryHost)

randomAssignment

public ServerName randomAssignment(RegionInfo regionInfo,
                                   List<ServerName> servers)
                            throws HBaseIOException

Description copied from class: BaseLoadBalancer

Used to assign a single region to a random server.

Specified by:

randomAssignment in interface LoadBalancer

Overrides:

randomAssignment in class BaseLoadBalancer

Parameters:

regionInfo - Region for which this selection is being done.

Returns:

Servername

Throws:

HBaseIOException

updateFavoredNodesForRegion

private void updateFavoredNodesForRegion(RegionInfo regionInfo,
                                         List<ServerName> newFavoredNodes)
                                  throws IOException

Throws:

IOException

retainAssignment

public Map<ServerName,List<RegionInfo>> retainAssignment(Map<RegionInfo,ServerName> regions,
                                                         List<ServerName> servers)
                                                  throws HBaseIOException

Description copied from class: BaseLoadBalancer

Generates a bulk assignment startup plan, attempting to reuse the existing assignment information from META, but adjusting for the specified list of available/online servers available for assignment.

Takes a map of all regions to their existing assignment from META. Also takes a list of online servers for regions to be assigned to. Attempts to retain all assignment, so in some instances initial assignment will not be completely balanced.

Any leftover regions without an existing server to be assigned to will be assigned randomly to available servers.

Specified by:

retainAssignment in interface LoadBalancer

Overrides:

retainAssignment in class BaseLoadBalancer

Parameters:

regions - regions and existing assignment from meta

servers - available servers

Returns:

map of servers and regions to be assigned to them

Throws:

HBaseIOException

getOnlineFavoredNodes

private List<ServerName> getOnlineFavoredNodes(List<ServerName> onlineServers,
                                               List<ServerName> serversWithoutStartCodes)

getFavoredNodes

public List<ServerName> getFavoredNodes(RegionInfo regionInfo)

generateFavoredNodesForDaughter

public void generateFavoredNodesForDaughter(List<ServerName> servers,
                                            RegionInfo parent,
                                            RegionInfo regionA,
                                            RegionInfo regionB)
                                     throws IOException

Specified by:

generateFavoredNodesForDaughter in interface FavoredNodesPromoter

Throws:

IOException

getInheritedFNForDaughter

private Set<ServerName> getInheritedFNForDaughter(FavoredNodeAssignmentHelper helper,
                                                  List<ServerName> parentFavoredNodes,
                                                  FavoredNodesPlan.Position primary,
                                                  FavoredNodesPlan.Position secondary)
                                           throws IOException

Throws:

IOException

generateFavoredNodesForMergedRegion

public void generateFavoredNodesForMergedRegion(RegionInfo merged,
                                                RegionInfo[] mergeParents)
                                         throws IOException

Specified by:

generateFavoredNodesForMergedRegion in interface FavoredNodesPromoter

Throws:

IOException

balanceCluster

public List<RegionPlan> balanceCluster(Map<ServerName,List<RegionInfo>> clusterState)

Description copied from class: StochasticLoadBalancer

Given the cluster state this will try and approach an optimal balance. This should always approach the optimal state given enough steps.

Specified by:

balanceCluster in interface LoadBalancer

Overrides:

balanceCluster in class StochasticLoadBalancer

Returns:

List of plans