org.apache.hadoop.hbase.rsgroup

Class RSGroupAdminServer

java.lang.Object

org.apache.hadoop.hbase.rsgroup.RSGroupAdminServer

All Implemented Interfaces:

RSGroupAdmin

@InterfaceAudience.Private
public class RSGroupAdminServer
extends Object
implements RSGroupAdmin

Service to support Region Server Grouping (HBase-6721).

Field Summary

Fields

Modifier and Type	Field and Description
static String	KEEP_ONE_SERVER_IN_DEFAULT_ERROR_MESSAGE
private static org.slf4j.Logger	LOG
private MasterServices	master
private RSGroupInfoManager	rsGroupInfoManager

Constructor Summary

Constructors

Constructor and Description
RSGroupAdminServer(MasterServices master, RSGroupInfoManager rsGroupInfoManager)

Method Summary

Modifier and Type	Method and Description
private void	addRegion(LinkedList<RegionInfo> regions, RegionInfo hri)
void	addRSGroup(String name) Creates a new RegionServer group with the given name.
BalanceResponse	balanceRSGroup(String groupName, BalanceRequest request) Balance regions in the given RegionServer group, running based on the given BalanceRequest.
private void	checkForDeadOrOnlineServers(Set<Address> servers) Check if the set of servers are belong to dead servers list or online servers list.
private void	checkOnlineServersOnly(Set<Address> servers)
private void	checkServersAndTables(Set<Address> servers, Set<TableName> tables, String targetGroupName) Check servers and tables.
private RSGroupInfo	getAndCheckRSGroupInfo(String name) Check passed name.
private Address	getRegionAddress(RegionInfo hri)
private List<RegionInfo>	getRegions(Address server) Returns List of Regions associated with this server.
(package private) Map<TableName,Map<ServerName,List<RegionInfo>>>	getRSGroupAssignmentsByTable(TableStateManager tableStateManager, String groupName) This is an EXPENSIVE clone.
RSGroupInfo	getRSGroupInfo(String groupName) Gets RSGroupInfo for given group name.
RSGroupInfo	getRSGroupInfoOfTable(TableName tableName) Gets RSGroupInfo for the given table's group.
RSGroupInfo	getRSGroupOfServer(Address hostPort) Retrieve the RSGroupInfo a server is affiliated to
List<RSGroupInfo>	listRSGroups() Lists current set of RegionServer groups.
(package private) void	modifyOrMoveTables(Set<TableName> tables, RSGroupInfo targetGroup)
private List<Long>	modifyTables(Set<TableDescriptor> tableDescriptors, String targetGroup)
private void	modifyTablesAndWaitForCompletion(Set<TableDescriptor> tableDescriptors, String targetGroup)
private void	moveServerRegionsFromGroup(Set<Address> movedServers, Set<TableName> movedTables, Set<Address> srcGrpServers, String targetGroupName, String sourceGroupName) Move every region from servers which are currently located on these servers, but should not be located there.
void	moveServers(Set<Address> servers, String targetGroupName) Move given set of servers to the specified target RegionServer group.
void	moveServersAndTables(Set<Address> servers, Set<TableName> tables, String targetGroup) Move given set of servers and tables to the specified target RegionServer group.
private void	moveTableRegionsToGroup(Set<TableName> tables, RSGroupInfo targetGrp) Moves regions of tables which are not on target group servers.
void	moveTables(Set<TableName> tables, String targetGroup) Move given set of tables to the specified target RegionServer group.
void	removeRSGroup(String name) Removes RegionServer group associated with the given name.
void	removeServers(Set<Address> servers) Remove decommissioned servers from rsgroup.
void	renameRSGroup(String oldName, String newName) Rename rsgroup.
private Map<String,RegionState>	rsGroupGetRegionsInTransition(String groupName)
void	updateConfiguration(String groupName) Because the RSGroupAdminClient.updateConfiguration(String) calls Admin.updateConfiguration(ServerName) method, the implementation of this method on the Server side is empty.
void	updateRSGroupConfig(String groupName, Map<String,String> configuration) Update RSGroup configuration
private void	waitForProcedureCompletion(List<Long> procIds)
private boolean	waitForRegionMovement(List<Pair<RegionInfo,Future<byte[]>>> regionMoveFutures, String groupName, int retryCount) Wait for all the region move to complete.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.rsgroup.RSGroupAdmin

balanceRSGroup

Field Detail

LOG

private static final org.slf4j.Logger LOG

KEEP_ONE_SERVER_IN_DEFAULT_ERROR_MESSAGE

public static final String KEEP_ONE_SERVER_IN_DEFAULT_ERROR_MESSAGE

See Also:

Constant Field Values

master

private MasterServices master

rsGroupInfoManager

private final RSGroupInfoManager rsGroupInfoManager

Constructor Detail

RSGroupAdminServer

public RSGroupAdminServer(MasterServices master,
                          RSGroupInfoManager rsGroupInfoManager)

Method Detail

getRSGroupInfo

public RSGroupInfo getRSGroupInfo(String groupName)
                           throws IOException

Description copied from interface: RSGroupAdmin

Gets RSGroupInfo for given group name.

Specified by:

getRSGroupInfo in interface RSGroupAdmin

Throws:

IOException

getRSGroupInfoOfTable

public RSGroupInfo getRSGroupInfoOfTable(TableName tableName)
                                  throws IOException

Description copied from interface: RSGroupAdmin

Gets RSGroupInfo for the given table's group.

Specified by:

getRSGroupInfoOfTable in interface RSGroupAdmin

Throws:

IOException

checkOnlineServersOnly

private void checkOnlineServersOnly(Set<Address> servers)
                             throws ConstraintException

Throws:

ConstraintException

getAndCheckRSGroupInfo

private RSGroupInfo getAndCheckRSGroupInfo(String name)
                                    throws IOException

Check passed name. Fail if nulls or if corresponding RSGroupInfo not found.

Returns:

The RSGroupInfo named name

Throws:

IOException

getRegions

private List<RegionInfo> getRegions(Address server)

Returns List of Regions associated with this server.

addRegion

private void addRegion(LinkedList<RegionInfo> regions,
                       RegionInfo hri)

checkServersAndTables

private void checkServersAndTables(Set<Address> servers,
                                   Set<TableName> tables,
                                   String targetGroupName)
                            throws IOException

Check servers and tables.

Parameters:

servers - servers to move

tables - tables to move

targetGroupName - target group name

Throws:

IOException - if nulls or if servers and tables not belong to the same group

moveServerRegionsFromGroup

private void moveServerRegionsFromGroup(Set<Address> movedServers,
                                        Set<TableName> movedTables,
                                        Set<Address> srcGrpServers,
                                        String targetGroupName,
                                        String sourceGroupName)
                                 throws IOException

Move every region from servers which are currently located on these servers, but should not be located there.

Parameters:

movedServers - the servers that are moved to new group

movedTables - the tables that are moved to new group

srcGrpServers - all servers in the source group, excluding the movedServers

targetGroupName - the target group

sourceGroupName - the source group

Throws:

IOException - if any error while moving regions

getRegionAddress

private Address getRegionAddress(RegionInfo hri)

waitForRegionMovement

private boolean waitForRegionMovement(List<Pair<RegionInfo,Future<byte[]>>> regionMoveFutures,
                                      String groupName,
                                      int retryCount)

Wait for all the region move to complete. Keep waiting for other region movement completion even if some region movement fails.

moveTableRegionsToGroup

private void moveTableRegionsToGroup(Set<TableName> tables,
                                     RSGroupInfo targetGrp)
                              throws IOException

Moves regions of tables which are not on target group servers.

Parameters:

tables - the tables that will move to new group

targetGrp - the target group

Throws:

IOException - if moving the region fails

moveServers

public void moveServers(Set<Address> servers,
                        String targetGroupName)
                 throws IOException

Description copied from interface: RSGroupAdmin

Move given set of servers to the specified target RegionServer group.

Specified by:

moveServers in interface RSGroupAdmin

Throws:

IOException

moveTables

public void moveTables(Set<TableName> tables,
                       String targetGroup)
                throws IOException

Description copied from interface: RSGroupAdmin

Move given set of tables to the specified target RegionServer group. This will unassign all of a table's region so it can be reassigned to the correct group.

Specified by:

moveTables in interface RSGroupAdmin

Throws:

IOException

addRSGroup

public void addRSGroup(String name)
                throws IOException

Description copied from interface: RSGroupAdmin

Creates a new RegionServer group with the given name.

Specified by:

addRSGroup in interface RSGroupAdmin

Throws:

IOException

removeRSGroup

public void removeRSGroup(String name)
                   throws IOException

Description copied from interface: RSGroupAdmin

Removes RegionServer group associated with the given name.

Specified by:

removeRSGroup in interface RSGroupAdmin

Throws:

IOException

balanceRSGroup

public BalanceResponse balanceRSGroup(String groupName,
                                      BalanceRequest request)
                               throws IOException

Description copied from interface: RSGroupAdmin

Balance regions in the given RegionServer group, running based on the given BalanceRequest.

Specified by:

balanceRSGroup in interface RSGroupAdmin

Returns:

boolean Whether balance ran or not

Throws:

IOException

listRSGroups

public List<RSGroupInfo> listRSGroups()
                               throws IOException

Description copied from interface: RSGroupAdmin

Lists current set of RegionServer groups.

Specified by:

listRSGroups in interface RSGroupAdmin

Throws:

IOException

getRSGroupOfServer

public RSGroupInfo getRSGroupOfServer(Address hostPort)
                               throws IOException

Description copied from interface: RSGroupAdmin

Retrieve the RSGroupInfo a server is affiliated to

Specified by:

getRSGroupOfServer in interface RSGroupAdmin

Parameters:

hostPort - HostPort to get RSGroupInfo for

Throws:

IOException

moveServersAndTables

public void moveServersAndTables(Set<Address> servers,
                                 Set<TableName> tables,
                                 String targetGroup)
                          throws IOException

Description copied from interface: RSGroupAdmin

Move given set of servers and tables to the specified target RegionServer group.

Specified by:

moveServersAndTables in interface RSGroupAdmin

Parameters:

servers - set of servers to move

tables - set of tables to move

targetGroup - the target group name

Throws:

IOException - if moving the server and tables fail

removeServers

public void removeServers(Set<Address> servers)
                   throws IOException

Description copied from interface: RSGroupAdmin

Remove decommissioned servers from rsgroup. 1. Sometimes we may find the server aborted due to some hardware failure and we must offline the server for repairing. Or we need to move some servers to join other clusters. So we need to remove these servers from the rsgroup. 2. Dead/recovering/live servers will be disallowed.

Specified by:

removeServers in interface RSGroupAdmin

Parameters:

servers - set of servers to remove

Throws:

IOException

renameRSGroup

public void renameRSGroup(String oldName,
                          String newName)
                   throws IOException

Description copied from interface: RSGroupAdmin

Rename rsgroup.

Specified by:

renameRSGroup in interface RSGroupAdmin

Parameters:

oldName - old rsgroup name

newName - new rsgroup name

Throws:

IOException

updateRSGroupConfig

public void updateRSGroupConfig(String groupName,
                                Map<String,String> configuration)
                         throws IOException

Description copied from interface: RSGroupAdmin

Update RSGroup configuration

Specified by:

updateRSGroupConfig in interface RSGroupAdmin

Parameters:

groupName - the group name

configuration - new configuration of the group name to be set

Throws:

IOException - if a remote or network exception occurs

updateConfiguration

public void updateConfiguration(String groupName)
                         throws IOException

Because the RSGroupAdminClient.updateConfiguration(String) calls Admin.updateConfiguration(ServerName) method, the implementation of this method on the Server side is empty.

Specified by:

updateConfiguration in interface RSGroupAdmin

Parameters:

groupName - the group name

Throws:

IOException - if a remote or network exception occurs

rsGroupGetRegionsInTransition

private Map<String,RegionState> rsGroupGetRegionsInTransition(String groupName)
                                                       throws IOException

Throws:

IOException

getRSGroupAssignmentsByTable

Map<TableName,Map<ServerName,List<RegionInfo>>> getRSGroupAssignmentsByTable(TableStateManager tableStateManager,
                                                                             String groupName)
                                                                      throws IOException

This is an EXPENSIVE clone. Cloning though is the safest thing to do. Can't let out original since it can change and at least the load balancer wants to iterate this exported list. Load balancer should iterate over this list because cloned list will ignore disabled table and split parent region cases. This method is invoked by balanceRSGroup(java.lang.String, org.apache.hadoop.hbase.client.BalanceRequest)

Returns:

A clone of current assignments for this group.

Throws:

IOException

checkForDeadOrOnlineServers

private void checkForDeadOrOnlineServers(Set<Address> servers)
                                  throws ConstraintException

Check if the set of servers are belong to dead servers list or online servers list.

Parameters:

servers - servers to remove

Throws:

ConstraintException

modifyOrMoveTables

void modifyOrMoveTables(Set<TableName> tables,
                        RSGroupInfo targetGroup)
                 throws IOException

Throws:

IOException

modifyTablesAndWaitForCompletion

private void modifyTablesAndWaitForCompletion(Set<TableDescriptor> tableDescriptors,
                                              String targetGroup)
                                       throws IOException

Throws:

IOException

modifyTables

private List<Long> modifyTables(Set<TableDescriptor> tableDescriptors,
                                String targetGroup)
                         throws IOException

Throws:

IOException

waitForProcedureCompletion

private void waitForProcedureCompletion(List<Long> procIds)
                                 throws IOException

Throws:

IOException