Package org.apache.hadoop.hbase.io.asyncfs.monitor

Class ExcludeDatanodeManager

java.lang.Object

org.apache.hadoop.hbase.io.asyncfs.monitor.ExcludeDatanodeManager

All Implemented Interfaces:

ConfigurationObserver

@Private
public class ExcludeDatanodeManager
extends Object
implements ConfigurationObserver

The class to manage the excluded datanodes of the WALs on the regionserver.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	ExcludeDatanodeManager.ExcludeCause	Enumerates the reason of excluding a Datanode from WAL Write due to specific cause.

Field Summary

Fields

Modifier and Type	Field	Description
private final org.apache.hadoop.conf.Configuration	conf
static final int	DEFAULT_WAL_EXCLUDE_DATANODE_TTL
static final int	DEFAULT_WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT
private org.apache.hbase.thirdparty.com.google.common.cache.Cache<org.apache.hadoop.hdfs.protocol.DatanodeInfo,Pair<String,Long>>	excludeDNsCache
private static final org.slf4j.Logger	LOG
private final int	maxExcludeDNCount
private final Map<String,StreamSlowMonitor>	streamSlowMonitors
static final String	WAL_EXCLUDE_DATANODE_TTL_KEY	Configure for the TTL time of the datanodes excluded
static final String	WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT_KEY	Configure for the max count the excluded datanodes.

Constructor Summary

Constructors

Constructor	Description
ExcludeDatanodeManager(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method	Description
Map<org.apache.hadoop.hdfs.protocol.DatanodeInfo,Pair<String,Long>>	getExcludeDNs()
StreamSlowMonitor	getStreamSlowMonitor(String name)
void	onConfigurationChange(org.apache.hadoop.conf.Configuration conf)	This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.
boolean	tryAddExcludeDN(org.apache.hadoop.hdfs.protocol.DatanodeInfo datanodeInfo, String cause)	Try to add a datanode to the regionserver excluding cache

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT_KEY

public static final String WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT_KEY

Configure for the max count the excluded datanodes.

See Also:

• Constant Field Values

DEFAULT_WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT

public static final int DEFAULT_WAL_MAX_EXCLUDE_SLOW_DATANODE_COUNT

See Also:

• Constant Field Values

WAL_EXCLUDE_DATANODE_TTL_KEY

public static final String WAL_EXCLUDE_DATANODE_TTL_KEY

Configure for the TTL time of the datanodes excluded

See Also:

• Constant Field Values

DEFAULT_WAL_EXCLUDE_DATANODE_TTL

public static final int DEFAULT_WAL_EXCLUDE_DATANODE_TTL

See Also:

• Constant Field Values

excludeDNsCache

private volatile org.apache.hbase.thirdparty.com.google.common.cache.Cache<org.apache.hadoop.hdfs.protocol.DatanodeInfo,Pair<String,Long>> excludeDNsCache

maxExcludeDNCount

private final int maxExcludeDNCount

conf

private final org.apache.hadoop.conf.Configuration conf

streamSlowMonitors

private final Map<String,StreamSlowMonitor> streamSlowMonitors

Constructor Details

ExcludeDatanodeManager

public ExcludeDatanodeManager(org.apache.hadoop.conf.Configuration conf)

Method Details

tryAddExcludeDN

public boolean tryAddExcludeDN(org.apache.hadoop.hdfs.protocol.DatanodeInfo datanodeInfo,
 String cause)

Try to add a datanode to the regionserver excluding cache

Parameters:

datanodeInfo - the datanode to be added to the excluded cache

cause - the cause that the datanode is hope to be excluded

Returns:

True if the datanode is added to the regionserver excluding cache, false otherwise

getStreamSlowMonitor

public StreamSlowMonitor getStreamSlowMonitor(String name)

getExcludeDNs

public Map<org.apache.hadoop.hdfs.protocol.DatanodeInfo,Pair<String,Long>> getExcludeDNs()

onConfigurationChange

public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)

Description copied from interface: ConfigurationObserver

This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.

Specified by:

onConfigurationChange in interface ConfigurationObserver