Package org.apache.hadoop.hbase.master.normalizer

Class RegionNormalizerWorker

java.lang.Object

org.apache.hadoop.hbase.master.normalizer.RegionNormalizerWorker

All Implemented Interfaces:

Runnable, ConfigurationObserver, PropagatingConfigurationObserver

@Private
class RegionNormalizerWorker
extends Object
implements PropagatingConfigurationObserver, Runnable

Consumes normalization request targets (TableNames) off the RegionNormalizerWorkQueue, dispatches them to the RegionNormalizer, and executes the resulting NormalizationPlans.

Field Summary

Fields

Modifier and Type	Field	Description
(package private) static final String	CUMULATIVE_SIZE_LIMIT_MB_KEY
private final AtomicLong	cumulativePlansSizeLimitMb
(package private) static final long	DEFAULT_CUMULATIVE_SIZE_LIMIT_MB
private final boolean	defaultNormalizerTableLevel
static final String	HBASE_TABLE_NORMALIZATION_ENABLED
private static final org.slf4j.Logger	LOG
private final MasterServices	masterServices
private long	mergePlanCount
(package private) static final String	RATE_LIMIT_BYTES_PER_SEC_KEY
private static final long	RATE_UNLIMITED_BYTES
private final org.apache.hbase.thirdparty.com.google.common.util.concurrent.RateLimiter	rateLimiter
private final RegionNormalizer	regionNormalizer
private final long[]	skippedCount
private long	splitPlanCount
private final RegionNormalizerWorkQueue<TableName>	workQueue

Constructor Summary

Constructors

Constructor	Description
RegionNormalizerWorker(org.apache.hadoop.conf.Configuration configuration, MasterServices masterServices, RegionNormalizer regionNormalizer, RegionNormalizerWorkQueue<TableName> workQueue)

Method Summary

Modifier and Type	Method	Description
private List<NormalizationPlan>	calculatePlans(TableName tableName)
void	deregisterChildren(ConfigurationManager manager)	Needs to be called to deregister the children from the manager.
private boolean	extractDefaultNormalizerValue(org.apache.hadoop.conf.Configuration configuration)
(package private) long	getMergePlanCount()
(package private) org.apache.hbase.thirdparty.com.google.common.util.concurrent.RateLimiter	getRateLimiter()	Used in test only.
(package private) long	getSkippedCount(NormalizationPlan.PlanType type)
(package private) long	getSplitPlanCount()
private static long	loadRateLimit(org.apache.hadoop.conf.Configuration configuration)
private static org.apache.hbase.thirdparty.com.google.common.util.concurrent.RateLimiter	loadRateLimiter(org.apache.hadoop.conf.Configuration configuration)
private static long	logLongConfigurationUpdated(String key, long oldValue, long newValue)
void	onConfigurationChange(org.apache.hadoop.conf.Configuration conf)	This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.
(package private) void	planSkipped(NormalizationPlan.PlanType type)
void	registerChildren(ConfigurationManager manager)	Needs to be called to register the children to the manager.
void	run()
private void	submitMergePlan(MergeNormalizationPlan plan)	Interacts with MasterServices in order to execute a plan.
private void	submitPlans(List<NormalizationPlan> plans)
private void	submitSplitPlan(SplitNormalizationPlan plan)	Interacts with MasterServices in order to execute a plan.
private List<NormalizationPlan>	truncateForSize(List<NormalizationPlan> plans)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

HBASE_TABLE_NORMALIZATION_ENABLED

public static final String HBASE_TABLE_NORMALIZATION_ENABLED

See Also:

• Constant Field Values

LOG

private static final org.slf4j.Logger LOG

RATE_LIMIT_BYTES_PER_SEC_KEY

static final String RATE_LIMIT_BYTES_PER_SEC_KEY

See Also:

• Constant Field Values

RATE_UNLIMITED_BYTES

private static final long RATE_UNLIMITED_BYTES

See Also:

• Constant Field Values

CUMULATIVE_SIZE_LIMIT_MB_KEY

static final String CUMULATIVE_SIZE_LIMIT_MB_KEY

See Also:

• Constant Field Values

DEFAULT_CUMULATIVE_SIZE_LIMIT_MB

static final long DEFAULT_CUMULATIVE_SIZE_LIMIT_MB

See Also:

• Constant Field Values

masterServices

private final MasterServices masterServices

regionNormalizer

private final RegionNormalizer regionNormalizer

workQueue

private final RegionNormalizerWorkQueue<TableName> workQueue

rateLimiter

private final org.apache.hbase.thirdparty.com.google.common.util.concurrent.RateLimiter rateLimiter

skippedCount

private final long[] skippedCount

defaultNormalizerTableLevel

private final boolean defaultNormalizerTableLevel

splitPlanCount

private long splitPlanCount

mergePlanCount

private long mergePlanCount

cumulativePlansSizeLimitMb

private final AtomicLong cumulativePlansSizeLimitMb

Constructor Details

RegionNormalizerWorker

RegionNormalizerWorker(org.apache.hadoop.conf.Configuration configuration,
 MasterServices masterServices,
 RegionNormalizer regionNormalizer,
 RegionNormalizerWorkQueue<TableName> workQueue)

Method Details

extractDefaultNormalizerValue

private boolean extractDefaultNormalizerValue(org.apache.hadoop.conf.Configuration configuration)

registerChildren

public void registerChildren(ConfigurationManager manager)

Description copied from interface: PropagatingConfigurationObserver

Needs to be called to register the children to the manager.

Specified by:

registerChildren in interface PropagatingConfigurationObserver

Parameters:

manager - : to register to

deregisterChildren

public void deregisterChildren(ConfigurationManager manager)

Description copied from interface: PropagatingConfigurationObserver

Needs to be called to deregister the children from the manager.

Specified by:

deregisterChildren in interface PropagatingConfigurationObserver

Parameters:

manager - : to deregister from

logLongConfigurationUpdated

private static long logLongConfigurationUpdated(String key,
 long oldValue,
 long newValue)

onConfigurationChange

public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)

Description copied from interface: ConfigurationObserver

This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.

Specified by:

onConfigurationChange in interface ConfigurationObserver

loadRateLimiter

private static org.apache.hbase.thirdparty.com.google.common.util.concurrent.RateLimiter loadRateLimiter(org.apache.hadoop.conf.Configuration configuration)

loadRateLimit

private static long loadRateLimit(org.apache.hadoop.conf.Configuration configuration)

planSkipped

void planSkipped(NormalizationPlan.PlanType type)

See Also:

• RegionNormalizerManager.planSkipped(NormalizationPlan.PlanType)

getSkippedCount

long getSkippedCount(NormalizationPlan.PlanType type)

See Also:

• RegionNormalizerManager.getSkippedCount(NormalizationPlan.PlanType)

getSplitPlanCount

long getSplitPlanCount()

See Also:

• RegionNormalizerManager.getSplitPlanCount()

getMergePlanCount

long getMergePlanCount()

See Also:

• RegionNormalizerManager.getMergePlanCount()

getRateLimiter

org.apache.hbase.thirdparty.com.google.common.util.concurrent.RateLimiter getRateLimiter()

Used in test only. This field is exposed to the test, as opposed to tracking the current configuration value beside the RateLimiter instance and managing synchronization to keep the two in sync.

run

public void run()

Specified by:

run in interface Runnable

calculatePlans

private List<NormalizationPlan> calculatePlans(TableName tableName)

truncateForSize

private List<NormalizationPlan> truncateForSize(List<NormalizationPlan> plans)

submitPlans

private void submitPlans(List<NormalizationPlan> plans)

submitMergePlan

private void submitMergePlan(MergeNormalizationPlan plan)

Interacts with MasterServices in order to execute a plan.

submitSplitPlan

private void submitSplitPlan(SplitNormalizationPlan plan)

Interacts with MasterServices in order to execute a plan.