org.apache.hadoop.hbase.regionserver.throttle

Class PressureAwareCompactionThroughputController

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.regionserver.throttle.PressureAwareThroughputController

org.apache.hadoop.hbase.regionserver.throttle.PressureAwareCompactionThroughputController

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, ThroughputController, Stoppable

@InterfaceAudience.LimitedPrivate(value="Configuration")
public class PressureAwareCompactionThroughputController
extends PressureAwareThroughputController

A throughput controller which uses the follow schema to limit throughput

• If compaction pressure is greater than 1.0, no limitation.
• In off peak hours, use a fixed throughput limitation "hbase.hstore.compaction.throughput.offpeak"
• In normal hours, the max throughput is tuned between "hbase.hstore.compaction.throughput.lower.bound" and "hbase.hstore.compaction.throughput.higher.bound", using the formula "lower + (higer - lower) * compactionPressure", where compactionPressure is in range [0.0, 1.0]

See Also:

HStore.getCompactionPressure()

Field Summary

Fields

Modifier and Type	Field and Description
private static long	DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_HIGHER_BOUND
private static long	DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_LOWER_BOUND
private static long	DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_OFFPEAK
private static int	DEFAULT_HSTORE_COMPACTION_THROUGHPUT_TUNE_PERIOD
static String	HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_HIGHER_BOUND
static String	HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_LOWER_BOUND
static String	HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_OFFPEAK
private static String	HBASE_HSTORE_COMPACTION_THROUGHPUT_CONTROL_CHECK_INTERVAL
static String	HBASE_HSTORE_COMPACTION_THROUGHPUT_TUNE_PERIOD
private static org.slf4j.Logger	LOG
private long	maxThroughputOffpeak

Fields inherited from class org.apache.hadoop.hbase.regionserver.throttle.PressureAwareThroughputController

activeOperations, controlPerSize, maxThroughputLowerBound, maxThroughputUpperBound, offPeakHours, tuningPeriod

Constructor Summary

Constructors

Constructor and Description
PressureAwareCompactionThroughputController()

Method Summary

Modifier and Type	Method and Description
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	setup(RegionServerServices server) Setup controller for the given region server.
protected boolean	skipControl(long deltaSize, long controlSize) Check whether to skip control given delta size and control size
String	toString()
private void	tune(double compactionPressure)

Methods inherited from class org.apache.hadoop.hbase.regionserver.throttle.PressureAwareThroughputController

control, finish, getMaxThroughput, isStopped, setMaxThroughput, start, stop, throughputDesc, throughputDesc

Methods inherited from class org.apache.hadoop.conf.Configured

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_HIGHER_BOUND

public static final String HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_HIGHER_BOUND

See Also:

Constant Field Values

DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_HIGHER_BOUND

private static final long DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_HIGHER_BOUND

See Also:

Constant Field Values

HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_LOWER_BOUND

public static final String HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_LOWER_BOUND

See Also:

Constant Field Values

DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_LOWER_BOUND

private static final long DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_LOWER_BOUND

See Also:

Constant Field Values

HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_OFFPEAK

public static final String HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_OFFPEAK

See Also:

Constant Field Values

DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_OFFPEAK

private static final long DEFAULT_HBASE_HSTORE_COMPACTION_MAX_THROUGHPUT_OFFPEAK

See Also:

Constant Field Values

HBASE_HSTORE_COMPACTION_THROUGHPUT_TUNE_PERIOD

public static final String HBASE_HSTORE_COMPACTION_THROUGHPUT_TUNE_PERIOD

See Also:

Constant Field Values

DEFAULT_HSTORE_COMPACTION_THROUGHPUT_TUNE_PERIOD

private static final int DEFAULT_HSTORE_COMPACTION_THROUGHPUT_TUNE_PERIOD

See Also:

Constant Field Values

HBASE_HSTORE_COMPACTION_THROUGHPUT_CONTROL_CHECK_INTERVAL

private static final String HBASE_HSTORE_COMPACTION_THROUGHPUT_CONTROL_CHECK_INTERVAL

See Also:

Constant Field Values

maxThroughputOffpeak

private long maxThroughputOffpeak

Constructor Detail

PressureAwareCompactionThroughputController

public PressureAwareCompactionThroughputController()

Method Detail

setup

public void setup(RegionServerServices server)

Description copied from interface: ThroughputController

Setup controller for the given region server.

Specified by:

setup in interface ThroughputController

Specified by:

setup in class PressureAwareThroughputController

tune

private void tune(double compactionPressure)

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

toString

public String toString()

Overrides:

toString in class Object

skipControl

protected boolean skipControl(long deltaSize,
                              long controlSize)

Description copied from class: PressureAwareThroughputController

Check whether to skip control given delta size and control size

Specified by:

skipControl in class PressureAwareThroughputController

Parameters:

deltaSize - Delta size since last control

controlSize - Size limit to perform control

Returns:

a boolean indicates whether to skip this control