org.apache.hadoop.hbase.regionserver.throttle

Class PressureAwareFlushThroughputController

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.regionserver.throttle.PressureAwareThroughputController

org.apache.hadoop.hbase.regionserver.throttle.PressureAwareFlushThroughputController

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, ThroughputController, Stoppable

@InterfaceAudience.LimitedPrivate(value="Configuration")
public class PressureAwareFlushThroughputController
extends PressureAwareThroughputController

A throughput controller which uses the follow schema to limit throughput

• If flush pressure is greater than or equal to 1.0, no limitation.
• In normal case, the max throughput is tuned between "hbase.hstore.flush.throughput.lower.bound" and "hbase.hstore.flush.throughput.upper.bound", using the formula "lower + (upper - lower) * flushPressure", where flushPressure is in range [0.0, 1.0)

See Also:

HRegionServer.getFlushPressure()

Field Summary

Fields

Modifier and Type	Field and Description
private static long	DEFAULT_HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_LOWER_BOUND
private static long	DEFAULT_HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_UPPER_BOUND
private static long	DEFAULT_HBASE_HSTORE_FLUSH_THROUGHPUT_CONTROL_CHECK_INTERVAL
private static int	DEFAULT_HSTORE_FLUSH_THROUGHPUT_TUNE_PERIOD
static String	HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_LOWER_BOUND
static String	HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_UPPER_BOUND
static String	HBASE_HSTORE_FLUSH_THROUGHPUT_CONTROL_CHECK_INTERVAL
static String	HBASE_HSTORE_FLUSH_THROUGHPUT_TUNE_PERIOD
private static org.slf4j.Logger	LOG

Fields inherited from class org.apache.hadoop.hbase.regionserver.throttle.PressureAwareThroughputController

activeOperations, controlPerSize, maxThroughputLowerBound, maxThroughputUpperBound, offPeakHours, tuningPeriod

Constructor Summary

Constructors

Constructor and Description
PressureAwareFlushThroughputController()

Method Summary

Modifier and Type	Method and Description
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	setup(RegionServerServices server) Setup controller for the given region server.
protected boolean	skipControl(long deltaSize, long controlSize) Check whether to skip control given delta size and control size
String	toString()
private void	tune(double flushPressure)

Methods inherited from class org.apache.hadoop.hbase.regionserver.throttle.PressureAwareThroughputController

control, finish, getMaxThroughput, isStopped, setMaxThroughput, start, stop, throughputDesc, throughputDesc

Methods inherited from class org.apache.hadoop.conf.Configured

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_UPPER_BOUND

public static final String HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_UPPER_BOUND

See Also:

Constant Field Values

DEFAULT_HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_UPPER_BOUND

private static final long DEFAULT_HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_UPPER_BOUND

See Also:

Constant Field Values

HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_LOWER_BOUND

public static final String HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_LOWER_BOUND

See Also:

Constant Field Values

DEFAULT_HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_LOWER_BOUND

private static final long DEFAULT_HBASE_HSTORE_FLUSH_MAX_THROUGHPUT_LOWER_BOUND

See Also:

Constant Field Values

HBASE_HSTORE_FLUSH_THROUGHPUT_TUNE_PERIOD

public static final String HBASE_HSTORE_FLUSH_THROUGHPUT_TUNE_PERIOD

See Also:

Constant Field Values

DEFAULT_HSTORE_FLUSH_THROUGHPUT_TUNE_PERIOD

private static final int DEFAULT_HSTORE_FLUSH_THROUGHPUT_TUNE_PERIOD

See Also:

Constant Field Values

HBASE_HSTORE_FLUSH_THROUGHPUT_CONTROL_CHECK_INTERVAL

public static final String HBASE_HSTORE_FLUSH_THROUGHPUT_CONTROL_CHECK_INTERVAL

See Also:

Constant Field Values

DEFAULT_HBASE_HSTORE_FLUSH_THROUGHPUT_CONTROL_CHECK_INTERVAL

private static final long DEFAULT_HBASE_HSTORE_FLUSH_THROUGHPUT_CONTROL_CHECK_INTERVAL

See Also:

Constant Field Values

Constructor Detail

PressureAwareFlushThroughputController

public PressureAwareFlushThroughputController()

Method Detail

setup

public void setup(RegionServerServices server)

Description copied from interface: ThroughputController

Setup controller for the given region server.

Specified by:

setup in interface ThroughputController

Specified by:

setup in class PressureAwareThroughputController

tune

private void tune(double flushPressure)

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

toString

public String toString()

Overrides:

toString in class Object

skipControl

protected boolean skipControl(long deltaSize,
                              long controlSize)

Description copied from class: PressureAwareThroughputController

Check whether to skip control given delta size and control size

Specified by:

skipControl in class PressureAwareThroughputController

Parameters:

deltaSize - Delta size since last control

controlSize - Size limit to perform control

Returns:

a boolean indicates whether to skip this control