org.apache.hadoop.hbase.thrift

Class IncrementCoalescer

java.lang.Object

org.apache.hadoop.hbase.thrift.IncrementCoalescer

All Implemented Interfaces:

IncrementCoalescerMBean

@InterfaceAudience.Private
public class IncrementCoalescer
extends Object
implements IncrementCoalescerMBean

This class will coalesce increments from a thift server if hbase.regionserver.thrift.coalesceIncrement is set to true. Turning this config to true will cause the thrift server to queue increments into an instance of this class. The thread pool associated with this class will drain the coalesced increments as the thread is able. This can cause data loss if the thrift server dies or is shut down before everything in the queue is drained.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
(package private) static class	IncrementCoalescer.FullyQualifiedRow Used to identify a cell that will be incremented.

Field Summary

Fields

Modifier and Type	Field and Description
private static int	CORE_POOL_SIZE
private ConcurrentMap<IncrementCoalescer.FullyQualifiedRow,Long>	countersMap
private LongAdder	failedIncrements
private ThriftServerRunner.HBaseHandler	handler
private static org.slf4j.Logger	LOG
private int	maxQueueSize
private ThreadPoolExecutor	pool
private LongAdder	successfulCoalescings
private LongAdder	totalIncrements

Constructor Summary

Constructors

Constructor and Description
IncrementCoalescer(ThriftServerRunner.HBaseHandler hand)

Method Summary

Modifier and Type	Method and Description
boolean	canQueue()
private Callable<Integer>	createIncCallable()
private void	dynamicallySetCoreSize(int countersMapSize) This method samples the incoming requests and, if selected, will check if the corePoolSize should be changed.
int	getCorePoolSize()
long	getCountersMapSize()
long	getFailedIncrements()
int	getMaxPoolSize()
int	getMaxQueueSize()
long	getPoolCompletedTaskCount()
int	getPoolLargestPoolSize()
long	getPoolTaskCount()
int	getQueueSize()
long	getSuccessfulCoalescings()
long	getTotalIncrements()
private boolean	internalQueueIncrement(byte[] tableName, byte[] rowKey, byte[] fam, byte[] qual, long ammount)
private boolean	internalQueueTincrement(org.apache.hadoop.hbase.thrift.generated.TIncrement inc)
boolean	queueIncrement(org.apache.hadoop.hbase.thrift.generated.TIncrement inc)
boolean	queueIncrements(List<org.apache.hadoop.hbase.thrift.generated.TIncrement> incs)
void	setCorePoolSize(int newCoreSize)
void	setMaxPoolSize(int newMaxSize)
void	setMaxQueueSize(int newSize)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

failedIncrements

private final LongAdder failedIncrements

successfulCoalescings

private final LongAdder successfulCoalescings

totalIncrements

private final LongAdder totalIncrements

countersMap

private final ConcurrentMap<IncrementCoalescer.FullyQualifiedRow,Long> countersMap

pool

private final ThreadPoolExecutor pool

handler

private final ThriftServerRunner.HBaseHandler handler

maxQueueSize

private int maxQueueSize

CORE_POOL_SIZE

private static final int CORE_POOL_SIZE

See Also:

Constant Field Values

LOG

private static final org.slf4j.Logger LOG

Constructor Detail

IncrementCoalescer

public IncrementCoalescer(ThriftServerRunner.HBaseHandler hand)

Method Detail

queueIncrement

public boolean queueIncrement(org.apache.hadoop.hbase.thrift.generated.TIncrement inc)
                       throws org.apache.thrift.TException

Throws:

org.apache.thrift.TException

queueIncrements

public boolean queueIncrements(List<org.apache.hadoop.hbase.thrift.generated.TIncrement> incs)
                        throws org.apache.thrift.TException

Throws:

org.apache.thrift.TException

internalQueueTincrement

private boolean internalQueueTincrement(org.apache.hadoop.hbase.thrift.generated.TIncrement inc)
                                 throws org.apache.thrift.TException

Throws:

org.apache.thrift.TException

internalQueueIncrement

private boolean internalQueueIncrement(byte[] tableName,
                                       byte[] rowKey,
                                       byte[] fam,
                                       byte[] qual,
                                       long ammount)
                                throws org.apache.thrift.TException

Throws:

org.apache.thrift.TException

canQueue

public boolean canQueue()

createIncCallable

private Callable<Integer> createIncCallable()

dynamicallySetCoreSize

private void dynamicallySetCoreSize(int countersMapSize)

This method samples the incoming requests and, if selected, will check if the corePoolSize should be changed.

Parameters:

countersMapSize -

getQueueSize

public int getQueueSize()

Specified by:

getQueueSize in interface IncrementCoalescerMBean

getMaxQueueSize

public int getMaxQueueSize()

Specified by:

getMaxQueueSize in interface IncrementCoalescerMBean

setMaxQueueSize

public void setMaxQueueSize(int newSize)

Specified by:

setMaxQueueSize in interface IncrementCoalescerMBean

getPoolCompletedTaskCount

public long getPoolCompletedTaskCount()

Specified by:

getPoolCompletedTaskCount in interface IncrementCoalescerMBean

getPoolTaskCount

public long getPoolTaskCount()

Specified by:

getPoolTaskCount in interface IncrementCoalescerMBean

getPoolLargestPoolSize

public int getPoolLargestPoolSize()

Specified by:

getPoolLargestPoolSize in interface IncrementCoalescerMBean

getCorePoolSize

public int getCorePoolSize()

Specified by:

getCorePoolSize in interface IncrementCoalescerMBean

setCorePoolSize

public void setCorePoolSize(int newCoreSize)

Specified by:

setCorePoolSize in interface IncrementCoalescerMBean

getMaxPoolSize

public int getMaxPoolSize()

Specified by:

getMaxPoolSize in interface IncrementCoalescerMBean

setMaxPoolSize

public void setMaxPoolSize(int newMaxSize)

Specified by:

setMaxPoolSize in interface IncrementCoalescerMBean

getFailedIncrements

public long getFailedIncrements()

Specified by:

getFailedIncrements in interface IncrementCoalescerMBean

getSuccessfulCoalescings

public long getSuccessfulCoalescings()

Specified by:

getSuccessfulCoalescings in interface IncrementCoalescerMBean

getTotalIncrements

public long getTotalIncrements()

Specified by:

getTotalIncrements in interface IncrementCoalescerMBean

getCountersMapSize

public long getCountersMapSize()

Specified by:

getCountersMapSize in interface IncrementCoalescerMBean