org.apache.hadoop.hbase.ipc

Class FastPathBalancedQueueRpcExecutor

java.lang.Object

org.apache.hadoop.hbase.ipc.RpcExecutor

org.apache.hadoop.hbase.ipc.BalancedQueueRpcExecutor

org.apache.hadoop.hbase.ipc.FastPathBalancedQueueRpcExecutor

@InterfaceAudience.Private
public class FastPathBalancedQueueRpcExecutor
extends BalancedQueueRpcExecutor

Balanced queue executor with a fastpath. Because this is FIFO, it has no respect for ordering so a fast path skipping the queuing of Calls if an Handler is available, is possible. Just pass the Call direct to waiting Handler thread. Try to keep the hot Handlers bubbling rather than let them go cold and lose context. Idea taken from Apace Kudu (incubating). See https://gerrit.cloudera.org/#/c/2938/7/src/kudu/rpc/service_queue.h

Field Summary

Fields

Modifier and Type	Field and Description
private Deque<FastPathRpcHandler>	fastPathHandlerStack

Fields inherited from class org.apache.hadoop.hbase.ipc.RpcExecutor

CALL_QUEUE_CODEL_DEFAULT_INTERVAL, CALL_QUEUE_CODEL_DEFAULT_LIFO_THRESHOLD, CALL_QUEUE_CODEL_DEFAULT_TARGET_DELAY, CALL_QUEUE_CODEL_INTERVAL, CALL_QUEUE_CODEL_LIFO_THRESHOLD, CALL_QUEUE_CODEL_TARGET_DELAY, CALL_QUEUE_HANDLER_FACTOR_CONF_KEY, CALL_QUEUE_QUEUE_BALANCER_CLASS, CALL_QUEUE_QUEUE_BALANCER_CLASS_DEFAULT, CALL_QUEUE_TYPE_CODEL_CONF_VALUE, CALL_QUEUE_TYPE_CONF_DEFAULT, CALL_QUEUE_TYPE_CONF_KEY, CALL_QUEUE_TYPE_DEADLINE_CONF_VALUE, CALL_QUEUE_TYPE_FIFO_CONF_VALUE, CALL_QUEUE_TYPE_PLUGGABLE_CONF_VALUE, currentQueueLimit, DEFAULT_CALL_QUEUE_SIZE_HARD_LIMIT, numCallQueues, PLUGGABLE_CALL_QUEUE_CLASS_NAME, PLUGGABLE_CALL_QUEUE_WITH_FAST_PATH_ENABLED, QUEUE_MAX_CALL_DELAY_CONF_KEY, queues

Constructor Summary

Constructors

Constructor and Description
FastPathBalancedQueueRpcExecutor(String name, int handlerCount, int maxQueueLength, PriorityFunction priority, org.apache.hadoop.conf.Configuration conf, Abortable abortable)
FastPathBalancedQueueRpcExecutor(String name, int handlerCount, String callQueueType, int maxQueueLength, PriorityFunction priority, org.apache.hadoop.conf.Configuration conf, Abortable abortable)

Method Summary

Modifier and Type	Method and Description
boolean	dispatch(CallRunner callTask) Add the request to the executor queue
protected RpcHandler	getHandler(String name, double handlerFailureThreshhold, int handlerCount, BlockingQueue<CallRunner> q, AtomicInteger activeHandlerCount, AtomicInteger failedHandlerCount, Abortable abortable) Override if providing alternate Handler implementation.
private FastPathRpcHandler	popReadyHandler() Returns Pop a Handler instance if one available ready-to-go or else return null.

Methods inherited from class org.apache.hadoop.hbase.ipc.BalancedQueueRpcExecutor

onConfigurationChange

Methods inherited from class org.apache.hadoop.hbase.ipc.RpcExecutor

computeNumCallQueues, getActiveHandlerCount, getActiveReadHandlerCount, getActiveScanHandlerCount, getActiveWriteHandlerCount, getBalancer, getCallQueueCountsSummary, getCallQueueSizeSummary, getName, getNumGeneralCallsDropped, getNumLifoModeSwitches, getQueueLength, getQueues, getReadQueueLength, getScanQueueLength, getWriteQueueLength, initializeQueues, isCodelQueueType, isDeadlineQueueType, isFifoQueueType, isPluggableQueueType, isPluggableQueueWithFastPath, resizeQueues, start, startHandlers, startHandlers, stop

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

fastPathHandlerStack

private final Deque<FastPathRpcHandler> fastPathHandlerStack

Constructor Detail

FastPathBalancedQueueRpcExecutor

public FastPathBalancedQueueRpcExecutor(String name,
                                        int handlerCount,
                                        int maxQueueLength,
                                        PriorityFunction priority,
                                        org.apache.hadoop.conf.Configuration conf,
                                        Abortable abortable)

FastPathBalancedQueueRpcExecutor

public FastPathBalancedQueueRpcExecutor(String name,
                                        int handlerCount,
                                        String callQueueType,
                                        int maxQueueLength,
                                        PriorityFunction priority,
                                        org.apache.hadoop.conf.Configuration conf,
                                        Abortable abortable)

Method Detail

getHandler

protected RpcHandler getHandler(String name,
                                double handlerFailureThreshhold,
                                int handlerCount,
                                BlockingQueue<CallRunner> q,
                                AtomicInteger activeHandlerCount,
                                AtomicInteger failedHandlerCount,
                                Abortable abortable)

Description copied from class: RpcExecutor

Override if providing alternate Handler implementation.

Overrides:

getHandler in class RpcExecutor

dispatch

public boolean dispatch(CallRunner callTask)

Description copied from class: RpcExecutor

Add the request to the executor queue

Overrides:

dispatch in class BalancedQueueRpcExecutor

popReadyHandler

private FastPathRpcHandler popReadyHandler()

Returns Pop a Handler instance if one available ready-to-go or else return null.