@InterfaceAudience.Private public class LruBlockCache extends Object implements ResizableBlockCache, HeapSize
HeapSize
,
memory-bound using an LRU eviction algorithm, and concurrent: backed by a
ConcurrentHashMap
and with a non-blocking eviction thread giving
constant-time cacheBlock(org.apache.hadoop.hbase.io.hfile.BlockCacheKey, org.apache.hadoop.hbase.io.hfile.Cacheable, boolean, boolean)
and getBlock(org.apache.hadoop.hbase.io.hfile.BlockCacheKey, boolean, boolean, boolean)
operations.
Contains three levels of block priority to allow for
scan-resistance and in-memory families
HColumnDescriptor.setInMemory(boolean)
(An
in-memory column family is a column family that should be served from memory if possible):
single-access, multiple-accesses, and in-memory priority.
A block is added with an in-memory priority flag if
HColumnDescriptor.isInMemory()
,
otherwise a block becomes a single access
priority the first time it is read into this block cache. If a block is accessed again while
in cache, it is marked as a multiple access priority block. This delineation of blocks is used
to prevent scans from thrashing the cache adding a least-frequently-used
element to the eviction algorithm.
Each priority is given its own chunk of the total cache to ensure fairness during eviction. Each priority will retain close to its maximum size, however, if any priority is not using its entire chunk the others are able to grow beyond their chunk size.
Instantiated at a minimum with the total size and average block size. All sizes are in bytes. The block size is not especially important as this cache is fully dynamic in its sizing of blocks. It is only used for pre-allocating data structures and in initial heap estimation of the map.
The detailed constructor defines the sizes for the three priorities (they
should total to the maximum size
defined). It also sets the levels that
trigger and control the eviction thread.
The acceptable size
is the cache size level which triggers the eviction
process to start. It evicts enough blocks to get the size below the
minimum size specified.
Eviction happens in a separate thread and involves a single full-scan of the map. It determines how many bytes must be freed to reach the minimum size, and then while scanning determines the fewest least-recently-used blocks necessary from each of the three priorities (would be 3 times bytes to free). It then uses the priority chunk sizes to evict fairly according to the relative sizes and usage.
Modifier and Type | Class and Description |
---|---|
private class |
LruBlockCache.BlockBucket
Used to group blocks into priority buckets.
|
(package private) static class |
LruBlockCache.EvictionThread |
(package private) static class |
LruBlockCache.StatisticsThread |
Modifier and Type | Field and Description |
---|---|
private float |
acceptableFactor
Acceptable size of cache (no evictions if size < acceptable)
|
private long |
blockSize
Approximate block size
|
static long |
CACHE_FIXED_OVERHEAD |
private AtomicLong |
count
Cache access count (sequential ID)
|
(package private) static float |
DEFAULT_ACCEPTABLE_FACTOR |
(package private) static int |
DEFAULT_CONCURRENCY_LEVEL |
(package private) static float |
DEFAULT_HARD_CAPACITY_LIMIT_FACTOR
default hard capacity limit
|
(package private) static boolean |
DEFAULT_IN_MEMORY_FORCE_MODE |
(package private) static float |
DEFAULT_LOAD_FACTOR
Backing Concurrent Map Configuration
|
private static long |
DEFAULT_MAX_BLOCK_SIZE |
(package private) static float |
DEFAULT_MEMORY_FACTOR |
(package private) static float |
DEFAULT_MIN_FACTOR
Eviction thresholds
|
(package private) static float |
DEFAULT_MULTI_FACTOR |
(package private) static float |
DEFAULT_SINGLE_FACTOR
Priority buckets
|
private AtomicLong |
elements
Current number of cached elements
|
private boolean |
evictionInProgress
Volatile boolean to track if we are in an eviction process or not
|
private ReentrantLock |
evictionLock
Eviction lock (locked when eviction in process)
|
private LruBlockCache.EvictionThread |
evictionThread
Eviction thread
|
private boolean |
forceInMemory
Whether in-memory hfile's data block has higher priority when evicting
|
private float |
hardCapacityLimitFactor
hard capacity limit
|
private static org.apache.commons.logging.Log |
LOG |
(package private) static String |
LRU_ACCEPTABLE_FACTOR_CONFIG_NAME
Acceptable size of cache (no evictions if size < acceptable)
|
(package private) static String |
LRU_HARD_CAPACITY_LIMIT_FACTOR_CONFIG_NAME
Hard capacity limit of cache, will reject any put if size > this * acceptable
|
(package private) static String |
LRU_IN_MEMORY_FORCE_MODE_CONFIG_NAME
Configuration key to force data-block always (except in-memory are too much)
cached in memory for in-memory hfile, unlike inMemory, which is a column-family
configuration, inMemoryForceMode is a cluster-wide configuration
|
private static String |
LRU_MAX_BLOCK_SIZE |
(package private) static String |
LRU_MEMORY_PERCENTAGE_CONFIG_NAME |
(package private) static String |
LRU_MIN_FACTOR_CONFIG_NAME
Percentage of total size that eviction will evict until; e.g.
|
(package private) static String |
LRU_MULTI_PERCENTAGE_CONFIG_NAME |
(package private) static String |
LRU_SINGLE_PERCENTAGE_CONFIG_NAME |
private Map<BlockCacheKey,LruCachedBlock> |
map
Concurrent map (the cache)
|
private long |
maxBlockSize |
private long |
maxSize
Maximum allowable size of cache (block put if size > max, evict)
|
private float |
memoryFactor
In-memory bucket size
|
private float |
minFactor
Minimum threshold of cache (when evicting, evict until size < min)
|
private float |
multiFactor
Multiple access bucket size
|
private long |
overhead
Overhead of the structure itself
|
private ScheduledExecutorService |
scheduleThreadPool
Statistics thread schedule pool (for heavy debugging, could remove)
|
private float |
singleFactor
Single access bucket size
|
private AtomicLong |
size
Current size of cache
|
private CacheStats |
stats
Cache statistics
|
(package private) static int |
statThreadPeriod
Statistics thread
|
private BlockCache |
victimHandler
Where to send victims (blocks evicted/missing from the cache)
|
Constructor and Description |
---|
LruBlockCache(long maxSize,
long blockSize)
Default constructor.
|
LruBlockCache(long maxSize,
long blockSize,
boolean evictionThread)
Constructor used for testing.
|
LruBlockCache(long maxSize,
long blockSize,
boolean evictionThread,
org.apache.hadoop.conf.Configuration conf) |
LruBlockCache(long maxSize,
long blockSize,
boolean evictionThread,
int mapInitialSize,
float mapLoadFactor,
int mapConcurrencyLevel,
float minFactor,
float acceptableFactor,
float singleFactor,
float multiFactor,
float memoryFactor,
float hardLimitFactor,
boolean forceInMemory,
long maxBlockSize)
Configurable constructor.
|
LruBlockCache(long maxSize,
long blockSize,
org.apache.hadoop.conf.Configuration conf) |
Modifier and Type | Method and Description |
---|---|
(package private) long |
acceptableSize() |
private static void |
assertCounterSanity(long mapSize,
long counterVal)
Sanity-checking for parity between actual block cache content and metrics.
|
void |
cacheBlock(BlockCacheKey cacheKey,
Cacheable buf)
Cache the block with the specified name and buffer.
|
void |
cacheBlock(BlockCacheKey cacheKey,
Cacheable buf,
boolean inMemory,
boolean cacheDataInL1)
Cache the block with the specified name and buffer.
|
static long |
calculateOverhead(long maxSize,
long blockSize,
int concurrency) |
void |
clearCache()
Clears the cache.
|
private int |
compare(Cacheable left,
Cacheable right) |
boolean |
containsBlock(BlockCacheKey cacheKey)
Whether the cache contains block with specified cacheKey
|
(package private) void |
evict()
Eviction method.
|
boolean |
evictBlock(BlockCacheKey cacheKey)
Evict block from cache.
|
protected long |
evictBlock(LruCachedBlock block,
boolean evictedByEvictionProcess)
Evict the block, and it will be cached by the victim handler if exists &&
block may be read again later
|
int |
evictBlocksByHfileName(String hfileName)
Evicts all blocks for a specific HFile.
|
Cacheable |
getBlock(BlockCacheKey cacheKey,
boolean caching,
boolean repeat,
boolean updateCacheMetrics)
Get the buffer of the block with the specified name.
|
BlockCache[] |
getBlockCaches() |
long |
getBlockCount()
Returns the number of blocks currently cached in the block cache.
|
(package private) Map<BlockType,Integer> |
getBlockTypeCountsForTest() |
(package private) SortedSet<String> |
getCachedFileNamesForTest()
Used in testing.
|
long |
getCurrentSize()
Returns the occupied size of the block cache, in bytes.
|
Map<DataBlockEncoding,Integer> |
getEncodingCountsForTest() |
(package private) LruBlockCache.EvictionThread |
getEvictionThread() |
long |
getFreeSize()
Returns the free size of the block cache, in bytes.
|
(package private) Map<BlockCacheKey,LruCachedBlock> |
getMapForTests() |
long |
getMaxSize()
Get the maximum size of this cache.
|
CacheStats |
getStats()
Get counter statistics for this cache.
|
(package private) BlockCache |
getVictimHandler() |
long |
heapSize() |
Iterator<CachedBlock> |
iterator() |
void |
logStats() |
private long |
memorySize() |
private long |
minSize() |
private long |
multiSize() |
private void |
runEviction()
Multi-threaded call to run the eviction process.
|
void |
setMaxSize(long maxSize)
Sets the max heap size that can be used by the BlockCache.
|
void |
setVictimCache(BlockCache handler) |
void |
shutdown()
Shutdown the cache.
|
private long |
singleSize() |
long |
size()
Returns the total size of the block cache, in bytes.
|
String |
toString() |
protected long |
updateSizeMetrics(LruCachedBlock cb,
boolean evict)
Helper function that updates the local size counter and also updates any
per-cf or per-blocktype metrics it can discern from given
LruCachedBlock |
private static final org.apache.commons.logging.Log LOG
static final String LRU_MIN_FACTOR_CONFIG_NAME
static final String LRU_ACCEPTABLE_FACTOR_CONFIG_NAME
static final String LRU_HARD_CAPACITY_LIMIT_FACTOR_CONFIG_NAME
static final String LRU_SINGLE_PERCENTAGE_CONFIG_NAME
static final String LRU_MULTI_PERCENTAGE_CONFIG_NAME
static final String LRU_MEMORY_PERCENTAGE_CONFIG_NAME
static final String LRU_IN_MEMORY_FORCE_MODE_CONFIG_NAME
static final float DEFAULT_LOAD_FACTOR
static final int DEFAULT_CONCURRENCY_LEVEL
static final float DEFAULT_MIN_FACTOR
static final float DEFAULT_ACCEPTABLE_FACTOR
static final float DEFAULT_SINGLE_FACTOR
static final float DEFAULT_MULTI_FACTOR
static final float DEFAULT_MEMORY_FACTOR
static final float DEFAULT_HARD_CAPACITY_LIMIT_FACTOR
static final boolean DEFAULT_IN_MEMORY_FORCE_MODE
static final int statThreadPeriod
private static final String LRU_MAX_BLOCK_SIZE
private static final long DEFAULT_MAX_BLOCK_SIZE
private final Map<BlockCacheKey,LruCachedBlock> map
private final ReentrantLock evictionLock
private final long maxBlockSize
private volatile boolean evictionInProgress
private final LruBlockCache.EvictionThread evictionThread
private final ScheduledExecutorService scheduleThreadPool
private final AtomicLong size
private final AtomicLong elements
private final AtomicLong count
private float hardCapacityLimitFactor
private final CacheStats stats
private long maxSize
private long blockSize
private float acceptableFactor
private float minFactor
private float singleFactor
private float multiFactor
private float memoryFactor
private long overhead
private boolean forceInMemory
private BlockCache victimHandler
public static final long CACHE_FIXED_OVERHEAD
public LruBlockCache(long maxSize, long blockSize)
All other factors will be calculated based on defaults specified in this class.
maxSize
- maximum size of cache, in bytesblockSize
- approximate size of each block, in bytespublic LruBlockCache(long maxSize, long blockSize, boolean evictionThread)
public LruBlockCache(long maxSize, long blockSize, boolean evictionThread, org.apache.hadoop.conf.Configuration conf)
public LruBlockCache(long maxSize, long blockSize, org.apache.hadoop.conf.Configuration conf)
public LruBlockCache(long maxSize, long blockSize, boolean evictionThread, int mapInitialSize, float mapLoadFactor, int mapConcurrencyLevel, float minFactor, float acceptableFactor, float singleFactor, float multiFactor, float memoryFactor, float hardLimitFactor, boolean forceInMemory, long maxBlockSize)
maxSize
- maximum size of this cache, in bytesblockSize
- expected average size of blocks, in bytesevictionThread
- whether to run evictions in a bg thread or notmapInitialSize
- initial size of backing ConcurrentHashMapmapLoadFactor
- initial load factor of backing ConcurrentHashMapmapConcurrencyLevel
- initial concurrency factor for backing CHMminFactor
- percentage of total size that eviction will evict untilacceptableFactor
- percentage of total size that triggers evictionsingleFactor
- percentage of total size for single-access blocksmultiFactor
- percentage of total size for multiple-access blocksmemoryFactor
- percentage of total size for in-memory blockspublic void setMaxSize(long maxSize)
ResizableBlockCache
setMaxSize
in interface ResizableBlockCache
maxSize
- The max heap size.public void cacheBlock(BlockCacheKey cacheKey, Cacheable buf, boolean inMemory, boolean cacheDataInL1)
It is assumed this will NOT be called on an already cached block. In rare cases (HBASE-8547) this can happen, for which we compare the buffer contents.
cacheBlock
in interface BlockCache
cacheKey
- block's cache keybuf
- block bufferinMemory
- if block is in-memorycacheDataInL1
- private static void assertCounterSanity(long mapSize, long counterVal)
public void cacheBlock(BlockCacheKey cacheKey, Cacheable buf)
cacheBlock
in interface BlockCache
cacheKey
- block's cache keybuf
- block bufferprotected long updateSizeMetrics(LruCachedBlock cb, boolean evict)
LruCachedBlock
cb
- evict
- public Cacheable getBlock(BlockCacheKey cacheKey, boolean caching, boolean repeat, boolean updateCacheMetrics)
getBlock
in interface BlockCache
cacheKey
- block's cache keycaching
- true if the caller caches blocks on cache missesrepeat
- Whether this is a repeat lookup for the same block
(used to avoid double counting cache misses when doing double-check locking)updateCacheMetrics
- Whether to update cache metrics or notpublic boolean containsBlock(BlockCacheKey cacheKey)
cacheKey
- public boolean evictBlock(BlockCacheKey cacheKey)
BlockCache
evictBlock
in interface BlockCache
cacheKey
- Block to evictpublic int evictBlocksByHfileName(String hfileName)
This is used for evict-on-close to remove all blocks of a specific HFile.
evictBlocksByHfileName
in interface BlockCache
protected long evictBlock(LruCachedBlock block, boolean evictedByEvictionProcess)
block
- evictedByEvictionProcess
- true if the given block is evicted by
EvictionThreadprivate void runEviction()
void evict()
public long getMaxSize()
public long getCurrentSize()
BlockCache
getCurrentSize
in interface BlockCache
public long getFreeSize()
BlockCache
getFreeSize
in interface BlockCache
public long size()
BlockCache
size
in interface BlockCache
public long getBlockCount()
BlockCache
getBlockCount
in interface BlockCache
LruBlockCache.EvictionThread getEvictionThread()
public void logStats()
public CacheStats getStats()
Includes: total accesses, hits, misses, evicted blocks, and runs of the eviction processes.
getStats
in interface BlockCache
public long heapSize()
public static long calculateOverhead(long maxSize, long blockSize, int concurrency)
public Iterator<CachedBlock> iterator()
iterator
in interface Iterable<CachedBlock>
iterator
in interface BlockCache
long acceptableSize()
private long minSize()
private long singleSize()
private long multiSize()
private long memorySize()
public void shutdown()
BlockCache
shutdown
in interface BlockCache
public void clearCache()
SortedSet<String> getCachedFileNamesForTest()
public Map<DataBlockEncoding,Integer> getEncodingCountsForTest()
public void setVictimCache(BlockCache handler)
Map<BlockCacheKey,LruCachedBlock> getMapForTests()
BlockCache getVictimHandler()
public BlockCache[] getBlockCaches()
getBlockCaches
in interface BlockCache
Copyright © 2007–2019 The Apache Software Foundation. All rights reserved.