org.apache.hadoop.hbase.io.hfile

Class CombinedBlockCache

java.lang.Object

org.apache.hadoop.hbase.io.hfile.CombinedBlockCache

All Implemented Interfaces:

Iterable<CachedBlock>, HeapSize, BlockCache, ResizableBlockCache

Direct Known Subclasses:

InclusiveCombinedBlockCache

@InterfaceAudience.Private
public class CombinedBlockCache
extends Object
implements ResizableBlockCache, HeapSize

CombinedBlockCache is an abstraction layer that combines FirstLevelBlockCache and BucketCache. The smaller lruCache is used to cache bloom blocks and index blocks. The larger Cache is used to cache data blocks. getBlock(BlockCacheKey, boolean, boolean, boolean) reads first from the smaller l1Cache before looking for the block in the l2Cache. Blocks evicted from l1Cache are put into the bucket cache. Metrics are the combined size and hits and misses of both caches.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CombinedBlockCache.CombinedCacheStats

Field Summary

Fields

Modifier and Type	Field and Description
protected CombinedBlockCache.CombinedCacheStats	combinedCacheStats
protected FirstLevelBlockCache	l1Cache
protected BlockCache	l2Cache

Constructor Summary

Constructors

Constructor and Description
CombinedBlockCache(FirstLevelBlockCache l1Cache, BlockCache l2Cache)

Method Summary

Modifier and Type	Method and Description
void	cacheBlock(BlockCacheKey cacheKey, Cacheable buf) Add block to cache (defaults to not in-memory).
void	cacheBlock(BlockCacheKey cacheKey, Cacheable buf, boolean inMemory) Add block to cache.
boolean	evictBlock(BlockCacheKey cacheKey) Evict block from cache.
int	evictBlocksByHfileName(String hfileName) Evicts all blocks for the given HFile.
Cacheable	getBlock(BlockCacheKey cacheKey, boolean caching, boolean repeat, boolean updateCacheMetrics) Fetch block from cache.
BlockCache[]	getBlockCaches() Returns The list of sub blockcaches that make up this one; returns null if no sub caches.
long	getBlockCount() Returns the number of blocks currently cached in the block cache.
long	getCurrentDataSize() Returns the occupied size of data blocks, in bytes.
long	getCurrentSize() Returns the occupied size of the block cache, in bytes.
long	getDataBlockCount() Returns the number of data blocks currently cached in the block cache.
FirstLevelBlockCache	getFirstLevelCache()
long	getFreeSize() Returns the free size of the block cache, in bytes.
long	getMaxSize() Returns the Max size of the block cache, in bytes.
int	getRpcRefCount(BlockCacheKey cacheKey)
BlockCache	getSecondLevelCache()
CacheStats	getStats() Get the statistics for this block cache.
long	heapSize() Return the approximate 'exclusive deep size' of implementing object.
Iterator<CachedBlock>	iterator() Returns Iterator over the blocks in the cache.
void	setMaxSize(long size) Sets the max heap size that can be used by the BlockCache.
void	shutdown() Shutdown the cache.
long	size() Returns the total size of the block cache, in bytes.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.io.hfile.BlockCache

isMetaBlock

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Field Detail

l1Cache

protected final FirstLevelBlockCache l1Cache

l2Cache

protected final BlockCache l2Cache

combinedCacheStats

protected final CombinedBlockCache.CombinedCacheStats combinedCacheStats

Constructor Detail

CombinedBlockCache

public CombinedBlockCache(FirstLevelBlockCache l1Cache,
                          BlockCache l2Cache)

Method Detail

heapSize

public long heapSize()

Description copied from interface: HeapSize

Return the approximate 'exclusive deep size' of implementing object. Includes count of payload and hosting object sizings.

Specified by:

heapSize in interface HeapSize

cacheBlock

public void cacheBlock(BlockCacheKey cacheKey,
                       Cacheable buf,
                       boolean inMemory)

Description copied from interface: BlockCache

Add block to cache.

Specified by:

cacheBlock in interface BlockCache

Parameters:

cacheKey - The block's cache key.

buf - The block contents wrapped in a ByteBuffer.

inMemory - Whether block should be treated as in-memory

cacheBlock

public void cacheBlock(BlockCacheKey cacheKey,
                       Cacheable buf)

Description copied from interface: BlockCache

Add block to cache (defaults to not in-memory).

Specified by:

cacheBlock in interface BlockCache

Parameters:

cacheKey - The block's cache key.

buf - The object to cache.

getBlock

public Cacheable getBlock(BlockCacheKey cacheKey,
                          boolean caching,
                          boolean repeat,
                          boolean updateCacheMetrics)

Description copied from interface: BlockCache

Fetch block from cache.

Specified by:

getBlock in interface BlockCache

Parameters:

cacheKey - Block to fetch.

caching - Whether this request has caching enabled (used for stats)

repeat - Whether this is a repeat lookup for the same block (used to avoid double counting cache misses when doing double-check locking)

updateCacheMetrics - Whether to update cache metrics or not

Returns:

Block or null if block is not in 2 cache.

evictBlock

public boolean evictBlock(BlockCacheKey cacheKey)

Description copied from interface: BlockCache

Evict block from cache.

Specified by:

evictBlock in interface BlockCache

Parameters:

cacheKey - Block to evict

Returns:

true if block existed and was evicted, false if not

evictBlocksByHfileName

public int evictBlocksByHfileName(String hfileName)

Description copied from interface: BlockCache

Evicts all blocks for the given HFile.

Specified by:

evictBlocksByHfileName in interface BlockCache

Returns:

the number of blocks evicted

getStats

public CacheStats getStats()

Description copied from interface: BlockCache

Get the statistics for this block cache. n

Specified by:

getStats in interface BlockCache

shutdown

public void shutdown()

Description copied from interface: BlockCache

Shutdown the cache.

Specified by:

shutdown in interface BlockCache

size

public long size()

Description copied from interface: BlockCache

Returns the total size of the block cache, in bytes.

Specified by:

size in interface BlockCache

Returns:

size of cache, in bytes

getMaxSize

public long getMaxSize()

Description copied from interface: BlockCache

Returns the Max size of the block cache, in bytes.

Specified by:

getMaxSize in interface BlockCache

Returns:

size of cache, in bytes

getCurrentDataSize

public long getCurrentDataSize()

Description copied from interface: BlockCache

Returns the occupied size of data blocks, in bytes.

Specified by:

getCurrentDataSize in interface BlockCache

Returns:

occupied space in cache, in bytes

getFreeSize

public long getFreeSize()

Description copied from interface: BlockCache

Returns the free size of the block cache, in bytes.

Specified by:

getFreeSize in interface BlockCache

Returns:

free space in cache, in bytes

getCurrentSize

public long getCurrentSize()

Description copied from interface: BlockCache

Returns the occupied size of the block cache, in bytes.

Specified by:

getCurrentSize in interface BlockCache

Returns:

occupied space in cache, in bytes

getBlockCount

public long getBlockCount()

Description copied from interface: BlockCache

Returns the number of blocks currently cached in the block cache.

Specified by:

getBlockCount in interface BlockCache

Returns:

number of blocks in the cache

getDataBlockCount

public long getDataBlockCount()

Description copied from interface: BlockCache

Returns the number of data blocks currently cached in the block cache.

Specified by:

getDataBlockCount in interface BlockCache

Returns:

number of blocks in the cache

iterator

public Iterator<CachedBlock> iterator()

Description copied from interface: BlockCache

Returns Iterator over the blocks in the cache.

Specified by:

iterator in interface Iterable<CachedBlock>

Specified by:

iterator in interface BlockCache

getBlockCaches

public BlockCache[] getBlockCaches()

Description copied from interface: BlockCache

Returns The list of sub blockcaches that make up this one; returns null if no sub caches.

Specified by:

getBlockCaches in interface BlockCache

setMaxSize

public void setMaxSize(long size)

Description copied from interface: ResizableBlockCache

Sets the max heap size that can be used by the BlockCache.

Specified by:

setMaxSize in interface ResizableBlockCache

Parameters:

size - The max heap size.

getRpcRefCount

public int getRpcRefCount(BlockCacheKey cacheKey)

getFirstLevelCache

public FirstLevelBlockCache getFirstLevelCache()

getSecondLevelCache

public BlockCache getSecondLevelCache()