org.apache.hadoop.hbase.regionserver

Class TestHStore.MyCompactingMemStore5

java.lang.Object

org.apache.hadoop.hbase.regionserver.AbstractMemStore

org.apache.hadoop.hbase.regionserver.CompactingMemStore

org.apache.hadoop.hbase.regionserver.TestHStore.MyCompactingMemStore5

All Implemented Interfaces:

org.apache.hadoop.hbase.regionserver.MemStore

Enclosing class:

TestHStore

public static class TestHStore.MyCompactingMemStore5
extends org.apache.hadoop.hbase.regionserver.CompactingMemStore

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.CompactingMemStore

org.apache.hadoop.hbase.regionserver.CompactingMemStore.IndexType

Field Summary

Fields

Modifier and Type	Field and Description
private AtomicInteger	flattenOneSegmentCounter
private CyclicBarrier	flattenOneSegmentPostCyclicBarrier Only after CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) completed, CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList) could execute.
private CyclicBarrier	flattenOneSegmentPreCyclicBarrier CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) must execute after CompactingMemStore.getImmutableSegments()
private AtomicInteger	getImmutableSegmentsListCounter
private CyclicBarrier	inMemoryCompactionEndCyclicBarrier To wait for CompactingMemStore.InMemoryCompactionRunnable stopping.
private AtomicInteger	setInMemoryCompactionFlagCounter
private CyclicBarrier	snapShotStartCyclicCyclicBarrier Only the in memory compact thread enters CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action),the snapshot thread starts CompactingMemStore.snapshot(),because CompactingMemStore.snapshot() would invoke CompactingMemStore.stopCompaction().
private AtomicInteger	swapPipelineWithNullCounter
private static String	TAKE_SNAPSHOT_THREAD_NAME
private static String	WRITE_AGAIN_THREAD_NAME
private CyclicBarrier	writeMemStoreAgainEndCyclicBarrier This is used for snapshot thread,writeAgain thread and in memory compact thread.
private CyclicBarrier	writeMemStoreAgainStartCyclicBarrier Only the snapshot thread retry CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList), writeAgain thread could start.

Fields inherited from class org.apache.hadoop.hbase.regionserver.CompactingMemStore

allowCompaction, COMPACTING_MEMSTORE_TYPE_DEFAULT, COMPACTING_MEMSTORE_TYPE_KEY, compactor, DEEP_OVERHEAD, IN_MEMORY_CONPACTION_POOL_SIZE_DEFAULT, IN_MEMORY_CONPACTION_POOL_SIZE_KEY, IN_MEMORY_FLUSH_THRESHOLD_FACTOR_KEY

Fields inherited from class org.apache.hadoop.hbase.regionserver.AbstractMemStore

FIXED_OVERHEAD, regionServices, snapshot, snapshotId

Constructor Summary

Constructors

Constructor and Description
MyCompactingMemStore5(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hbase.CellComparatorImpl cellComparator, org.apache.hadoop.hbase.regionserver.HStore store, org.apache.hadoop.hbase.regionserver.RegionServicesForStores regionServices, org.apache.hadoop.hbase.MemoryCompactionPolicy compactionPolicy)

Method Summary

Modifier and Type	Method and Description
void	flattenOneSegment(long requesterVersion, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action action)
org.apache.hadoop.hbase.regionserver.VersionedSegmentsList	getImmutableSegments()
(package private) void	inMemoryCompaction()
protected boolean	setInMemoryCompactionFlag()
protected boolean	swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList segments)

Methods inherited from class org.apache.hadoop.hbase.regionserver.CompactingMemStore

checkAndAddToActiveSize, createList, createMemStoreCompactor, debug, flushInMemory, flushInMemory, getFamilyName, getFlushableSize, getIndexType, getInmemoryFlushSize, getNextRow, getScanners, getSegments, getSmallestReadPoint, getStore, hasImmutableSegments, heapSize, isMemStoreFlushingInMemory, isSloppy, keySize, postUpdate, preFlushSeqIDEstimation, preUpdate, pushActiveToPipeline, setCompositeSnapshot, setIndexType, setInMemoryCompactionCompleted, size, sizeAddedPreOperation, snapshot, startReplayingFromWAL, stopReplayingFromWAL, swapCompactedSegments, updateLowestUnflushedSequenceIdInWAL

Methods inherited from class org.apache.hadoop.hbase.regionserver.AbstractMemStore

add, add, addToScanners, addToScanners, clearSnapshot, doAdd, doClearSnapShot, dump, getActive, getComparator, getConfiguration, getLowest, getNextRow, getSnapshot, getSnapshotSize, resetActive, resetTimeOfOldestEdit, timeOfOldestEdit, toString, upsert

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

TAKE_SNAPSHOT_THREAD_NAME

private static final String TAKE_SNAPSHOT_THREAD_NAME

See Also:

Constant Field Values

WRITE_AGAIN_THREAD_NAME

private static final String WRITE_AGAIN_THREAD_NAME

See Also:

Constant Field Values

flattenOneSegmentPreCyclicBarrier

private final CyclicBarrier flattenOneSegmentPreCyclicBarrier

CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) must execute after CompactingMemStore.getImmutableSegments()

flattenOneSegmentPostCyclicBarrier

private final CyclicBarrier flattenOneSegmentPostCyclicBarrier

Only after CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) completed, CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList) could execute.

snapShotStartCyclicCyclicBarrier

private final CyclicBarrier snapShotStartCyclicCyclicBarrier

Only the in memory compact thread enters CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action),the snapshot thread starts CompactingMemStore.snapshot(),because CompactingMemStore.snapshot() would invoke CompactingMemStore.stopCompaction().

inMemoryCompactionEndCyclicBarrier

private final CyclicBarrier inMemoryCompactionEndCyclicBarrier

To wait for CompactingMemStore.InMemoryCompactionRunnable stopping.

getImmutableSegmentsListCounter

private final AtomicInteger getImmutableSegmentsListCounter

swapPipelineWithNullCounter

private final AtomicInteger swapPipelineWithNullCounter

flattenOneSegmentCounter

private final AtomicInteger flattenOneSegmentCounter

setInMemoryCompactionFlagCounter

private final AtomicInteger setInMemoryCompactionFlagCounter

writeMemStoreAgainStartCyclicBarrier

private final CyclicBarrier writeMemStoreAgainStartCyclicBarrier

Only the snapshot thread retry CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList), writeAgain thread could start.

writeMemStoreAgainEndCyclicBarrier

private final CyclicBarrier writeMemStoreAgainEndCyclicBarrier

This is used for snapshot thread,writeAgain thread and in memory compact thread. Only the writeAgain thread completes, CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList) would execute,and in memory compact thread would exit,because we expect that in memory compact executing only once.

Constructor Detail

MyCompactingMemStore5

public MyCompactingMemStore5(org.apache.hadoop.conf.Configuration conf,
                             org.apache.hadoop.hbase.CellComparatorImpl cellComparator,
                             org.apache.hadoop.hbase.regionserver.HStore store,
                             org.apache.hadoop.hbase.regionserver.RegionServicesForStores regionServices,
                             org.apache.hadoop.hbase.MemoryCompactionPolicy compactionPolicy)
                      throws IOException

Throws:

IOException

Method Detail

getImmutableSegments

public org.apache.hadoop.hbase.regionserver.VersionedSegmentsList getImmutableSegments()

Overrides:

getImmutableSegments in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

swapPipelineWithNull

protected boolean swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList segments)

Overrides:

swapPipelineWithNull in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

flattenOneSegment

public void flattenOneSegment(long requesterVersion,
                              org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action action)

Overrides:

flattenOneSegment in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

setInMemoryCompactionFlag

protected boolean setInMemoryCompactionFlag()

Overrides:

setInMemoryCompactionFlag in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

inMemoryCompaction

void inMemoryCompaction()

Overrides:

inMemoryCompaction in class org.apache.hadoop.hbase.regionserver.CompactingMemStore