Package org.apache.hadoop.hbase.regionserver

Class TestHStore.MyCompactingMemStore5

java.lang.Object

org.apache.hadoop.hbase.regionserver.AbstractMemStore

org.apache.hadoop.hbase.regionserver.CompactingMemStore

org.apache.hadoop.hbase.regionserver.TestHStore.MyCompactingMemStore5

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.hbase.regionserver.MemStore

Enclosing class:

TestHStore

public static class TestHStore.MyCompactingMemStore5
extends org.apache.hadoop.hbase.regionserver.CompactingMemStore

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.CompactingMemStore

org.apache.hadoop.hbase.regionserver.CompactingMemStore.IndexType

Field Summary

Fields

Modifier and Type	Field	Description
private final AtomicInteger	flattenOneSegmentCounter
private final CyclicBarrier	flattenOneSegmentPostCyclicBarrier	Only after CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) completed, CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList) could execute.
private final CyclicBarrier	flattenOneSegmentPreCyclicBarrier	CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) must execute after CompactingMemStore.getImmutableSegments()
private final AtomicInteger	getImmutableSegmentsListCounter
private final CyclicBarrier	inMemoryCompactionEndCyclicBarrier	To wait for CompactingMemStore.InMemoryCompactionRunnable stopping.
private final AtomicInteger	setInMemoryCompactionFlagCounter
private final CyclicBarrier	snapShotStartCyclicCyclicBarrier	Only the in memory compact thread enters CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action),the snapshot thread starts CompactingMemStore.snapshot(),because CompactingMemStore.snapshot() would invoke CompactingMemStore.stopCompaction().
private final AtomicInteger	swapPipelineWithNullCounter
private static final String	TAKE_SNAPSHOT_THREAD_NAME
private static final String	WRITE_AGAIN_THREAD_NAME
private final CyclicBarrier	writeMemStoreAgainEndCyclicBarrier	This is used for snapshot thread,writeAgain thread and in memory compact thread.
private final CyclicBarrier	writeMemStoreAgainStartCyclicBarrier	Only the snapshot thread retry CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList), writeAgain thread could start.

Fields inherited from class org.apache.hadoop.hbase.regionserver.CompactingMemStore

allowCompaction, COMPACTING_MEMSTORE_TYPE_DEFAULT, COMPACTING_MEMSTORE_TYPE_KEY, compactor, DEEP_OVERHEAD, IN_MEMORY_CONPACTION_POOL_SIZE_DEFAULT, IN_MEMORY_CONPACTION_POOL_SIZE_KEY, IN_MEMORY_FLUSH_THRESHOLD_FACTOR_KEY

Fields inherited from class org.apache.hadoop.hbase.regionserver.AbstractMemStore

FIXED_OVERHEAD, regionServices, snapshot, snapshotId

Constructor Summary

Constructors

Constructor	Description
MyCompactingMemStore5(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hbase.CellComparatorImpl cellComparator, org.apache.hadoop.hbase.regionserver.HStore store, org.apache.hadoop.hbase.regionserver.RegionServicesForStores regionServices, org.apache.hadoop.hbase.MemoryCompactionPolicy compactionPolicy)

Method Summary

Modifier and Type	Method	Description
void	flattenOneSegment(long requesterVersion, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action action)
org.apache.hadoop.hbase.regionserver.VersionedSegmentsList	getImmutableSegments()
(package private) void	inMemoryCompaction()
protected boolean	setInMemoryCompactionFlag()
protected boolean	swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList segments)

Methods inherited from class org.apache.hadoop.hbase.regionserver.CompactingMemStore

checkAndAddToActiveSize, createList, createMemStoreCompactor, debug, flushInMemory, flushInMemory, getFamilyName, getFlushableSize, getIndexType, getInmemoryFlushSize, getNextRow, getScanners, getSegments, getSmallestReadPoint, getStore, hasImmutableSegments, heapSize, isMemStoreFlushingInMemory, isSloppy, keySize, postUpdate, preFlushSeqIDEstimation, preUpdate, pushActiveToPipeline, setCompositeSnapshot, setIndexType, setInMemoryCompactionCompleted, size, sizeAddedPreOperation, snapshot, startReplayingFromWAL, stopReplayingFromWAL, swapCompactedSegments, updateLowestUnflushedSequenceIdInWAL

Methods inherited from class org.apache.hadoop.hbase.regionserver.AbstractMemStore

add, add, addToScanners, addToScanners, clearSnapshot, close, doAdd, doClearSnapShot, dump, getActive, getComparator, getConfiguration, getLowest, getNextRow, getSnapshot, getSnapshotSize, resetActive, resetTimeOfOldestEdit, timeOfOldestEdit, toString, upsert

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

TAKE_SNAPSHOT_THREAD_NAME

private static final String TAKE_SNAPSHOT_THREAD_NAME

See Also:

• Constant Field Values

WRITE_AGAIN_THREAD_NAME

private static final String WRITE_AGAIN_THREAD_NAME

See Also:

• Constant Field Values

flattenOneSegmentPreCyclicBarrier

private final CyclicBarrier flattenOneSegmentPreCyclicBarrier

CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) must execute after CompactingMemStore.getImmutableSegments()

flattenOneSegmentPostCyclicBarrier

private final CyclicBarrier flattenOneSegmentPostCyclicBarrier

Only after CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action) completed, CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList) could execute.

snapShotStartCyclicCyclicBarrier

private final CyclicBarrier snapShotStartCyclicCyclicBarrier

Only the in memory compact thread enters CompactingMemStore.flattenOneSegment(long, org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action),the snapshot thread starts CompactingMemStore.snapshot(),because CompactingMemStore.snapshot() would invoke CompactingMemStore.stopCompaction().

inMemoryCompactionEndCyclicBarrier

private final CyclicBarrier inMemoryCompactionEndCyclicBarrier

To wait for CompactingMemStore.InMemoryCompactionRunnable stopping.

getImmutableSegmentsListCounter

private final AtomicInteger getImmutableSegmentsListCounter

swapPipelineWithNullCounter

private final AtomicInteger swapPipelineWithNullCounter

flattenOneSegmentCounter

private final AtomicInteger flattenOneSegmentCounter

setInMemoryCompactionFlagCounter

private final AtomicInteger setInMemoryCompactionFlagCounter

writeMemStoreAgainStartCyclicBarrier

private final CyclicBarrier writeMemStoreAgainStartCyclicBarrier

Only the snapshot thread retry CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList), writeAgain thread could start.

writeMemStoreAgainEndCyclicBarrier

private final CyclicBarrier writeMemStoreAgainEndCyclicBarrier

This is used for snapshot thread,writeAgain thread and in memory compact thread. Only the writeAgain thread completes, CompactingMemStore.swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList) would execute,and in memory compact thread would exit,because we expect that in memory compact executing only once.

Constructor Details

MyCompactingMemStore5

public MyCompactingMemStore5(org.apache.hadoop.conf.Configuration conf,
 org.apache.hadoop.hbase.CellComparatorImpl cellComparator,
 org.apache.hadoop.hbase.regionserver.HStore store,
 org.apache.hadoop.hbase.regionserver.RegionServicesForStores regionServices,
 org.apache.hadoop.hbase.MemoryCompactionPolicy compactionPolicy)
                      throws IOException

Throws:

IOException

Method Details

getImmutableSegments

public org.apache.hadoop.hbase.regionserver.VersionedSegmentsList getImmutableSegments()

Overrides:

getImmutableSegments in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

swapPipelineWithNull

protected boolean swapPipelineWithNull(org.apache.hadoop.hbase.regionserver.VersionedSegmentsList segments)

Overrides:

swapPipelineWithNull in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

flattenOneSegment

public void flattenOneSegment(long requesterVersion,
 org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action action)

Overrides:

flattenOneSegment in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

setInMemoryCompactionFlag

protected boolean setInMemoryCompactionFlag()

Overrides:

setInMemoryCompactionFlag in class org.apache.hadoop.hbase.regionserver.CompactingMemStore

inMemoryCompaction

void inMemoryCompaction()

Overrides:

inMemoryCompaction in class org.apache.hadoop.hbase.regionserver.CompactingMemStore