Package org.apache.hadoop.hbase.regionserver

Class TestCompactingToCellFlatMapMemStore

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestDefaultMemStore

org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore

public class TestCompactingToCellFlatMapMemStore
extends TestCompactingMemStore

compacted memstore test case

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

TestCompactingMemStore.MyCompactingMemStore

Field Summary

Fields

Modifier and Type	Field	Description
static final HBaseClassTestRule	CLASS_RULE
(package private) org.apache.hadoop.conf.Configuration	conf
private static final org.slf4j.Logger	LOG
final boolean	toCellChunkMap

Fields inherited from class org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

chunkCreator, region, regionServicesForStores, store

Fields inherited from class org.apache.hadoop.hbase.regionserver.TestDefaultMemStore

FAMILY, memstore, mvcc, name, QUALIFIER_COUNT, ROW_COUNT, startSeqNum

Constructor Summary

Constructors

Constructor	Description
TestCompactingToCellFlatMapMemStore(String type)

Method Summary

Modifier and Type	Method	Description
private long	addRowsByKeysDataSize(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc, String[] keys)
private void	addRowsByKeysWith50Cols(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc, String[] keys)
private long	cellAfterFlushSize()
private long	cellBeforeFlushSize()
static Object[]	data()
void	setUp()
void	tearDown()
void	testBigCellSizeAfterInMemoryCompaction()	Test big cell size after in memory compaction.
void	testCompaction1Bucket()
void	testCompaction2Buckets()
void	testCompaction3Buckets()
void	testCountOfCellsAfterFlatteningByIterator()
void	testCountOfCellsAfterFlatteningByScan()
void	testFlatteningToBigCellChunkMap()	CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks.
void	testFlatteningToCellChunkMap()
void	testFlatteningToJumboCellChunkMap()	CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks.
void	testForceCopyOfBigCellIntoImmutableSegment()	CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks.
void	testMerging()
void	testPuttingBackChunksAfterFlushing()
void	testPuttingBackChunksWithOpeningScanner()
private void	testTimeRange(boolean isCompaction)
void	testTimeRangeAfterCompaction()
void	testTimeRangeAfterMerge()

Methods inherited from class org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

addRowsByKeys, addRowsByKeys, compactingSetUp, makeQualifier, testGet_memstoreAndSnapShot, testGetNextRow, testMagicCompaction3Buckets, testPuttingBackChunksWithOpeningPipelineScanner, testScanAcrossSnapshot2, testSnapshotting, testTimeOfOldestEdit, testUpdateToTimeOfOldestEdit, testUpsertMemstoreSize

Methods inherited from class org.apache.hadoop.hbase.regionserver.TestDefaultMemStore

addRows, addRows, assertScannerResults, checkShouldFlush, doScan, internalSetUp, main, tearDownClass, testBytesReadFromMemstore, testBytesReadFromMemstoreWithScanMetricsDisabled, testGetWithDelete, testGetWithDeleteColumn, testGetWithDeleteFamily, testKeepDeleteInmemstore, testMemstoreConcurrentControl, testMemstoreDeletesVisibilityWithSameKey, testMemstoreEditsVisibilityWithSameKey, testMultipleVersionsSimple, testPutSameCell, testPutSameKey, testReadOwnWritesUnderConcurrency, testRetainsDeleteColumn, testRetainsDeleteFamily, testRetainsDeleteVersion, testScanAcrossSnapshot, testShouldFlush, testShouldFlushMeta, verifyOneScanAcrossSnapshot2, verifyScanAcrossSnapshot2

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

toCellChunkMap

public final boolean toCellChunkMap

conf

org.apache.hadoop.conf.Configuration conf

Constructor Details

TestCompactingToCellFlatMapMemStore

public TestCompactingToCellFlatMapMemStore(String type)

Method Details

data

public static Object[] data()

tearDown

public void tearDown()
              throws Exception

Overrides:

tearDown in class TestCompactingMemStore

Throws:

Exception

setUp

public void setUp()
           throws Exception

Overrides:

setUp in class TestCompactingMemStore

Throws:

Exception

testCompaction1Bucket

public void testCompaction1Bucket()
                           throws IOException

Overrides:

testCompaction1Bucket in class TestCompactingMemStore

Throws:

IOException

testCompaction2Buckets

public void testCompaction2Buckets()
                            throws IOException

Overrides:

testCompaction2Buckets in class TestCompactingMemStore

Throws:

IOException

testCompaction3Buckets

public void testCompaction3Buckets()
                            throws IOException

Overrides:

testCompaction3Buckets in class TestCompactingMemStore

Throws:

IOException

testMerging

public void testMerging()
                 throws IOException

Throws:

IOException

testTimeRangeAfterCompaction

public void testTimeRangeAfterCompaction()
                                  throws IOException

Throws:

IOException

testTimeRangeAfterMerge

public void testTimeRangeAfterMerge()
                             throws IOException

Throws:

IOException

testTimeRange

private void testTimeRange(boolean isCompaction)
                    throws IOException

Throws:

IOException

testCountOfCellsAfterFlatteningByScan

public void testCountOfCellsAfterFlatteningByScan()
                                           throws IOException

Throws:

IOException

testCountOfCellsAfterFlatteningByIterator

public void testCountOfCellsAfterFlatteningByIterator()
                                               throws IOException

Throws:

IOException

addRowsByKeysWith50Cols

private void addRowsByKeysWith50Cols(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc,
 String[] keys)

testPuttingBackChunksWithOpeningScanner

public void testPuttingBackChunksWithOpeningScanner()
                                             throws IOException

Overrides:

testPuttingBackChunksWithOpeningScanner in class TestCompactingMemStore

Throws:

IOException

testPuttingBackChunksAfterFlushing

public void testPuttingBackChunksAfterFlushing()
                                        throws IOException

Overrides:

testPuttingBackChunksAfterFlushing in class TestCompactingMemStore

Throws:

IOException

testFlatteningToCellChunkMap

public void testFlatteningToCellChunkMap()
                                  throws IOException

Throws:

IOException

testFlatteningToBigCellChunkMap

public void testFlatteningToBigCellChunkMap()
                                     throws IOException

CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks. Even though MSLAB is enabled, cells bigger than maxAlloc (even if smaller than the size of a chunk) are not written in the MSLAB Chunks. If such cells are found in the process of flattening into CellChunkMap (in-memory-flush) they need to be copied into MSLAB. testFlatteningToBigCellChunkMap checks that the process of flattening into CellChunkMap succeeds, even when such big cells are allocated.

Throws:

IOException

testFlatteningToJumboCellChunkMap

public void testFlatteningToJumboCellChunkMap()
                                       throws IOException

CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks. Even though MSLAB is enabled, cells bigger than the size of a chunk are not written in the MSLAB Chunks. If such cells are found in the process of flattening into CellChunkMap (in-memory-flush) they need to be copied into MSLAB. testFlatteningToJumboCellChunkMap checks that the process of flattening into CellChunkMap succeeds, even when such big cells are allocated.

Throws:

IOException

testForceCopyOfBigCellIntoImmutableSegment

public void testForceCopyOfBigCellIntoImmutableSegment()
                                                throws IOException

CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks. Even though MSLAB is enabled, cells bigger than the size of a chunk are not written in the MSLAB Chunks. If such cells are found in the process of a merge they need to be copied into MSLAB. testForceCopyOfBigCellIntoImmutableSegment checks that the ImmutableMemStoreLAB's forceCopyOfBigCellInto does what it's supposed to do.

Throws:

IOException

testBigCellSizeAfterInMemoryCompaction

public void testBigCellSizeAfterInMemoryCompaction()
                                            throws IOException

Test big cell size after in memory compaction. (HBASE-26467)

Throws:

IOException

addRowsByKeysDataSize

private long addRowsByKeysDataSize(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc,
 String[] keys)

cellBeforeFlushSize

private long cellBeforeFlushSize()

cellAfterFlushSize

private long cellAfterFlushSize()