Package org.apache.hadoop.hbase.regionserver

Class TestCompactingToCellFlatMapMemStore

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestDefaultMemStore

org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

org.apache.hadoop.hbase.regionserver.TestCompactingToCellFlatMapMemStore

@Tag("org.apache.hadoop.hbase.testclassification.RegionServerTests") @Tag("org.apache.hadoop.hbase.testclassification.MediumTests")
@ParameterizedClass(name="{index}: type={0}")
@MethodSource("parameters")
public class TestCompactingToCellFlatMapMemStore
extends TestCompactingMemStore

compacted memstore test case

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

TestCompactingMemStore.MyCompactingMemStore

Field Summary

Fields

Modifier and Type	Field	Description
(package private) org.apache.hadoop.conf.Configuration	conf
private static final org.slf4j.Logger	LOG
final boolean	toCellChunkMap
private final String	type

Fields inherited from class org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

chunkCreator, region, regionServicesForStores, store

Fields inherited from class org.apache.hadoop.hbase.regionserver.TestDefaultMemStore

FAMILY, memstore, mvcc, name, QUALIFIER_COUNT, ROW_COUNT, SCAN_ROW_COUNT

Constructor Summary

Constructors

Constructor	Description
TestCompactingToCellFlatMapMemStore(String type)

Method Summary

Modifier and Type	Method	Description
private long	addRowsByKeysDataSize(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc, String[] keys)
private void	addRowsByKeysWith50Cols(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc, String[] keys)
private long	cellAfterFlushSize()
private long	cellBeforeFlushSize()
protected void	createMemStore()
protected String	getParameterizedTestNameSuffix()
static Stream<org.junit.jupiter.params.provider.Arguments>	parameters()
void	testBigCellSizeAfterInMemoryCompaction()	Test big cell size after in memory compaction.
void	testCompaction1Bucket()
void	testCompaction2Buckets()
void	testCompaction3Buckets()
void	testCountOfCellsAfterFlatteningByIterator()
void	testCountOfCellsAfterFlatteningByScan()
void	testFlatteningToBigCellChunkMap()	CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks.
void	testFlatteningToCellChunkMap()
void	testFlatteningToJumboCellChunkMap()	CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks.
void	testForceCopyOfBigCellIntoImmutableSegment()	CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks.
void	testMerging()
void	testPuttingBackChunksAfterFlushing()
void	testPuttingBackChunksWithOpeningScanner()
void	testScan()
private void	testTimeRange(boolean isCompaction)
void	testTimeRangeAfterCompaction()
void	testTimeRangeAfterMerge()

Methods inherited from class org.apache.hadoop.hbase.regionserver.TestCompactingMemStore

addRowsByKeys, addRowsByKeys, createChunkCreator, internalSetUp, internalTearDown, testGet_memstoreAndSnapShot, testGetNextRow, testMagicCompaction3Buckets, testPuttingBackChunksWithOpeningPipelineScanner, testScanAcrossSnapshot2, testSnapshotting, testTimeOfOldestEdit, testUpdateToTimeOfOldestEdit, testUpsertMemstoreSize

Methods inherited from class org.apache.hadoop.hbase.regionserver.TestDefaultMemStore

addRows, addRows, assertScannerResults, checkShouldFlush, getTestName, makeQualifier, scanMemStore, setUp, tearDown, tearDownClass, testBytesReadFromMemstore, testBytesReadFromMemstoreWithScanMetricsDisabled, testGetWithDelete, testGetWithDeleteColumn, testGetWithDeleteFamily, testKeepDeleteInmemstore, testMemstoreConcurrentControl, testMemstoreDeletesVisibilityWithSameKey, testMemstoreEditsVisibilityWithSameKey, testMultipleVersionsSimple, testPutSameCell, testPutSameKey, testReadOwnWritesUnderConcurrency, testRetainsDeleteColumn, testRetainsDeleteFamily, testRetainsDeleteVersion, testScanAcrossSnapshot, testShouldFlush, testShouldFlushMeta, verifyOneScanAcrossSnapshot2, verifyScanAcrossSnapshot2

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

toCellChunkMap

public final boolean toCellChunkMap

type

private final String type

conf

org.apache.hadoop.conf.Configuration conf

Constructor Details

TestCompactingToCellFlatMapMemStore

public TestCompactingToCellFlatMapMemStore(String type)

Method Details

parameters

public static Stream<org.junit.jupiter.params.provider.Arguments> parameters()

getParameterizedTestNameSuffix

protected String getParameterizedTestNameSuffix()

Overrides:

getParameterizedTestNameSuffix in class TestDefaultMemStore

createMemStore

protected void createMemStore()
                       throws IOException

Overrides:

createMemStore in class TestCompactingMemStore

Throws:

IOException

testCompaction1Bucket

@Test
public void testCompaction1Bucket()
                           throws IOException

Overrides:

testCompaction1Bucket in class TestCompactingMemStore

Throws:

IOException

testCompaction2Buckets

@Test
public void testCompaction2Buckets()
                            throws IOException

Overrides:

testCompaction2Buckets in class TestCompactingMemStore

Throws:

IOException

testCompaction3Buckets

@Test
public void testCompaction3Buckets()
                            throws IOException

Overrides:

testCompaction3Buckets in class TestCompactingMemStore

Throws:

IOException

testMerging

@Test
public void testMerging()
                 throws IOException

Throws:

IOException

testTimeRangeAfterCompaction

@Test
public void testTimeRangeAfterCompaction()
                                  throws IOException

Throws:

IOException

testTimeRangeAfterMerge

@Test
public void testTimeRangeAfterMerge()
                             throws IOException

Throws:

IOException

testTimeRange

private void testTimeRange(boolean isCompaction)
                    throws IOException

Throws:

IOException

testCountOfCellsAfterFlatteningByScan

@Test
public void testCountOfCellsAfterFlatteningByScan()
                                           throws IOException

Throws:

IOException

testCountOfCellsAfterFlatteningByIterator

@Test
public void testCountOfCellsAfterFlatteningByIterator()
                                               throws IOException

Throws:

IOException

addRowsByKeysWith50Cols

private void addRowsByKeysWith50Cols(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc,
 String[] keys)

testPuttingBackChunksWithOpeningScanner

@Test
public void testPuttingBackChunksWithOpeningScanner()
                                             throws IOException

Overrides:

testPuttingBackChunksWithOpeningScanner in class TestCompactingMemStore

Throws:

IOException

testPuttingBackChunksAfterFlushing

@Test
public void testPuttingBackChunksAfterFlushing()
                                        throws IOException

Overrides:

testPuttingBackChunksAfterFlushing in class TestCompactingMemStore

Throws:

IOException

testFlatteningToCellChunkMap

@Test
public void testFlatteningToCellChunkMap()
                                  throws IOException

Throws:

IOException

testFlatteningToBigCellChunkMap

@Test
public void testFlatteningToBigCellChunkMap()
                                     throws IOException

CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks. Even though MSLAB is enabled, cells bigger than maxAlloc (even if smaller than the size of a chunk) are not written in the MSLAB Chunks. If such cells are found in the process of flattening into CellChunkMap (in-memory-flush) they need to be copied into MSLAB. testFlatteningToBigCellChunkMap checks that the process of flattening into CellChunkMap succeeds, even when such big cells are allocated.

Throws:

IOException

testFlatteningToJumboCellChunkMap

@Test
public void testFlatteningToJumboCellChunkMap()
                                       throws IOException

CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks. Even though MSLAB is enabled, cells bigger than the size of a chunk are not written in the MSLAB Chunks. If such cells are found in the process of flattening into CellChunkMap (in-memory-flush) they need to be copied into MSLAB. testFlatteningToJumboCellChunkMap checks that the process of flattening into CellChunkMap succeeds, even when such big cells are allocated.

Throws:

IOException

testForceCopyOfBigCellIntoImmutableSegment

@Disabled
@Test
public void testForceCopyOfBigCellIntoImmutableSegment()
                                                throws IOException

CellChunkMap Segment index requires all cell data to be written in the MSLAB Chunks. Even though MSLAB is enabled, cells bigger than the size of a chunk are not written in the MSLAB Chunks. If such cells are found in the process of a merge they need to be copied into MSLAB. testForceCopyOfBigCellIntoImmutableSegment checks that the ImmutableMemStoreLAB's forceCopyOfBigCellInto does what it's supposed to do.

Throws:

IOException

testBigCellSizeAfterInMemoryCompaction

@Test
public void testBigCellSizeAfterInMemoryCompaction()
                                            throws IOException

Test big cell size after in memory compaction. (HBASE-26467)

Throws:

IOException

testScan

@Test
public void testScan()
              throws IOException

Overrides:

testScan in class TestCompactingMemStore

Throws:

IOException

addRowsByKeysDataSize

private long addRowsByKeysDataSize(org.apache.hadoop.hbase.regionserver.AbstractMemStore hmc,
 String[] keys)

cellBeforeFlushSize

private long cellBeforeFlushSize()

cellAfterFlushSize

private long cellAfterFlushSize()