Package org.apache.hadoop.hbase.regionserver

Class TestMajorCompaction

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestMajorCompaction

@Tag("org.apache.hadoop.hbase.testclassification.RegionServerTests") @Tag("org.apache.hadoop.hbase.testclassification.LargeTests")
public class TestMajorCompaction
extends Object

Test major compactions

Field Summary

Fields

Modifier and Type	Field	Description
private static final byte[]	COLUMN_FAMILY
private static final byte[]	COLUMN_FAMILY_TEXT
private int	compactionThreshold
private final String	compType
protected org.apache.hadoop.conf.Configuration	conf
private org.apache.hadoop.hbase.client.TableDescriptor	htd
private static final org.slf4j.Logger	LOG
private static final long	MAX_FILES_TO_COMPACT
private String	name
private org.apache.hadoop.hbase.regionserver.HRegion	r
private byte[]	secondRowBytes
private final byte[]	STARTROW
private byte[]	thirdRowBytes
private static final HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
TestMajorCompaction(String compType)	constructor

Method Summary

Modifier and Type	Method	Description
private int	count()
private void	createSmallerStoreFile(org.apache.hadoop.hbase.regionserver.HRegion region)
private void	createStoreFile(org.apache.hadoop.hbase.regionserver.HRegion region)
private void	createStoreFile(org.apache.hadoop.hbase.regionserver.HRegion region, String family)
private void	majorCompaction()
void	majorCompactionWithDataBlockEncoding(boolean inCacheOnly)
static Stream<org.junit.jupiter.params.provider.Arguments>	parameters()
void	setUp(org.junit.jupiter.api.TestInfo testInfo)
void	tearDown()
void	testDataBlockEncodingEverywhere()
void	testDataBlockEncodingInCacheOnly()
void	testMajorCompactingToNoOutput()	Test that on a major compaction, if all cells are expired or deleted, then we'll end up with no product.
void	testMajorCompactingToNoOutputWithReverseScan()	Test that on a major compaction, if all cells are expired or deleted, then we'll end up with no product.
private void	testMajorCompactingWithDeletes(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells)
void	testMajorCompactingWithKeepDeletedCells()	Test that on a major compaction,Deleted cells are retained if keep deleted cells is set to true
void	testMajorCompaction()	Run compaction and flushing memstore Assert deletes get cleaned up.
void	testNonUserMajorCompactionRequest()	Test for HBASE-5920 - Test user requested major compactions always occurring
void	testTimeBasedMajorCompaction()
void	testUserMajorCompactionRequest()	Test for HBASE-5920
private void	verifyCounts(int countRow1, int countRow2)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtil UTIL

conf

protected org.apache.hadoop.conf.Configuration conf

name

private String name

compType

private final String compType

r

private org.apache.hadoop.hbase.regionserver.HRegion r

htd

private org.apache.hadoop.hbase.client.TableDescriptor htd

COLUMN_FAMILY

private static final byte[] COLUMN_FAMILY

STARTROW

private final byte[] STARTROW

COLUMN_FAMILY_TEXT

private static final byte[] COLUMN_FAMILY_TEXT

compactionThreshold

private int compactionThreshold

secondRowBytes

private byte[] secondRowBytes

thirdRowBytes

private byte[] thirdRowBytes

MAX_FILES_TO_COMPACT

private static final long MAX_FILES_TO_COMPACT

See Also:

• Constant Field Values

Constructor Details

TestMajorCompaction

public TestMajorCompaction(String compType)

constructor

Method Details

parameters

public static Stream<org.junit.jupiter.params.provider.Arguments> parameters()

setUp

@BeforeEach
public void setUp(org.junit.jupiter.api.TestInfo testInfo)
           throws Exception

Throws:

Exception

tearDown

@AfterEach
public void tearDown()
              throws Exception

Throws:

Exception

testMajorCompactingToNoOutput

@TestTemplate
public void testMajorCompactingToNoOutput()
                                   throws IOException

Test that on a major compaction, if all cells are expired or deleted, then we'll end up with no product. Make sure scanner over region returns right answer in this case - and that it just basically works.

Throws:

IOException - exception encountered

testMajorCompactingWithKeepDeletedCells

@TestTemplate
public void testMajorCompactingWithKeepDeletedCells()
                                             throws IOException

Test that on a major compaction,Deleted cells are retained if keep deleted cells is set to true

Throws:

IOException - exception encountered

testMajorCompaction

@TestTemplate
public void testMajorCompaction()
                         throws Exception

Run compaction and flushing memstore Assert deletes get cleaned up.

Throws:

Exception

testDataBlockEncodingInCacheOnly

@TestTemplate
public void testDataBlockEncodingInCacheOnly()
                                      throws Exception

Throws:

Exception

testDataBlockEncodingEverywhere

@TestTemplate
public void testDataBlockEncodingEverywhere()
                                     throws Exception

Throws:

Exception

majorCompactionWithDataBlockEncoding

public void majorCompactionWithDataBlockEncoding(boolean inCacheOnly)
                                          throws Exception

Throws:

Exception

majorCompaction

private void majorCompaction()
                      throws Exception

Throws:

Exception

testTimeBasedMajorCompaction

@TestTemplate
public void testTimeBasedMajorCompaction()
                                  throws Exception

Throws:

Exception

verifyCounts

private void verifyCounts(int countRow1,
 int countRow2)
                   throws Exception

Throws:

Exception

count

private int count()
           throws IOException

Throws:

IOException

createStoreFile

private void createStoreFile(org.apache.hadoop.hbase.regionserver.HRegion region)
                      throws IOException

Throws:

IOException

createStoreFile

private void createStoreFile(org.apache.hadoop.hbase.regionserver.HRegion region,
 String family)
                      throws IOException

Throws:

IOException

createSmallerStoreFile

private void createSmallerStoreFile(org.apache.hadoop.hbase.regionserver.HRegion region)
                             throws IOException

Throws:

IOException

testNonUserMajorCompactionRequest

@TestTemplate
public void testNonUserMajorCompactionRequest()
                                       throws Exception

Test for HBASE-5920 - Test user requested major compactions always occurring

Throws:

Exception

testUserMajorCompactionRequest

@TestTemplate
public void testUserMajorCompactionRequest()
                                    throws IOException

Test for HBASE-5920

Throws:

IOException

testMajorCompactingToNoOutputWithReverseScan

@TestTemplate
public void testMajorCompactingToNoOutputWithReverseScan()
                                                  throws IOException

Test that on a major compaction, if all cells are expired or deleted, then we'll end up with no product. Make sure scanner over region returns right answer in this case - and that it just basically works.

Throws:

IOException

testMajorCompactingWithDeletes

private void testMajorCompactingWithDeletes(org.apache.hadoop.hbase.KeepDeletedCells keepDeletedCells)
                                     throws IOException

Throws:

IOException