Package org.apache.hadoop.hbase.coprocessor

Class TestWALObserver

java.lang.Object

org.apache.hadoop.hbase.coprocessor.TestWALObserver

@Tag("org.apache.hadoop.hbase.testclassification.CoprocessorTests") @Tag("org.apache.hadoop.hbase.testclassification.MediumTests")
public class TestWALObserver
extends Object

Tests invocation of the MasterObserver interface hooks at all appropriate times during normal HMaster operations.

Field Summary

Fields

Modifier and Type	Field	Description
private org.apache.hadoop.conf.Configuration	conf
private String	currentTestName
private org.apache.hadoop.fs.FileSystem	fs
private org.apache.hadoop.fs.Path	hbaseRootDir
private org.apache.hadoop.fs.Path	hbaseWALRootDir
private static final org.slf4j.Logger	LOG
private org.apache.hadoop.fs.Path	logDir
private org.apache.hadoop.fs.Path	oldLogDir
private static byte[][]	TEST_FAMILY
private static byte[][]	TEST_QUALIFIER
private static byte[]	TEST_ROW
private static byte[]	TEST_TABLE
private static final HBaseTestingUtil	TEST_UTIL
private static byte[][]	TEST_VALUE
private org.apache.hadoop.hbase.wal.WALFactory	wals

Constructor Summary

Constructors

Constructor	Description
TestWALObserver()

Method Summary

Modifier and Type	Method	Description
private void	addWALEdits(org.apache.hadoop.hbase.TableName tableName, org.apache.hadoop.hbase.client.RegionInfo hri, byte[] rowName, byte[] family, int count, org.apache.hadoop.hbase.util.EnvironmentEdge ee, org.apache.hadoop.hbase.wal.WAL wal, NavigableMap<byte[],Integer> scopes, org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl mvcc)
private org.apache.hadoop.hbase.client.TableDescriptor	createBasic3FamilyHTD(String tableName)
private org.apache.hadoop.hbase.client.RegionInfo	createBasicHRegionInfo(String tableName)	Creates an HRI around an HTD that has tableName.
private org.apache.hadoop.hbase.client.Put	creatPutWith2Families(byte[] row)
private void	deleteDir(org.apache.hadoop.fs.Path p)
private org.apache.hadoop.hbase.client.TableDescriptor	getBasic3FamilyHTableDescriptor(org.apache.hadoop.hbase.TableName tableName)
private SampleRegionWALCoprocessor	getCoprocessor(org.apache.hadoop.hbase.wal.WAL wal, Class<? extends SampleRegionWALCoprocessor> clazz)
private org.apache.hadoop.fs.Path	runWALSplit(org.apache.hadoop.conf.Configuration c)
void	setUp(org.junit.jupiter.api.TestInfo testInfo)
static void	setupBeforeClass()
void	tearDown()
static void	teardownAfterClass()
void	testEmptyWALEditAreNotSeen()	Coprocessors shouldn't get notice of empty waledits.
void	testWALCoprocessorReplay()	Test WAL replay behavior with WALObserver.
void	testWALObserverLoaded()	Test to see CP loaded successfully or not.
void	testWALObserverRoll()
void	testWALObserverWriteToWAL()	Test WAL write behavior with WALObserver.
private void	verifyWritesSeen(org.apache.hadoop.hbase.wal.WAL log, SampleRegionWALCoprocessor cp, boolean seesLegacy)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

private static final HBaseTestingUtil TEST_UTIL

TEST_TABLE

private static byte[] TEST_TABLE

TEST_FAMILY

private static byte[][] TEST_FAMILY

TEST_QUALIFIER

private static byte[][] TEST_QUALIFIER

TEST_VALUE

private static byte[][] TEST_VALUE

TEST_ROW

private static byte[] TEST_ROW

currentTestName

private String currentTestName

conf

private org.apache.hadoop.conf.Configuration conf

fs

private org.apache.hadoop.fs.FileSystem fs

hbaseRootDir

private org.apache.hadoop.fs.Path hbaseRootDir

hbaseWALRootDir

private org.apache.hadoop.fs.Path hbaseWALRootDir

oldLogDir

private org.apache.hadoop.fs.Path oldLogDir

logDir

private org.apache.hadoop.fs.Path logDir

wals

private org.apache.hadoop.hbase.wal.WALFactory wals

Constructor Details

TestWALObserver

public TestWALObserver()

Method Details

setupBeforeClass

@BeforeAll
public static void setupBeforeClass()
                             throws Exception

Throws:

Exception

teardownAfterClass

@AfterAll
public static void teardownAfterClass()
                               throws Exception

Throws:

Exception

setUp

@BeforeEach
public void setUp(org.junit.jupiter.api.TestInfo testInfo)
           throws Exception

Throws:

Exception

tearDown

@AfterEach
public void tearDown()
              throws Exception

Throws:

Exception

testWALObserverWriteToWAL

@Test
public void testWALObserverWriteToWAL()
                               throws Exception

Test WAL write behavior with WALObserver. The coprocessor monitors a WALEdit written to WAL, and ignore, modify, and add KeyValue's for the WALEdit.

Throws:

Exception

verifyWritesSeen

private void verifyWritesSeen(org.apache.hadoop.hbase.wal.WAL log,
 SampleRegionWALCoprocessor cp,
 boolean seesLegacy)
                       throws Exception

Throws:

Exception

testEmptyWALEditAreNotSeen

@Test
public void testEmptyWALEditAreNotSeen()
                                throws Exception

Coprocessors shouldn't get notice of empty waledits.

Throws:

Exception

testWALCoprocessorReplay

@Test
public void testWALCoprocessorReplay()
                              throws Exception

Test WAL replay behavior with WALObserver.

Throws:

Exception

testWALObserverLoaded

@Test
public void testWALObserverLoaded()
                           throws Exception

Test to see CP loaded successfully or not. There is a duplication at TestHLog, but the purpose of that one is to see whether the loaded CP will impact existing WAL tests or not.

Throws:

Exception

testWALObserverRoll

@Test
public void testWALObserverRoll()
                         throws Exception

Throws:

Exception

getCoprocessor

private SampleRegionWALCoprocessor getCoprocessor(org.apache.hadoop.hbase.wal.WAL wal,
 Class<? extends SampleRegionWALCoprocessor> clazz)
                                           throws Exception

Throws:

Exception

createBasicHRegionInfo

private org.apache.hadoop.hbase.client.RegionInfo createBasicHRegionInfo(String tableName)

Creates an HRI around an HTD that has tableName.

Parameters:

tableName - Name of table to use.

deleteDir

private void deleteDir(org.apache.hadoop.fs.Path p)
                throws IOException

Throws:

IOException

creatPutWith2Families

private org.apache.hadoop.hbase.client.Put creatPutWith2Families(byte[] row)
                                                          throws IOException

Throws:

IOException

runWALSplit

private org.apache.hadoop.fs.Path runWALSplit(org.apache.hadoop.conf.Configuration c)
                                       throws IOException

Throws:

IOException

addWALEdits

private void addWALEdits(org.apache.hadoop.hbase.TableName tableName,
 org.apache.hadoop.hbase.client.RegionInfo hri,
 byte[] rowName,
 byte[] family,
 int count,
 org.apache.hadoop.hbase.util.EnvironmentEdge ee,
 org.apache.hadoop.hbase.wal.WAL wal,
 NavigableMap<byte[],Integer> scopes,
 org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl mvcc)
                  throws IOException

Throws:

IOException

getBasic3FamilyHTableDescriptor

private org.apache.hadoop.hbase.client.TableDescriptor getBasic3FamilyHTableDescriptor(org.apache.hadoop.hbase.TableName tableName)

createBasic3FamilyHTD

private org.apache.hadoop.hbase.client.TableDescriptor createBasic3FamilyHTD(String tableName)