org.apache.hadoop.hbase.regionserver.wal

Class AbstractTestFSWAL

java.lang.Object

org.apache.hadoop.hbase.regionserver.wal.AbstractTestFSWAL

Direct Known Subclasses:

TestAsyncFSWAL, TestFSHLog

public abstract class AbstractTestFSWAL
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.apache.hadoop.conf.Configuration	CONF
org.junit.rules.TestName	currentTest
protected static org.apache.hadoop.fs.Path	DIR
protected static org.apache.hadoop.fs.FileSystem	FS
protected static org.slf4j.Logger	LOG
protected static HBaseTestingUtility	TEST_UTIL

Constructor Summary

Constructors

Constructor and Description
AbstractTestFSWAL()

Method Summary

Modifier and Type	Method and Description
protected void	addEdits(org.apache.hadoop.hbase.wal.WAL log, org.apache.hadoop.hbase.client.RegionInfo hri, org.apache.hadoop.hbase.client.TableDescriptor htd, int times, org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl mvcc, NavigableMap<byte[],Integer> scopes)
protected void	flushRegion(org.apache.hadoop.hbase.wal.WAL wal, byte[] regionEncodedName, Set<byte[]> flushedFamilyNames) helper method to simulate region flush for a WAL.
protected abstract org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL<?>	newSlowWAL(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path rootDir, String WALDir, String archiveDir, org.apache.hadoop.conf.Configuration conf, List<org.apache.hadoop.hbase.regionserver.wal.WALActionsListener> listeners, boolean failIfWALExists, String prefix, String suffix, Runnable action)
protected abstract org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL<?>	newWAL(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path rootDir, String WALDir, String archiveDir, org.apache.hadoop.conf.Configuration conf, List<org.apache.hadoop.hbase.regionserver.wal.WALActionsListener> listeners, boolean failIfWALExists, String prefix, String suffix)
void	setUp()
static void	setUpBeforeClass()
static void	tearDownAfterClass()
void	testFailedToCreateWALIfParentRenamed()
void	testFindMemStoresEligibleForFlush() On rolling a wal after reaching the threshold, WAL.rollWriter() returns the list of regions which should be flushed in order to archive the oldest wal file.
void	testFlushSequenceIdIsGreaterThanAllEditsInHFile() Test flush for sure has a sequence id that is beyond the last edit appended.
void	testSyncNoAppend()
void	testUnflushedSeqIdTrackingWithAsyncWal()
void	testWALComparator() tests the log comparator.
void	testWALCoprocessorLoaded() A loaded WAL coprocessor won't break existing WAL test cases.
void	testWriteEntryCanBeNull()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final org.slf4j.Logger LOG

CONF

protected static org.apache.hadoop.conf.Configuration CONF

FS

protected static org.apache.hadoop.fs.FileSystem FS

DIR

protected static org.apache.hadoop.fs.Path DIR

TEST_UTIL

protected static final HBaseTestingUtility TEST_UTIL

currentTest

public final org.junit.rules.TestName currentTest

Constructor Detail

AbstractTestFSWAL

public AbstractTestFSWAL()

Method Detail

setUp

public void setUp()
           throws Exception

Throws:

Exception

setUpBeforeClass

public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

newWAL

protected abstract org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL<?> newWAL(org.apache.hadoop.fs.FileSystem fs,
                                                                                    org.apache.hadoop.fs.Path rootDir,
                                                                                    String WALDir,
                                                                                    String archiveDir,
                                                                                    org.apache.hadoop.conf.Configuration conf,
                                                                                    List<org.apache.hadoop.hbase.regionserver.wal.WALActionsListener> listeners,
                                                                                    boolean failIfWALExists,
                                                                                    String prefix,
                                                                                    String suffix)
                                                                             throws IOException

Throws:

IOException

newSlowWAL

protected abstract org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL<?> newSlowWAL(org.apache.hadoop.fs.FileSystem fs,
                                                                                        org.apache.hadoop.fs.Path rootDir,
                                                                                        String WALDir,
                                                                                        String archiveDir,
                                                                                        org.apache.hadoop.conf.Configuration conf,
                                                                                        List<org.apache.hadoop.hbase.regionserver.wal.WALActionsListener> listeners,
                                                                                        boolean failIfWALExists,
                                                                                        String prefix,
                                                                                        String suffix,
                                                                                        Runnable action)
                                                                                 throws IOException

Throws:

IOException

testWALCoprocessorLoaded

public void testWALCoprocessorLoaded()
                              throws Exception

A loaded WAL coprocessor won't break existing WAL test cases.

Throws:

Exception

addEdits

protected void addEdits(org.apache.hadoop.hbase.wal.WAL log,
                        org.apache.hadoop.hbase.client.RegionInfo hri,
                        org.apache.hadoop.hbase.client.TableDescriptor htd,
                        int times,
                        org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl mvcc,
                        NavigableMap<byte[],Integer> scopes)
                 throws IOException

Throws:

IOException

flushRegion

protected void flushRegion(org.apache.hadoop.hbase.wal.WAL wal,
                           byte[] regionEncodedName,
                           Set<byte[]> flushedFamilyNames)

helper method to simulate region flush for a WAL.

Parameters:

wal -

regionEncodedName -

testWALComparator

public void testWALComparator()
                       throws Exception

tests the log comparator. Ensure that we are not mixing meta logs with non-meta logs (throws exception if we do). Comparison is based on the timestamp present in the wal name.

Throws:

Exception

testFindMemStoresEligibleForFlush

public void testFindMemStoresEligibleForFlush()
                                       throws Exception

On rolling a wal after reaching the threshold, WAL.rollWriter() returns the list of regions which should be flushed in order to archive the oldest wal file.

This method tests this behavior by inserting edits and rolling the wal enough times to reach the max number of logs threshold. It checks whether we get the "right regions" for flush on rolling the wal.

Throws:

Exception

testFailedToCreateWALIfParentRenamed

public void testFailedToCreateWALIfParentRenamed()
                                          throws IOException,
                                                 org.apache.hadoop.hbase.util.CommonFSUtils.StreamLacksCapabilityException

Throws:

IOException

org.apache.hadoop.hbase.util.CommonFSUtils.StreamLacksCapabilityException

testFlushSequenceIdIsGreaterThanAllEditsInHFile

public void testFlushSequenceIdIsGreaterThanAllEditsInHFile()
                                                     throws IOException

Test flush for sure has a sequence id that is beyond the last edit appended. We do this by slowing appends in the background ring buffer thread while in foreground we call flush. The addition of the sync over HRegion in flush should fix an issue where flush was returning before all of its appends had made it out to the WAL (HBASE-11109).

Throws:

IOException

See Also:

HBASE-11109

testSyncNoAppend

public void testSyncNoAppend()
                      throws IOException

Throws:

IOException

testWriteEntryCanBeNull

public void testWriteEntryCanBeNull()
                             throws IOException

Throws:

IOException

testUnflushedSeqIdTrackingWithAsyncWal

public void testUnflushedSeqIdTrackingWithAsyncWal()
                                            throws IOException,
                                                   InterruptedException

Throws:

IOException

InterruptedException