Package org.apache.hadoop.hbase.regionserver

Class TestScanner

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestScanner

@Tag("org.apache.hadoop.hbase.testclassification.RegionServerTests") @Tag("org.apache.hadoop.hbase.testclassification.MediumTests")
public class TestScanner
extends Object

Test of a long-lived scanner validating as we go.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static final class	TestScanner.RecordingStoreScanner
private static final class	TestScanner.TrackingRowComparator

Field Summary

Fields

Modifier and Type	Field	Description
private final byte[]	col1
private static final byte[][]	COLS
private static final byte[][]	EXPLICIT_COLS
private static final byte[]	FIRST_ROW
private byte[]	firstRowBytes
private static final byte[]	LAZY_SEEK_FAMILY
private static final byte[]	LAZY_SEEK_QUALIFIER
private static final byte[]	LAZY_SEEK_ROW
private static final org.slf4j.Logger	LOG
private org.apache.hadoop.hbase.regionserver.HRegion	region
static final org.apache.hadoop.hbase.client.RegionInfo	REGION_INFO	HRegionInfo for root region
private static final byte[]	ROW_KEY
private byte[]	secondRowBytes
private static final long	START_CODE
private static final HBaseTestingUtil	TEST_UTIL
(package private) static final org.apache.hadoop.hbase.client.TableDescriptor	TESTTABLEDESC
private byte[]	thirdRowBytes

Constructor Summary

Constructors

Constructor	Description
TestScanner()

Method Summary

Modifier and Type	Method	Description
private void	assertInitialLazySeek(org.apache.hadoop.hbase.client.Scan scan, boolean lazySeekEnabled, boolean expected)
private int	count(org.apache.hadoop.hbase.client.Table countTable, int flushIndex, boolean concurrent)	Count table.
private org.apache.hadoop.hbase.regionserver.HStore	createLazySeekTestStore()
private org.apache.hadoop.hbase.Cell	getColumn(List<org.apache.hadoop.hbase.Cell> kvs, byte[] family, byte[] qualifier)
private void	getRegionInfo(org.apache.hadoop.hbase.client.Table table)	Use get to retrieve the HRegionInfo and validate it
private boolean	hasColumn(List<org.apache.hadoop.hbase.Cell> kvs, byte[] family, byte[] qualifier)
(package private) void	rowInclusiveStopFilter(org.apache.hadoop.hbase.client.Scan scan, byte[] stopRow)
(package private) void	rowPrefixFilter(org.apache.hadoop.hbase.client.Scan scan)
private void	scan(boolean validateStartcode, String serverName)	Use a scanner to get the region info and then validate the results
void	testFilterComparatorOnlySeesActualRows()
void	testFilters()
void	testInitialLazySeekForAllColumnScan()
void	testInitialLazySeekForFilteredGet()
void	testInitialLazySeekForFilteredNonGetScan()
void	testInitialLazySeekForUnfilteredExplicitColumnScan()
void	testInitialLazySeekWhenDisabledGlobally()
void	testRaceBetweenClientAndTimeout()	Test that closing a scanner while a client is using it doesn't throw NPEs but instead a UnknownScannerException.
void	testScanAndConcurrentMajorCompact(org.junit.jupiter.api.TestInfo testInfo)	Make sure scanner returns correct result when we run a major compaction with deletes.
void	testScanAndRealConcurrentFlush()	Tests to do a concurrent flush (using a 2nd thread) while scanning.
void	testScanAndSyncFlush()	Tests to do a sync flush during the middle of a scan.
void	testScanner()	The test!
void	testStopRow()	Test basic stop row filter works.
void	testWhileMatchFilterOnlySeesActualRows()
private void	validateRegionInfo(byte[] regionBytes)	Compare the HRegionInfo we read from HBase to what we stored

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

private static final HBaseTestingUtil TEST_UTIL

FIRST_ROW

private static final byte[] FIRST_ROW

COLS

private static final byte[][] COLS

EXPLICIT_COLS

private static final byte[][] EXPLICIT_COLS

TESTTABLEDESC

static final org.apache.hadoop.hbase.client.TableDescriptor TESTTABLEDESC

REGION_INFO

public static final org.apache.hadoop.hbase.client.RegionInfo REGION_INFO

HRegionInfo for root region

ROW_KEY

private static final byte[] ROW_KEY

START_CODE

private static final long START_CODE

See Also:

• Constant Field Values

LAZY_SEEK_FAMILY

private static final byte[] LAZY_SEEK_FAMILY

LAZY_SEEK_QUALIFIER

private static final byte[] LAZY_SEEK_QUALIFIER

LAZY_SEEK_ROW

private static final byte[] LAZY_SEEK_ROW

region

private org.apache.hadoop.hbase.regionserver.HRegion region

firstRowBytes

private byte[] firstRowBytes

secondRowBytes

private byte[] secondRowBytes

thirdRowBytes

private byte[] thirdRowBytes

col1

private final byte[] col1

Constructor Details

TestScanner

public TestScanner()

Method Details

testFilterComparatorOnlySeesActualRows

@Test
public void testFilterComparatorOnlySeesActualRows()
                                            throws Exception

Throws:

Exception

testWhileMatchFilterOnlySeesActualRows

@Test
public void testWhileMatchFilterOnlySeesActualRows()
                                            throws Exception

Throws:

Exception

testInitialLazySeekForUnfilteredExplicitColumnScan

@Test
public void testInitialLazySeekForUnfilteredExplicitColumnScan()
                                                        throws Exception

Throws:

Exception

testInitialLazySeekForFilteredGet

@Test
public void testInitialLazySeekForFilteredGet()
                                       throws Exception

Throws:

Exception

testInitialLazySeekForFilteredNonGetScan

@Test
public void testInitialLazySeekForFilteredNonGetScan()
                                              throws Exception

Throws:

Exception

testInitialLazySeekForAllColumnScan

@Test
public void testInitialLazySeekForAllColumnScan()
                                         throws Exception

Throws:

Exception

testInitialLazySeekWhenDisabledGlobally

@Test
public void testInitialLazySeekWhenDisabledGlobally()
                                             throws Exception

Throws:

Exception

assertInitialLazySeek

private void assertInitialLazySeek(org.apache.hadoop.hbase.client.Scan scan,
 boolean lazySeekEnabled,
 boolean expected)
                            throws IOException

Throws:

IOException

createLazySeekTestStore

private org.apache.hadoop.hbase.regionserver.HStore createLazySeekTestStore()
                                                                     throws IOException

Throws:

IOException

testStopRow

@Test
public void testStopRow()
                 throws Exception

Test basic stop row filter works.

Throws:

Exception

rowPrefixFilter

void rowPrefixFilter(org.apache.hadoop.hbase.client.Scan scan)
              throws IOException

Throws:

IOException

rowInclusiveStopFilter

void rowInclusiveStopFilter(org.apache.hadoop.hbase.client.Scan scan,
 byte[] stopRow)
                     throws IOException

Throws:

IOException

testFilters

@Test
public void testFilters()
                 throws IOException

Throws:

IOException

testRaceBetweenClientAndTimeout

@Test
public void testRaceBetweenClientAndTimeout()
                                     throws Exception

Test that closing a scanner while a client is using it doesn't throw NPEs but instead a UnknownScannerException. HBASE-2503

Throws:

Exception

testScanner

@Test
public void testScanner()
                 throws IOException

The test!

Throws:

IOException

validateRegionInfo

private void validateRegionInfo(byte[] regionBytes)
                         throws IOException

Compare the HRegionInfo we read from HBase to what we stored

Throws:

IOException

scan

private void scan(boolean validateStartcode,
 String serverName)
           throws IOException

Use a scanner to get the region info and then validate the results

Throws:

IOException

hasColumn

private boolean hasColumn(List<org.apache.hadoop.hbase.Cell> kvs,
 byte[] family,
 byte[] qualifier)

getColumn

private org.apache.hadoop.hbase.Cell getColumn(List<org.apache.hadoop.hbase.Cell> kvs,
 byte[] family,
 byte[] qualifier)

getRegionInfo

private void getRegionInfo(org.apache.hadoop.hbase.client.Table table)
                    throws IOException

Use get to retrieve the HRegionInfo and validate it

Throws:

IOException

testScanAndSyncFlush

@Test
public void testScanAndSyncFlush()
                          throws Exception

Tests to do a sync flush during the middle of a scan. This is testing the StoreScanner update readers code essentially. This is not highly concurrent, since its all 1 thread. HBase-910.

Throws:

Exception

testScanAndRealConcurrentFlush

@Test
public void testScanAndRealConcurrentFlush()
                                    throws Exception

Tests to do a concurrent flush (using a 2nd thread) while scanning. This tests both the StoreScanner update readers and the transition from memstore -> snapshot -> store file.

Throws:

Exception

testScanAndConcurrentMajorCompact

@Test
public void testScanAndConcurrentMajorCompact(org.junit.jupiter.api.TestInfo testInfo)
                                       throws Exception

Make sure scanner returns correct result when we run a major compaction with deletes.

Throws:

Exception

count

private int count(org.apache.hadoop.hbase.client.Table countTable,
 int flushIndex,
 boolean concurrent)
           throws Exception

Count table.

Parameters:

countTable - Table

flushIndex - At what row we start the flush.

concurrent - if the flush should be concurrent or sync.

Returns:

Count of rows found.

Throws:

Exception