org.apache.hadoop.hbase.regionserver

Class TestStoreScanner

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestStoreScanner

public class TestStoreScanner
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	TestStoreScanner.CellGridStoreScanner A StoreScanner for our CELL_GRID above.
private static class	TestStoreScanner.CellWithVersionsNoOptimizeStoreScanner
private static class	TestStoreScanner.CellWithVersionsStoreScanner
private static class	TestStoreScanner.KeyValueHeapWithCount

Field Summary

Fields

Modifier and Type	Field and Description
private static org.apache.hadoop.hbase.Cell[]	CELL_GRID Five rows by four columns distinguished by column qualifier (column qualifier is one of the four rows...
private static int	CELL_GRID_BLOCK2_BOUNDARY
private static int	CELL_GRID_BLOCK3_BOUNDARY
private static int	CELL_GRID_BLOCK4_BOUNDARY
private static int	CELL_GRID_BLOCK5_BOUNDARY
private static org.apache.hadoop.hbase.Cell[]	CELL_WITH_VERSIONS
private static int	CELL_WITH_VERSIONS_BLOCK2_BOUNDARY
private static byte[]	CF
private static String	CF_STR
static HBaseClassTestRule	CLASS_RULE
(package private) static org.apache.hadoop.conf.Configuration	CONF
private static byte[]	FIVE
private static byte[]	FOUR
private static org.apache.hadoop.hbase.KeyValue[]	kvs
private static org.slf4j.Logger	LOG
org.junit.rules.TestName	name
private static byte[]	ONE
private org.apache.hadoop.hbase.regionserver.ScanInfo	scanInfo
private static HBaseTestingUtility	TEST_UTIL
private static byte[]	THREE
private static byte[]	TWO
private static byte[]	TWO_POINT_TWO
private static byte[]	VALUE
private static byte[]	ZERO From here on down, we have a bunch of defines and specific CELL_GRID of Cells.
private static byte[]	ZERO_POINT_ZERO

Constructor Summary

Constructors

Constructor and Description
TestStoreScanner()

Method Summary

Modifier and Type	Method and Description
(package private) NavigableSet<byte[]>	getCols(String... strCols)
void	testDeleteColumn()
void	testDeletedRowThenGoodRow()
void	testDeleteFamily()
void	testDeleteMarkerLongevity()
void	testDeleteVersionMaskingMultiplePuts()
void	testDeleteVersionSameTimestamp()
void	testDeleteVersionsMixedAndMultipleVersionReturn()
void	testExpiredDeleteFamily() Ensure that expired delete family markers don't override valid puts
void	testFullRowGetDoesNotOverreadWhenRowInsideOneBlock()
void	testFullRowSpansBlocks()
void	testNonUserScan()
void	testOptimize() Test optimize in StoreScanner.
void	testOptimizeAndGet() Ensure the optimize Scan method in StoreScanner does not get in the way of a Get doing minimum work...
void	testOptimizeAndGetWithFakedNextBlockIndexStart() Ensure that optimize does not cause the Get to do more seeking than required.
void	testPeek()
void	testPreadNotEnabledForCompactionStoreScanners()
void	testReadVersionWithRawAndFilter()
void	testScannerReseekDoesntNPE()
void	testScanSameTimestamp()
void	testScanTimeRange()
void	testSkipColumn()
void	testWildCardOneVersionScan()
void	testWildCardScannerUnderDeletes()
void	testWildCardTtlScan()
void	testWithColumnCountGetFilter()
void	testWontNextToNext()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

name

public org.junit.rules.TestName name

CF_STR

private static final String CF_STR

See Also:

Constant Field Values

CF

private static final byte[] CF

CONF

static org.apache.hadoop.conf.Configuration CONF

TEST_UTIL

private static final HBaseTestingUtility TEST_UTIL

scanInfo

private org.apache.hadoop.hbase.regionserver.ScanInfo scanInfo

ZERO

private static final byte[] ZERO

From here on down, we have a bunch of defines and specific CELL_GRID of Cells. The CELL_GRID then has a Scanner that can fake out 'block' transitions. All this elaborate setup is for tests that ensure we don't overread, and that the StoreScanner is not overly enthusiastic.

ZERO_POINT_ZERO

private static final byte[] ZERO_POINT_ZERO

ONE

private static final byte[] ONE

TWO

private static final byte[] TWO

TWO_POINT_TWO

private static final byte[] TWO_POINT_TWO

THREE

private static final byte[] THREE

FOUR

private static final byte[] FOUR

FIVE

private static final byte[] FIVE

VALUE

private static final byte[] VALUE

CELL_GRID_BLOCK2_BOUNDARY

private static final int CELL_GRID_BLOCK2_BOUNDARY

See Also:

Constant Field Values

CELL_GRID_BLOCK3_BOUNDARY

private static final int CELL_GRID_BLOCK3_BOUNDARY

See Also:

Constant Field Values

CELL_GRID_BLOCK4_BOUNDARY

private static final int CELL_GRID_BLOCK4_BOUNDARY

See Also:

Constant Field Values

CELL_GRID_BLOCK5_BOUNDARY

private static final int CELL_GRID_BLOCK5_BOUNDARY

See Also:

Constant Field Values

CELL_GRID

private static final org.apache.hadoop.hbase.Cell[] CELL_GRID

Five rows by four columns distinguished by column qualifier (column qualifier is one of the four rows... ONE, TWO, etc.). Exceptions are a weird row after TWO; it is TWO_POINT_TWO. And then row FOUR has five columns finishing w/ row FIVE having a single column. We will use this to test scan does the right thing as it we do Gets, StoreScanner#optimize, and what we do on (faked) block boundaries.

CELL_WITH_VERSIONS_BLOCK2_BOUNDARY

private static final int CELL_WITH_VERSIONS_BLOCK2_BOUNDARY

See Also:

Constant Field Values

CELL_WITH_VERSIONS

private static final org.apache.hadoop.hbase.Cell[] CELL_WITH_VERSIONS

kvs

private static final org.apache.hadoop.hbase.KeyValue[] kvs

Constructor Detail

TestStoreScanner

public TestStoreScanner()

Method Detail

testWithColumnCountGetFilter

public void testWithColumnCountGetFilter()
                                  throws Exception

Throws:

Exception

getCols

NavigableSet<byte[]> getCols(String... strCols)

testFullRowGetDoesNotOverreadWhenRowInsideOneBlock

public void testFullRowGetDoesNotOverreadWhenRowInsideOneBlock()
                                                        throws IOException

Throws:

IOException

testFullRowSpansBlocks

public void testFullRowSpansBlocks()
                            throws IOException

Throws:

IOException

testOptimize

public void testOptimize()
                  throws IOException

Test optimize in StoreScanner. Test that we skip to the next 'block' when we it makes sense reading the block 'index'.

Throws:

IOException

testOptimizeAndGet

public void testOptimizeAndGet()
                        throws IOException

Ensure the optimize Scan method in StoreScanner does not get in the way of a Get doing minimum work... seeking to start of block and then SKIPPING until we find the wanted Cell. This 'simple' scenario mimics case of all Cells fitting inside a single HFileBlock. See HBASE-15392. This test is a little cryptic. Takes a bit of staring to figure what it up to.

Throws:

IOException

testOptimizeAndGetWithFakedNextBlockIndexStart

public void testOptimizeAndGetWithFakedNextBlockIndexStart()
                                                    throws IOException

Ensure that optimize does not cause the Get to do more seeking than required. Optimize (see HBASE-15392) was causing us to seek all Cells in a block when a Get Scan if the next block index/start key was a different row to the current one. A bug. We'd call next too often because we had to exhaust all Cells in the current row making us load the next block just to discard what we read there. This test is a little cryptic. Takes a bit of staring to figure what it up to.

Throws:

IOException

testScanTimeRange

public void testScanTimeRange()
                       throws IOException

Throws:

IOException

testScanSameTimestamp

public void testScanSameTimestamp()
                           throws IOException

Throws:

IOException

testNonUserScan

public void testNonUserScan()
                     throws IOException

Throws:

IOException

testWontNextToNext

public void testWontNextToNext()
                        throws IOException

Throws:

IOException

testDeleteVersionSameTimestamp

public void testDeleteVersionSameTimestamp()
                                    throws IOException

Throws:

IOException

testDeletedRowThenGoodRow

public void testDeletedRowThenGoodRow()
                               throws IOException

Throws:

IOException

testDeleteVersionMaskingMultiplePuts

public void testDeleteVersionMaskingMultiplePuts()
                                          throws IOException

Throws:

IOException

testDeleteVersionsMixedAndMultipleVersionReturn

public void testDeleteVersionsMixedAndMultipleVersionReturn()
                                                     throws IOException

Throws:

IOException

testWildCardOneVersionScan

public void testWildCardOneVersionScan()
                                throws IOException

Throws:

IOException

testWildCardScannerUnderDeletes

public void testWildCardScannerUnderDeletes()
                                     throws IOException

Throws:

IOException

testDeleteFamily

public void testDeleteFamily()
                      throws IOException

Throws:

IOException

testDeleteColumn

public void testDeleteColumn()
                      throws IOException

Throws:

IOException

testSkipColumn

public void testSkipColumn()
                    throws IOException

Throws:

IOException

testWildCardTtlScan

public void testWildCardTtlScan()
                         throws IOException

Throws:

IOException

testScannerReseekDoesntNPE

public void testScannerReseekDoesntNPE()
                                throws Exception

Throws:

Exception

testPeek

public void testPeek()
              throws Exception

Throws:

Exception

testExpiredDeleteFamily

public void testExpiredDeleteFamily()
                             throws Exception

Ensure that expired delete family markers don't override valid puts

Throws:

Exception

testDeleteMarkerLongevity

public void testDeleteMarkerLongevity()
                               throws Exception

Throws:

Exception

testPreadNotEnabledForCompactionStoreScanners

public void testPreadNotEnabledForCompactionStoreScanners()
                                                   throws Exception

Throws:

Exception

testReadVersionWithRawAndFilter

public void testReadVersionWithRawAndFilter()
                                     throws IOException

Throws:

IOException