org.apache.hadoop.hbase.io.hfile

Class TestSeekBeforeWithInlineBlocks

java.lang.Object

org.apache.hadoop.hbase.io.hfile.TestSeekBeforeWithInlineBlocks

public class TestSeekBeforeWithInlineBlocks
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
private static int	BLOOM_BLOCK_SIZE
static HBaseClassTestRule	CLASS_RULE
private org.apache.hadoop.conf.Configuration	conf
private static int	DATA_BLOCK_SIZE
private static int[]	EXPECTED_NUM_LEVELS
private static byte[]	FAM
private org.apache.hadoop.fs.FileSystem	fs
private static int[]	INDEX_CHUNK_SIZES
private static org.slf4j.Logger	LOG
private static int	NUM_KV
private static Random	RAND
private static HBaseTestingUtility	TEST_UTIL

Constructor Summary

Constructors

Constructor and Description
TestSeekBeforeWithInlineBlocks()

Method Summary

Modifier and Type	Method and Description
private void	checkCell(org.apache.hadoop.hbase.Cell expected, org.apache.hadoop.hbase.Cell actual) Check a key/value pair after it was read by the reader
private void	checkNoSeekBefore(org.apache.hadoop.hbase.Cell[] cells, org.apache.hadoop.hbase.io.hfile.HFileScanner scanner, int i)
private void	checkSeekBefore(org.apache.hadoop.hbase.Cell[] cells, org.apache.hadoop.hbase.io.hfile.HFileScanner scanner, int i)
void	testMultiIndexLevelRandomHFileWithBlooms() Scanner.seekBefore() could fail because when seeking to a previous HFile data block, it needs to know the size of that data block, which it calculates using current data block offset and the previous data block offset.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

private static final HBaseTestingUtility TEST_UTIL

NUM_KV

private static final int NUM_KV

See Also:

Constant Field Values

DATA_BLOCK_SIZE

private static final int DATA_BLOCK_SIZE

See Also:

Constant Field Values

BLOOM_BLOCK_SIZE

private static final int BLOOM_BLOCK_SIZE

See Also:

Constant Field Values

INDEX_CHUNK_SIZES

private static final int[] INDEX_CHUNK_SIZES

EXPECTED_NUM_LEVELS

private static final int[] EXPECTED_NUM_LEVELS

RAND

private static final Random RAND

FAM

private static final byte[] FAM

fs

private org.apache.hadoop.fs.FileSystem fs

conf

private org.apache.hadoop.conf.Configuration conf

Constructor Detail

TestSeekBeforeWithInlineBlocks

public TestSeekBeforeWithInlineBlocks()

Method Detail

testMultiIndexLevelRandomHFileWithBlooms

public void testMultiIndexLevelRandomHFileWithBlooms()
                                              throws IOException

Scanner.seekBefore() could fail because when seeking to a previous HFile data block, it needs to know the size of that data block, which it calculates using current data block offset and the previous data block offset. This fails to work when there are leaf-level index blocks in the scannable section of the HFile, i.e. starting in HFileV2. This test will try seekBefore() on a flat (single-level) and multi-level (2,3) HFile and confirm this bug is now fixed. This bug also happens for inline Bloom blocks for the same reasons.

Throws:

IOException

checkSeekBefore

private void checkSeekBefore(org.apache.hadoop.hbase.Cell[] cells,
                             org.apache.hadoop.hbase.io.hfile.HFileScanner scanner,
                             int i)
                      throws IOException

Throws:

IOException

checkNoSeekBefore

private void checkNoSeekBefore(org.apache.hadoop.hbase.Cell[] cells,
                               org.apache.hadoop.hbase.io.hfile.HFileScanner scanner,
                               int i)
                        throws IOException

Throws:

IOException

checkCell

private void checkCell(org.apache.hadoop.hbase.Cell expected,
                       org.apache.hadoop.hbase.Cell actual)

Check a key/value pair after it was read by the reader