org.apache.hadoop.hbase.client

Class TestScannersFromClientSide

java.lang.Object

org.apache.hadoop.hbase.client.TestScannersFromClientSide

public class TestScannersFromClientSide
extends Object

A client-side test, mostly testing scanners with various parameters. Parameterized on different registry implementations.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestScannersFromClientSide.LimitKVsReturnFilter

Field Summary

Fields

Modifier and Type	Field and Description
static HBaseClassTestRule	CLASS_RULE
private static byte[]	FAMILY
private static org.slf4j.Logger	LOG
TableNameTestRule	name
private static byte[]	QUALIFIER
private static byte[]	ROW
private static HBaseTestingUtility	TEST_UTIL
private static byte[]	VALUE

Constructor Summary

Constructors

Constructor and Description
TestScannersFromClientSide(Class<?> registryImpl, int numHedgedReqs)

Method Summary

Modifier and Type	Method and Description
private static boolean	isSameParameterizedCluster(Class<?> registryImpl, int numHedgedReqs) JUnit does not provide an easy way to run a hook after each parameterized run.
private static byte[][]	makeNAsciiWithZeroPrefix(byte[] base, int n)
static Collection<Object[]>	parameters()
void	setUp()
static void	tearDownAfterClass()
private void	testAsyncScanner(org.apache.hadoop.hbase.TableName table, int rowNumber, int familyNumber, int qualifierNumber, int caching, Consumer<Boolean> listener)
void	testAsyncScannerWithManyRows()
void	testAsyncScannerWithoutCaching()
void	testAsyncScannerWithSmallData()
void	testGetMaxResults() Test from client side for get with maxResultPerCF set
void	testGetRowOffset() Test from client side for get with rowOffset
void	testMaxResultSizeIsSetToDefault()
void	testReadExpiredDataForRawScan()
void	testReverseScanWithFlush()
void	testScanBatch() Test from client side for batch of scan
void	testScanMaxResults() Test from client side for scan with maxResultPerCF set
void	testScannerForNotExistingTable() Scan on not existing table should throw the exception with correct message
void	testScannerWithPartialResults()
void	testScanOnReopenedRegion() Test from client side for scan while the region is reopened on the same region server.
void	testScanRawDeleteFamilyVersion()
void	testScanWithColumnsAndFilterAndVersion()
void	testScanWithSameStartRowStopRow()
void	testSmallScan()
private void	testSmallScan(org.apache.hadoop.hbase.client.Table table, boolean reversed, int rows, int columns) Run through a variety of test configurations with a small scan
private void	verifyExpectedCounts(org.apache.hadoop.hbase.client.Table table, org.apache.hadoop.hbase.client.Scan scan, int expectedRowCount, int expectedCellCount)
(package private) static void	verifyResult(org.apache.hadoop.hbase.client.Result result, List<org.apache.hadoop.hbase.Cell> expKvList, boolean toLog, String msg)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

private static HBaseTestingUtility TEST_UTIL

ROW

private static byte[] ROW

FAMILY

private static byte[] FAMILY

QUALIFIER

private static byte[] QUALIFIER

VALUE

private static byte[] VALUE

name

public TableNameTestRule name

Constructor Detail

TestScannersFromClientSide

public TestScannersFromClientSide(Class<?> registryImpl,
                                  int numHedgedReqs)
                           throws Exception

Throws:

Exception

Method Detail

tearDownAfterClass

public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

setUp

public void setUp()
           throws Exception

Throws:

Exception

parameters

public static Collection<Object[]> parameters()

isSameParameterizedCluster

private static boolean isSameParameterizedCluster(Class<?> registryImpl,
                                                  int numHedgedReqs)

JUnit does not provide an easy way to run a hook after each parameterized run. Without that there is no easy way to restart the test cluster after each parameterized run. Annotation BeforeParam does not work either because it runs before parameterization and hence does not have access to the test parameters (which is weird). This *hack* checks if the current instance of test cluster configuration has the passed parameterized configs. In such a case, we can just reuse the cluster for test and do not need to initialize from scratch. While this is a hack, it saves a ton of time for the full test and de-flakes it.

testScanBatch

public void testScanBatch()
                   throws Exception

Test from client side for batch of scan

Throws:

Exception

testMaxResultSizeIsSetToDefault

public void testMaxResultSizeIsSetToDefault()
                                     throws Exception

Throws:

Exception

testScannerForNotExistingTable

public void testScannerForNotExistingTable()

Scan on not existing table should throw the exception with correct message

testSmallScan

public void testSmallScan()
                   throws Exception

Throws:

Exception

testSmallScan

private void testSmallScan(org.apache.hadoop.hbase.client.Table table,
                           boolean reversed,
                           int rows,
                           int columns)
                    throws Exception

Run through a variety of test configurations with a small scan

Parameters:

table -

reversed -

rows -

columns -

Throws:

Exception

verifyExpectedCounts

private void verifyExpectedCounts(org.apache.hadoop.hbase.client.Table table,
                                  org.apache.hadoop.hbase.client.Scan scan,
                                  int expectedRowCount,
                                  int expectedCellCount)
                           throws Exception

Throws:

Exception

testGetMaxResults

public void testGetMaxResults()
                       throws Exception

Test from client side for get with maxResultPerCF set

Throws:

Exception

testScanMaxResults

public void testScanMaxResults()
                        throws Exception

Test from client side for scan with maxResultPerCF set

Throws:

Exception

testGetRowOffset

public void testGetRowOffset()
                      throws Exception

Test from client side for get with rowOffset

Throws:

Exception

testScanRawDeleteFamilyVersion

public void testScanRawDeleteFamilyVersion()
                                    throws Exception

Throws:

Exception

testScanOnReopenedRegion

public void testScanOnReopenedRegion()
                              throws Exception

Test from client side for scan while the region is reopened on the same region server.

Throws:

Exception

testAsyncScannerWithSmallData

public void testAsyncScannerWithSmallData()
                                   throws Exception

Throws:

Exception

testAsyncScannerWithManyRows

public void testAsyncScannerWithManyRows()
                                  throws Exception

Throws:

Exception

testAsyncScannerWithoutCaching

public void testAsyncScannerWithoutCaching()
                                    throws Exception

Throws:

Exception

testAsyncScanner

private void testAsyncScanner(org.apache.hadoop.hbase.TableName table,
                              int rowNumber,
                              int familyNumber,
                              int qualifierNumber,
                              int caching,
                              Consumer<Boolean> listener)
                       throws Exception

Throws:

Exception

makeNAsciiWithZeroPrefix

private static byte[][] makeNAsciiWithZeroPrefix(byte[] base,
                                                 int n)

verifyResult

static void verifyResult(org.apache.hadoop.hbase.client.Result result,
                         List<org.apache.hadoop.hbase.Cell> expKvList,
                         boolean toLog,
                         String msg)

testReadExpiredDataForRawScan

public void testReadExpiredDataForRawScan()
                                   throws IOException

Throws:

IOException

testScanWithColumnsAndFilterAndVersion

public void testScanWithColumnsAndFilterAndVersion()
                                            throws IOException

Throws:

IOException

testScanWithSameStartRowStopRow

public void testScanWithSameStartRowStopRow()
                                     throws IOException

Throws:

IOException

testReverseScanWithFlush

public void testReverseScanWithFlush()
                              throws Exception

Throws:

Exception

testScannerWithPartialResults

public void testScannerWithPartialResults()
                                   throws Exception

Throws:

Exception