Package org.apache.hadoop.hbase.regionserver

Class TestHRegionServerBulkLoad

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad

@Tag("org.apache.hadoop.hbase.testclassification.RegionServerTests") @Tag("org.apache.hadoop.hbase.testclassification.LargeTests")
public class TestHRegionServerBulkLoad
extends Object

Tests bulk loading of HFiles and shows the atomicity or lack of atomicity of the region server's bullkLoad functionality.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	TestHRegionServerBulkLoad.AtomicHFileLoader	Thread that does full scans of the table looking for any partially completed rows.
static class	TestHRegionServerBulkLoad.AtomicScanReader	Thread that does full scans of the table looking for any partially completed rows.
(package private) static class	TestHRegionServerBulkLoad.FindBulkHBaseListener
static class	TestHRegionServerBulkLoad.MyObserver

Field Summary

Fields

Modifier and Type	Field	Description
static int	BLOCKSIZE
static org.apache.hadoop.hbase.io.compress.Compression.Algorithm	COMPRESSION
protected static final org.apache.hadoop.conf.Configuration	conf
protected static final byte[][]	families
private static final org.slf4j.Logger	LOG
protected static final int	NUM_CFS
protected static final byte[]	QUAL
private int	sleepDuration
protected static HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
TestHRegionServerBulkLoad(int duration)

Method Summary

Modifier and Type	Method	Description
static void	createHFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, byte[] family, byte[] qualifier, byte[] value, int numRows)	Create an HFile with the given number of rows with a specified value.
(package private) static String	family(int i)
static void	main(String[] args)	Run test on an HBase instance for 5 minutes.
static final Stream<org.junit.jupiter.params.provider.Arguments>	parameters()
static byte[]	rowkey(int i)	Create a rowkey compatible with createHFile(FileSystem, Path, byte[], byte[], byte[], int).
(package private) void	runAtomicBulkloadTest(org.apache.hadoop.hbase.TableName tableName, int millisToRun, int numScanners)
private void	setConf(org.apache.hadoop.conf.Configuration c)
static void	setUpBeforeClass()
void	setupTable(org.apache.hadoop.hbase.TableName table, int cfs)	Creates a table with given table name and specified number of column families if the table does not already exist.
void	testAtomicBulkLoad()	Atomic bulk load.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

protected static HBaseTestingUtil UTIL

conf

protected static final org.apache.hadoop.conf.Configuration conf

QUAL

protected static final byte[] QUAL

NUM_CFS

protected static final int NUM_CFS

See Also:

• Constant Field Values

sleepDuration

private int sleepDuration

BLOCKSIZE

public static int BLOCKSIZE

COMPRESSION

public static org.apache.hadoop.hbase.io.compress.Compression.Algorithm COMPRESSION

families

protected static final byte[][] families

Constructor Details

TestHRegionServerBulkLoad

public TestHRegionServerBulkLoad(int duration)

Method Details

parameters

public static final Stream<org.junit.jupiter.params.provider.Arguments> parameters()

setUpBeforeClass

@BeforeAll
public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

rowkey

public static byte[] rowkey(int i)

Create a rowkey compatible with createHFile(FileSystem, Path, byte[], byte[], byte[], int).

family

static String family(int i)

createHFile

public static void createHFile(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path path,
 byte[] family,
 byte[] qualifier,
 byte[] value,
 int numRows)
                        throws IOException

Create an HFile with the given number of rows with a specified value.

Throws:

IOException

setupTable

public void setupTable(org.apache.hadoop.hbase.TableName table,
 int cfs)
                throws IOException

Creates a table with given table name and specified number of column families if the table does not already exist.

Throws:

IOException

testAtomicBulkLoad

@TestTemplate
public void testAtomicBulkLoad()
                        throws Exception

Atomic bulk load.

Throws:

Exception

runAtomicBulkloadTest

void runAtomicBulkloadTest(org.apache.hadoop.hbase.TableName tableName,
 int millisToRun,
 int numScanners)
                    throws Exception

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Run test on an HBase instance for 5 minutes. This assumes that the table under test only has a single region.

Throws:

Exception

setConf

private void setConf(org.apache.hadoop.conf.Configuration c)