org.apache.hadoop.hbase.regionserver

Class TestHRegionServerBulkLoad

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad

Direct Known Subclasses:

TestHRegionServerBulkLoadWithOldClient, TestHRegionServerBulkLoadWithOldSecureEndpoint

public class TestHRegionServerBulkLoad
extends Object

Tests bulk loading of HFiles and shows the atomicity or lack of atomicity of the region server's bullkLoad functionality.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestHRegionServerBulkLoad.AtomicHFileLoader Thread that does full scans of the table looking for any partially completed rows.
static class	TestHRegionServerBulkLoad.AtomicScanReader Thread that does full scans of the table looking for any partially completed rows.
(package private) static class	TestHRegionServerBulkLoad.FindBulkHBaseListener
static class	TestHRegionServerBulkLoad.MyObserver

Field Summary

Fields

Modifier and Type	Field and Description
static int	BLOCKSIZE
static HBaseClassTestRule	CLASS_RULE
static org.apache.hadoop.hbase.io.compress.Compression.Algorithm	COMPRESSION
protected static org.apache.hadoop.conf.Configuration	conf
protected static byte[][]	families
private static org.slf4j.Logger	LOG
protected static int	NUM_CFS
protected static byte[]	QUAL
private int	sleepDuration
protected static HBaseTestingUtility	UTIL

Constructor Summary

Constructors

Constructor and Description
TestHRegionServerBulkLoad(int duration)

Method Summary

Modifier and Type	Method and Description
static void	createHFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, byte[] family, byte[] qualifier, byte[] value, int numRows) Create an HFile with the given number of rows with a specified value.
(package private) static String	family(int i)
static void	main(String[] args) Run test on an HBase instance for 5 minutes.
static Collection<Object[]>	parameters()
static byte[]	rowkey(int i) Create a rowkey compatible with createHFile(FileSystem, Path, byte[], byte[], byte[], int).
(package private) void	runAtomicBulkloadTest(org.apache.hadoop.hbase.TableName tableName, int millisToRun, int numScanners)
private void	setConf(org.apache.hadoop.conf.Configuration c)
static void	setUpBeforeClass()
void	setupTable(org.apache.hadoop.hbase.TableName table, int cfs) Creates a table with given table name and specified number of column families if the table does not already exist.
void	testAtomicBulkLoad() Atomic bulk load.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

UTIL

protected static HBaseTestingUtility UTIL

conf

protected static final org.apache.hadoop.conf.Configuration conf

QUAL

protected static final byte[] QUAL

NUM_CFS

protected static final int NUM_CFS

See Also:

Constant Field Values

sleepDuration

private int sleepDuration

BLOCKSIZE

public static int BLOCKSIZE

COMPRESSION

public static org.apache.hadoop.hbase.io.compress.Compression.Algorithm COMPRESSION

families

protected static final byte[][] families

Constructor Detail

TestHRegionServerBulkLoad

public TestHRegionServerBulkLoad(int duration)

Method Detail

parameters

public static final Collection<Object[]> parameters()

setUpBeforeClass

public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

rowkey

public static byte[] rowkey(int i)

Create a rowkey compatible with createHFile(FileSystem, Path, byte[], byte[], byte[], int).

family

static String family(int i)

createHFile

public static void createHFile(org.apache.hadoop.fs.FileSystem fs,
                               org.apache.hadoop.fs.Path path,
                               byte[] family,
                               byte[] qualifier,
                               byte[] value,
                               int numRows)
                        throws IOException

Create an HFile with the given number of rows with a specified value.

Throws:

IOException

setupTable

public void setupTable(org.apache.hadoop.hbase.TableName table,
                       int cfs)
                throws IOException

Creates a table with given table name and specified number of column families if the table does not already exist.

Throws:

IOException

testAtomicBulkLoad

public void testAtomicBulkLoad()
                        throws Exception

Atomic bulk load.

Throws:

Exception

runAtomicBulkloadTest

void runAtomicBulkloadTest(org.apache.hadoop.hbase.TableName tableName,
                           int millisToRun,
                           int numScanners)
                    throws Exception

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Run test on an HBase instance for 5 minutes. This assumes that the table under test only has a single region.

Throws:

Exception

setConf

private void setConf(org.apache.hadoop.conf.Configuration c)