org.apache.hadoop.hbase

Class IntegrationTestLazyCfLoading.DataGenerator

java.lang.Object

org.apache.hadoop.hbase.util.test.LoadTestDataGenerator

org.apache.hadoop.hbase.IntegrationTestLazyCfLoading.DataGenerator

Enclosing class:

IntegrationTestLazyCfLoading

private static class IntegrationTestLazyCfLoading.DataGenerator
extends LoadTestDataGenerator

Custom LoadTestDataGenerator. Uses key generation and verification from LoadTestKVGenerator. Creates 3 column families; one with an integer column to filter on, the 2nd one with an integer column that matches the first integer column (for test-specific verification), and byte[] value that is used for general verification; and the third one with just the value.

Field Summary

Fields

Modifier and Type	Field and Description
static long	ACCEPTED_VALUE
private static Map<byte[],byte[][]>	columnMap
static byte[]	ESSENTIAL_CF
private AtomicLong	expectedNumberOfKeys
static byte[]	FILTER_COLUMN
static byte[]	JOINED_CF1
static byte[]	JOINED_CF2
private static int	MAX_DATA_SIZE
private static int	MIN_DATA_SIZE
private AtomicLong	totalNumberOfKeys
static byte[]	VALUE_COLUMN

Fields inherited from class org.apache.hadoop.hbase.util.test.LoadTestDataGenerator

args, INCREMENT, kvGenerator, MUTATE_INFO

Constructor Summary

Constructors

Constructor and Description
DataGenerator()

Method Summary

Modifier and Type	Method and Description
byte[][]	generateColumnsForCf(byte[] rowKey, byte[] cf) Generates an applicable set of columns to be used for a particular key and family.
byte[]	generateValue(byte[] rowKey, byte[] cf, byte[] column) Generates a value to be used for a particular row/cf/column.
byte[][]	getColumnFamilies() Gets column families for the load test table.
byte[]	getDeterministicUniqueKey(long keyBase) Generates a deterministic, unique hashed row key from a number.
long	getExpectedNumberOfKeys()
org.apache.hadoop.hbase.filter.Filter	getScanFilter()
long	getTotalNumberOfKeys()
boolean	verify(byte[] rowKey, byte[] cf, byte[] column, byte[] value) Checks that value for a rowKey/cf/column is valid if generated via LoadTestDataGenerator.generateValue(byte[], byte[], byte[])
boolean	verify(byte[] rowKey, byte[] cf, Set<byte[]> columnSet) Checks that columns for a rowKey and cf are valid if generated via LoadTestDataGenerator.generateColumnsForCf(byte[], byte[])

Methods inherited from class org.apache.hadoop.hbase.util.test.LoadTestDataGenerator

beforeGet, beforeMutate, generateData, getArgs, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MIN_DATA_SIZE

private static final int MIN_DATA_SIZE

See Also:

Constant Field Values

MAX_DATA_SIZE

private static final int MAX_DATA_SIZE

See Also:

Constant Field Values

ESSENTIAL_CF

public static final byte[] ESSENTIAL_CF

JOINED_CF1

public static final byte[] JOINED_CF1

JOINED_CF2

public static final byte[] JOINED_CF2

FILTER_COLUMN

public static final byte[] FILTER_COLUMN

VALUE_COLUMN

public static final byte[] VALUE_COLUMN

ACCEPTED_VALUE

public static final long ACCEPTED_VALUE

See Also:

Constant Field Values

columnMap

private static final Map<byte[],byte[][]> columnMap

expectedNumberOfKeys

private final AtomicLong expectedNumberOfKeys

totalNumberOfKeys

private final AtomicLong totalNumberOfKeys

Constructor Detail

DataGenerator

public DataGenerator()

Method Detail

getExpectedNumberOfKeys

public long getExpectedNumberOfKeys()

getTotalNumberOfKeys

public long getTotalNumberOfKeys()

getDeterministicUniqueKey

public byte[] getDeterministicUniqueKey(long keyBase)

Description copied from class: LoadTestDataGenerator

Generates a deterministic, unique hashed row key from a number. That way, the user can keep track of numbers, without messing with byte array and ensuring key distribution.

Specified by:

getDeterministicUniqueKey in class LoadTestDataGenerator

Parameters:

keyBase - Base number for a key, such as a loop counter.

getColumnFamilies

public byte[][] getColumnFamilies()

Description copied from class: LoadTestDataGenerator

Gets column families for the load test table.

Specified by:

getColumnFamilies in class LoadTestDataGenerator

Returns:

The array of byte[]s representing column family names.

generateColumnsForCf

public byte[][] generateColumnsForCf(byte[] rowKey,
                                     byte[] cf)

Description copied from class: LoadTestDataGenerator

Generates an applicable set of columns to be used for a particular key and family.

Specified by:

generateColumnsForCf in class LoadTestDataGenerator

Parameters:

rowKey - The row key to generate for.

cf - The column family name to generate for.

Returns:

The array of byte[]s representing column names.

generateValue

public byte[] generateValue(byte[] rowKey,
                            byte[] cf,
                            byte[] column)

Description copied from class: LoadTestDataGenerator

Generates a value to be used for a particular row/cf/column.

Specified by:

generateValue in class LoadTestDataGenerator

Parameters:

rowKey - The row key to generate for.

cf - The column family name to generate for.

column - The column name to generate for.

Returns:

The value to use.

verify

public boolean verify(byte[] rowKey,
                      byte[] cf,
                      byte[] column,
                      byte[] value)

Description copied from class: LoadTestDataGenerator

Checks that value for a rowKey/cf/column is valid if generated via LoadTestDataGenerator.generateValue(byte[], byte[], byte[])

Specified by:

verify in class LoadTestDataGenerator

Parameters:

rowKey - The row key to verify for.

cf - The column family name to verify for.

column - The column name to verify for.

value - The value (for example, encountered by read).

Returns:

True iff valid.

verify

public boolean verify(byte[] rowKey,
                      byte[] cf,
                      Set<byte[]> columnSet)

Description copied from class: LoadTestDataGenerator

Checks that columns for a rowKey and cf are valid if generated via LoadTestDataGenerator.generateColumnsForCf(byte[], byte[])

Specified by:

verify in class LoadTestDataGenerator

Parameters:

rowKey - The row key to verify for.

cf - The column family name to verify for.

columnSet - The column set (for example, encountered by read).

Returns:

True iff valid.

getScanFilter

public org.apache.hadoop.hbase.filter.Filter getScanFilter()