org.apache.hadoop.hbase.util

Class MultiThreadedAction.DefaultDataGenerator

java.lang.Object

org.apache.hadoop.hbase.util.test.LoadTestDataGenerator

org.apache.hadoop.hbase.util.MultiThreadedAction.DefaultDataGenerator

Direct Known Subclasses:

LoadTestDataGeneratorWithACL, LoadTestDataGeneratorWithMOB, LoadTestDataGeneratorWithTags, LoadTestDataGeneratorWithVisibilityLabels

Enclosing class:

MultiThreadedAction

public static class MultiThreadedAction.DefaultDataGenerator
extends LoadTestDataGenerator

Default implementation of LoadTestDataGenerator that uses LoadTestKVGenerator, fixed set of column families, and random number of columns in range. The table for it can be created manually or, for example, via HBaseTestingUtility.createPreSplitLoadTestTable(Configuration, TableName, byte[], org.apache.hadoop.hbase.io.compress.Compression.Algorithm, org.apache.hadoop.hbase.io.encoding.DataBlockEncoding)

Field Summary

Fields

Modifier and Type	Field and Description
private byte[][]	columnFamilies
private int	maxColumnsPerKey
private int	minColumnsPerKey
private Random	random

Fields inherited from class org.apache.hadoop.hbase.util.test.LoadTestDataGenerator

args, INCREMENT, kvGenerator, MUTATE_INFO

Constructor Summary

Constructors

Constructor and Description
DefaultDataGenerator(byte[]... columnFamilies)
DefaultDataGenerator(int minValueSize, int maxValueSize, int minColumnsPerKey, int maxColumnsPerKey, byte[]... columnFamilies)

Method Summary

Modifier and Type	Method and Description
byte[][]	generateColumnsForCf(byte[] rowKey, byte[] cf) Generates an applicable set of columns to be used for a particular key and family.
byte[]	generateValue(byte[] rowKey, byte[] cf, byte[] column) Generates a value to be used for a particular row/cf/column.
byte[][]	getColumnFamilies() Gets column families for the load test table.
byte[]	getDeterministicUniqueKey(long keyBase) Generates a deterministic, unique hashed row key from a number.
boolean	verify(byte[] rowKey, byte[] cf, byte[] column, byte[] value) Checks that value for a rowKey/cf/column is valid if generated via LoadTestDataGenerator.generateValue(byte[], byte[], byte[])
boolean	verify(byte[] rowKey, byte[] cf, Set<byte[]> columnSet) Checks that columns for a rowKey and cf are valid if generated via LoadTestDataGenerator.generateColumnsForCf(byte[], byte[])

Methods inherited from class org.apache.hadoop.hbase.util.test.LoadTestDataGenerator

beforeGet, beforeMutate, generateData, getArgs, initialize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

columnFamilies

private byte[][] columnFamilies

minColumnsPerKey

private int minColumnsPerKey

maxColumnsPerKey

private int maxColumnsPerKey

random

private final Random random

Constructor Detail

DefaultDataGenerator

public DefaultDataGenerator(int minValueSize,
                            int maxValueSize,
                            int minColumnsPerKey,
                            int maxColumnsPerKey,
                            byte[]... columnFamilies)

DefaultDataGenerator

public DefaultDataGenerator(byte[]... columnFamilies)

Method Detail

getDeterministicUniqueKey

public byte[] getDeterministicUniqueKey(long keyBase)

Description copied from class: LoadTestDataGenerator

Generates a deterministic, unique hashed row key from a number. That way, the user can keep track of numbers, without messing with byte array and ensuring key distribution.

Specified by:

getDeterministicUniqueKey in class LoadTestDataGenerator

Parameters:

keyBase - Base number for a key, such as a loop counter.

getColumnFamilies

public byte[][] getColumnFamilies()

Description copied from class: LoadTestDataGenerator

Gets column families for the load test table.

Specified by:

getColumnFamilies in class LoadTestDataGenerator

Returns:

The array of byte[]s representing column family names.

generateColumnsForCf

public byte[][] generateColumnsForCf(byte[] rowKey,
                                     byte[] cf)

Description copied from class: LoadTestDataGenerator

Generates an applicable set of columns to be used for a particular key and family.

Specified by:

generateColumnsForCf in class LoadTestDataGenerator

Parameters:

rowKey - The row key to generate for.

cf - The column family name to generate for.

Returns:

The array of byte[]s representing column names.

generateValue

public byte[] generateValue(byte[] rowKey,
                            byte[] cf,
                            byte[] column)

Description copied from class: LoadTestDataGenerator

Generates a value to be used for a particular row/cf/column.

Specified by:

generateValue in class LoadTestDataGenerator

Parameters:

rowKey - The row key to generate for.

cf - The column family name to generate for.

column - The column name to generate for.

Returns:

The value to use.

verify

public boolean verify(byte[] rowKey,
                      byte[] cf,
                      byte[] column,
                      byte[] value)

Description copied from class: LoadTestDataGenerator

Checks that value for a rowKey/cf/column is valid if generated via LoadTestDataGenerator.generateValue(byte[], byte[], byte[])

Specified by:

verify in class LoadTestDataGenerator

Parameters:

rowKey - The row key to verify for.

cf - The column family name to verify for.

column - The column name to verify for.

value - The value (for example, encountered by read).

Returns:

True iff valid.

verify

public boolean verify(byte[] rowKey,
                      byte[] cf,
                      Set<byte[]> columnSet)

Description copied from class: LoadTestDataGenerator

Checks that columns for a rowKey and cf are valid if generated via LoadTestDataGenerator.generateColumnsForCf(byte[], byte[])

Specified by:

verify in class LoadTestDataGenerator

Parameters:

rowKey - The row key to verify for.

cf - The column family name to verify for.

columnSet - The column set (for example, encountered by read).

Returns:

True iff valid.