org.apache.hadoop.hbase.wal

Class WALPerformanceEvaluation

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.wal.WALPerformanceEvaluation

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

@InterfaceAudience.Private
public final class WALPerformanceEvaluation
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

This class runs performance benchmarks for WAL. See usage for this tool by running: $ hbase org.apache.hadoop.hbase.wal.WALPerformanceEvaluation -h

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
(package private) class	WALPerformanceEvaluation.WALPutBenchmark Perform WAL.append() of Put object, for the number of iterations requested.

Field Summary

Fields

Modifier and Type	Field and Description
private com.codahale.metrics.Meter	appendMeter
(package private) static String	FAMILY_PREFIX
private int	keySize
private com.codahale.metrics.Histogram	latencyHistogram
private static org.slf4j.Logger	LOG
private com.codahale.metrics.MetricRegistry	metrics
private org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl	mvcc
private int	numQualifiers
(package private) static String	QUALIFIER_PREFIX
private com.codahale.metrics.Histogram	syncCountHistogram
private com.codahale.metrics.Histogram	syncHistogram
private com.codahale.metrics.Meter	syncMeter
(package private) static String	TABLE_NAME
private HBaseTestingUtility	TEST_UTIL
private int	valueSize
private Set<org.apache.hadoop.hbase.wal.WAL>	walsListenedTo

Constructor Summary

Constructors

Constructor and Description
WALPerformanceEvaluation()

Method Summary

Modifier and Type	Method and Description
private void	cleanRegionRootDir(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dir)
private void	closeRegion(org.apache.hadoop.hbase.regionserver.HRegion region)
private static org.apache.hadoop.hbase.client.TableDescriptor	createHTableDescriptor(int regionNum, int numFamilies)
(package private) static int	innerMain(org.apache.hadoop.conf.Configuration c, String[] args) The guts of the main(java.lang.String[]) method.
private static void	logBenchmarkResult(String testName, long numTests, long totalTime)
static void	main(String[] args)
private org.apache.hadoop.hbase.regionserver.HRegion	openRegion(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dir, org.apache.hadoop.hbase.client.TableDescriptor htd, org.apache.hadoop.hbase.wal.WALFactory wals, long whenToRoll, org.apache.hadoop.hbase.regionserver.LogRoller roller)
private void	printUsageAndExit()
int	run(String[] args)
private long	runBenchmark(Runnable[] runnable, int numThreads)
void	setConf(org.apache.hadoop.conf.Configuration conf)
private org.apache.hadoop.hbase.client.Put	setupPut(Random rand, byte[] key, byte[] value, int numFamilies)
private long	verify(org.apache.hadoop.hbase.wal.WALFactory wals, org.apache.hadoop.fs.Path wal, boolean verbose) Verify the content of the WAL file.

Methods inherited from class org.apache.hadoop.conf.Configured

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf

Field Detail

LOG

private static final org.slf4j.Logger LOG

metrics

private final com.codahale.metrics.MetricRegistry metrics

syncMeter

private final com.codahale.metrics.Meter syncMeter

syncHistogram

private final com.codahale.metrics.Histogram syncHistogram

syncCountHistogram

private final com.codahale.metrics.Histogram syncCountHistogram

appendMeter

private final com.codahale.metrics.Meter appendMeter

latencyHistogram

private final com.codahale.metrics.Histogram latencyHistogram

mvcc

private final org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl mvcc

TEST_UTIL

private HBaseTestingUtility TEST_UTIL

TABLE_NAME

static final String TABLE_NAME

See Also:

Constant Field Values

QUALIFIER_PREFIX

static final String QUALIFIER_PREFIX

See Also:

Constant Field Values

FAMILY_PREFIX

static final String FAMILY_PREFIX

See Also:

Constant Field Values

numQualifiers

private int numQualifiers

valueSize

private int valueSize

keySize

private int keySize

walsListenedTo

private final Set<org.apache.hadoop.hbase.wal.WAL> walsListenedTo

Constructor Detail

WALPerformanceEvaluation

public WALPerformanceEvaluation()

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

createHTableDescriptor

private static org.apache.hadoop.hbase.client.TableDescriptor createHTableDescriptor(int regionNum,
                                                                                     int numFamilies)

verify

private long verify(org.apache.hadoop.hbase.wal.WALFactory wals,
                    org.apache.hadoop.fs.Path wal,
                    boolean verbose)
             throws IOException

Verify the content of the WAL file. Verify that the file has expected number of edits.

Parameters:

wals - may not be null

wal -

Returns:

Count of edits.

Throws:

IOException

logBenchmarkResult

private static void logBenchmarkResult(String testName,
                                       long numTests,
                                       long totalTime)

printUsageAndExit

private void printUsageAndExit()

openRegion

private org.apache.hadoop.hbase.regionserver.HRegion openRegion(org.apache.hadoop.fs.FileSystem fs,
                                                                org.apache.hadoop.fs.Path dir,
                                                                org.apache.hadoop.hbase.client.TableDescriptor htd,
                                                                org.apache.hadoop.hbase.wal.WALFactory wals,
                                                                long whenToRoll,
                                                                org.apache.hadoop.hbase.regionserver.LogRoller roller)
                                                         throws IOException

Throws:

IOException

closeRegion

private void closeRegion(org.apache.hadoop.hbase.regionserver.HRegion region)
                  throws IOException

Throws:

IOException

cleanRegionRootDir

private void cleanRegionRootDir(org.apache.hadoop.fs.FileSystem fs,
                                org.apache.hadoop.fs.Path dir)
                         throws IOException

Throws:

IOException

setupPut

private org.apache.hadoop.hbase.client.Put setupPut(Random rand,
                                                    byte[] key,
                                                    byte[] value,
                                                    int numFamilies)

runBenchmark

private long runBenchmark(Runnable[] runnable,
                          int numThreads)
                   throws InterruptedException

Throws:

InterruptedException

innerMain

static int innerMain(org.apache.hadoop.conf.Configuration c,
                     String[] args)
              throws Exception

The guts of the main(java.lang.String[]) method. Call this method to avoid the main(String[]) System.exit.

Parameters:

args -

Returns:

errCode

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception