Package org.apache.hadoop.hbase.wal

Class WALPerformanceEvaluation

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.wal.WALPerformanceEvaluation

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

@LimitedPrivate("Tools")
public final class WALPerformanceEvaluation
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

This class runs performance benchmarks for WAL. See usage for this tool by running: $ hbase org.apache.hadoop.hbase.wal.WALPerformanceEvaluation -h

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) class	WALPerformanceEvaluation.WALPutBenchmark	Perform WAL.append() of Put object, for the number of iterations requested.

Field Summary

Fields

Modifier and Type	Field	Description
private final com.codahale.metrics.Meter	appendMeter
(package private) static final String	FAMILY_PREFIX
private int	keySize
private final com.codahale.metrics.Histogram	latencyHistogram
private static final org.slf4j.Logger	LOG
private final com.codahale.metrics.MetricRegistry	metrics
private final MultiVersionConcurrencyControl	mvcc
private int	numQualifiers
(package private) static final String	QUALIFIER_PREFIX
private final com.codahale.metrics.Histogram	syncCountHistogram
private final com.codahale.metrics.Histogram	syncHistogram
private final com.codahale.metrics.Meter	syncMeter
(package private) static final String	TABLE_NAME
private int	valueSize
private final Set<WAL>	walsListenedTo

Constructor Summary

Constructors

Constructor	Description
WALPerformanceEvaluation()

Method Summary

Modifier and Type	Method	Description
private void	cleanRegionRootDir(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dir)
private void	closeRegion(HRegion region)
private static TableDescriptor	createHTableDescriptor(int regionNum, int numFamilies)
(package private) static int	innerMain(org.apache.hadoop.conf.Configuration c, String[] args)	The guts of the main(java.lang.String[]) method.
private static void	logBenchmarkResult(String testName, long numTests, long totalTime)
static void	main(String[] args)
private HRegion	openRegion(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dir, TableDescriptor htd, WALFactory wals, long whenToRoll, LogRoller roller)
private void	printUsageAndExit()
int	run(String[] args)
private long	runBenchmark(Runnable[] runnable, int numThreads)
void	setConf(org.apache.hadoop.conf.Configuration conf)
private Put	setupPut(Random rand, byte[] key, byte[] value, int numFamilies)
private long	verify(WALFactory wals, org.apache.hadoop.fs.Path wal, boolean verbose)	Verify the content of the WAL file.

Methods inherited from class org.apache.hadoop.conf.Configured

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf

Field Details

LOG

private static final org.slf4j.Logger LOG

metrics

private final com.codahale.metrics.MetricRegistry metrics

syncMeter

private final com.codahale.metrics.Meter syncMeter

syncHistogram

private final com.codahale.metrics.Histogram syncHistogram

syncCountHistogram

private final com.codahale.metrics.Histogram syncCountHistogram

appendMeter

private final com.codahale.metrics.Meter appendMeter

latencyHistogram

private final com.codahale.metrics.Histogram latencyHistogram

mvcc

private final MultiVersionConcurrencyControl mvcc

TABLE_NAME

static final String TABLE_NAME

See Also:

• Constant Field Values

QUALIFIER_PREFIX

static final String QUALIFIER_PREFIX

See Also:

• Constant Field Values

FAMILY_PREFIX

static final String FAMILY_PREFIX

See Also:

• Constant Field Values

numQualifiers

private int numQualifiers

valueSize

private int valueSize

keySize

private int keySize

walsListenedTo

private final Set<WAL> walsListenedTo

Constructor Details

WALPerformanceEvaluation

public WALPerformanceEvaluation()

Method Details

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

createHTableDescriptor

private static TableDescriptor createHTableDescriptor(int regionNum,
 int numFamilies)

verify

private long verify(WALFactory wals,
 org.apache.hadoop.fs.Path wal,
 boolean verbose)
             throws IOException

Verify the content of the WAL file. Verify that the file has expected number of edits.

Parameters:

wals - may not be null

Returns:

Count of edits.

Throws:

IOException

logBenchmarkResult

private static void logBenchmarkResult(String testName,
 long numTests,
 long totalTime)

printUsageAndExit

private void printUsageAndExit()

openRegion

private HRegion openRegion(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path dir,
 TableDescriptor htd,
 WALFactory wals,
 long whenToRoll,
 LogRoller roller)
                    throws IOException

Throws:

IOException

closeRegion

private void closeRegion(HRegion region)
                  throws IOException

Throws:

IOException

cleanRegionRootDir

private void cleanRegionRootDir(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path dir)
                         throws IOException

Throws:

IOException

setupPut

private Put setupPut(Random rand,
 byte[] key,
 byte[] value,
 int numFamilies)

runBenchmark

private long runBenchmark(Runnable[] runnable,
 int numThreads)
                   throws InterruptedException

Throws:

InterruptedException

innerMain

static int innerMain(org.apache.hadoop.conf.Configuration c,
 String[] args)
              throws Exception

The guts of the main(java.lang.String[]) method. Call this method to avoid the main(String[]) System.exit.

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception