org.apache.hadoop.hbase.mapreduce

Class WALPlayer

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.mapreduce.WALPlayer

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

@InterfaceAudience.Public
public class WALPlayer
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

A tool to replay WAL files as a M/R job. The WAL can be replayed for a set of tables or all tables, and a time range can be provided (in milliseconds). The WAL is filtered to the passed set of tables and the output can optionally be mapped to another set of tables. WAL replay can also generate HFiles for later bulk importing, in that case the WAL is replayed for a single table only.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	WALPlayer.Counter Enum for map metrics.
(package private) static class	WALPlayer.WALCellMapper A mapper that just writes out Cells.
(package private) static class	WALPlayer.WALKeyValueMapper Deprecated. Use WALPlayer.WALCellMapper. Will be removed from 3.0 onwards
protected static class	WALPlayer.WALMapper A mapper that writes out Mutation to be directly applied to a running HBase instance.

Field Summary

Fields

Modifier and Type	Field and Description
static String	BULK_OUTPUT_CONF_KEY
static String	IGNORE_MISSING_FILES
static String	INPUT_FILES_SEPARATOR_KEY
private static String	JOB_NAME_CONF_KEY
private static org.slf4j.Logger	LOG
(package private) static String	NAME
static String	TABLE_MAP_KEY
static String	TABLES_KEY

Constructor Summary

Constructors

Modifier	Constructor and Description
	WALPlayer()
protected	WALPlayer(org.apache.hadoop.conf.Configuration c)

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.Job	createSubmittableJob(String[] args) Sets up the actual job.
static void	main(String[] args) Main entry point.
int	run(String[] args)
(package private) void	setupTime(org.apache.hadoop.conf.Configuration conf, String option)
private void	usage(String errorMsg) Print usage

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Field Detail

LOG

private static final org.slf4j.Logger LOG

NAME

static final String NAME

See Also:

Constant Field Values

BULK_OUTPUT_CONF_KEY

public static final String BULK_OUTPUT_CONF_KEY

See Also:

Constant Field Values

TABLES_KEY

public static final String TABLES_KEY

See Also:

Constant Field Values

TABLE_MAP_KEY

public static final String TABLE_MAP_KEY

See Also:

Constant Field Values

INPUT_FILES_SEPARATOR_KEY

public static final String INPUT_FILES_SEPARATOR_KEY

See Also:

Constant Field Values

IGNORE_MISSING_FILES

public static final String IGNORE_MISSING_FILES

See Also:

Constant Field Values

JOB_NAME_CONF_KEY

private static final String JOB_NAME_CONF_KEY

See Also:

Constant Field Values

Constructor Detail

WALPlayer

public WALPlayer()

WALPlayer

protected WALPlayer(org.apache.hadoop.conf.Configuration c)

Method Detail

setupTime

void setupTime(org.apache.hadoop.conf.Configuration conf,
               String option)
        throws IOException

Throws:

IOException

createSubmittableJob

public org.apache.hadoop.mapreduce.Job createSubmittableJob(String[] args)
                                                     throws IOException

Sets up the actual job.

Parameters:

args - The command line parameters.

Returns:

The newly created job.

Throws:

IOException - When setting up the job fails.

usage

private void usage(String errorMsg)

Print usage

Parameters:

errorMsg - Error message. Can be null.

main

public static void main(String[] args)
                 throws Exception

Main entry point.

Parameters:

args - The command line parameters.

Throws:

Exception - When running the job fails.

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception