org.apache.hadoop.hbase.mapreduce

Class MultiTableOutputFormat.MultiTableRecordWriter

java.lang.Object

org.apache.hadoop.mapreduce.RecordWriter<ImmutableBytesWritable,Mutation>

org.apache.hadoop.hbase.mapreduce.MultiTableOutputFormat.MultiTableRecordWriter

Enclosing class:

MultiTableOutputFormat

protected static class MultiTableOutputFormat.MultiTableRecordWriter
extends org.apache.hadoop.mapreduce.RecordWriter<ImmutableBytesWritable,Mutation>

Record writer for outputting to multiple HTables.

Field Summary

Fields

Modifier and Type	Field and Description
(package private) org.apache.hadoop.conf.Configuration	conf
(package private) Connection	connection
private static org.slf4j.Logger	LOG
(package private) Map<ImmutableBytesWritable,BufferedMutator>	mutatorMap
(package private) boolean	useWriteAheadLogging

Constructor Summary

Constructors

Constructor and Description
MultiTableRecordWriter(org.apache.hadoop.conf.Configuration conf, boolean useWriteAheadLogging)

Method Summary

Modifier and Type	Method and Description
void	close(org.apache.hadoop.mapreduce.TaskAttemptContext context)
(package private) BufferedMutator	getBufferedMutator(ImmutableBytesWritable tableName)
void	write(ImmutableBytesWritable tableName, Mutation action) Writes an action (Put or Delete) to the specified table.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

connection

Connection connection

mutatorMap

Map<ImmutableBytesWritable,BufferedMutator> mutatorMap

conf

org.apache.hadoop.conf.Configuration conf

useWriteAheadLogging

boolean useWriteAheadLogging

Constructor Detail

MultiTableRecordWriter

public MultiTableRecordWriter(org.apache.hadoop.conf.Configuration conf,
                              boolean useWriteAheadLogging)
                       throws IOException

Parameters:

conf - HBaseConfiguration to used

useWriteAheadLogging - whether to use write ahead logging. This can be turned off ( false) to improve performance when bulk loading data.

Throws:

IOException

Method Detail

getBufferedMutator

BufferedMutator getBufferedMutator(ImmutableBytesWritable tableName)
                            throws IOException

Parameters:

tableName - the name of the table, as a string

Returns:

the named mutator

Throws:

IOException - if there is a problem opening a table

close

public void close(org.apache.hadoop.mapreduce.TaskAttemptContext context)
           throws IOException

Specified by:

close in class org.apache.hadoop.mapreduce.RecordWriter<ImmutableBytesWritable,Mutation>

Throws:

IOException

write

public void write(ImmutableBytesWritable tableName,
                  Mutation action)
           throws IOException

Writes an action (Put or Delete) to the specified table.

Specified by:

write in class org.apache.hadoop.mapreduce.RecordWriter<ImmutableBytesWritable,Mutation>

Parameters:

tableName - the table being updated.

action - the update, either a put or a delete.

Throws:

IllegalArgumentException - if the action is not a put or a delete.

IOException