org.apache.hadoop.hbase.mapred

Class TableOutputFormat

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<ImmutableBytesWritable,Put>

org.apache.hadoop.hbase.mapred.TableOutputFormat

All Implemented Interfaces:

org.apache.hadoop.mapred.OutputFormat<ImmutableBytesWritable,Put>

@InterfaceAudience.Public
public class TableOutputFormat
extends org.apache.hadoop.mapred.FileOutputFormat<ImmutableBytesWritable,Put>

Convert Map/Reduce output and write it to an HBase table

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	TableOutputFormat.TableRecordWriter Convert Reduce output (key, value) to (HStoreKey, KeyedDataArrayWritable) and write to an HBase table.

Nested classes/interfaces inherited from class org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

Field Summary

Fields

Modifier and Type	Field and Description
static String	OUTPUT_TABLE JobConf parameter that specifies the output table

Constructor Summary

Constructors

Constructor and Description
TableOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job)
org.apache.hadoop.mapred.RecordWriter	getRecordWriter(org.apache.hadoop.fs.FileSystem ignored, org.apache.hadoop.mapred.JobConf job, String name, org.apache.hadoop.util.Progressable progress) Creates a new record writer.

Methods inherited from class org.apache.hadoop.mapred.FileOutputFormat

getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath, setWorkOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OUTPUT_TABLE

public static final String OUTPUT_TABLE

JobConf parameter that specifies the output table

See Also:

Constant Field Values

Constructor Detail

TableOutputFormat

public TableOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapred.RecordWriter getRecordWriter(org.apache.hadoop.fs.FileSystem ignored,
                                                             org.apache.hadoop.mapred.JobConf job,
                                                             String name,
                                                             org.apache.hadoop.util.Progressable progress)
                                                      throws IOException

Creates a new record writer. Be aware that the baseline javadoc gives the impression that there is a single RecordWriter per job but in HBase, it is more natural if we give you a new RecordWriter per call of this method. You must close the returned RecordWriter when done. Failure to do so will drop writes.

Specified by:

getRecordWriter in interface org.apache.hadoop.mapred.OutputFormat<ImmutableBytesWritable,Put>

Specified by:

getRecordWriter in class org.apache.hadoop.mapred.FileOutputFormat<ImmutableBytesWritable,Put>

Parameters:

ignored - Ignored filesystem

job - Current JobConf

name - Name of the job

progress -

Returns:

The newly created writer instance.

Throws:

IOException - When creating the writer fails.

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.fs.FileSystem ignored,
                             org.apache.hadoop.mapred.JobConf job)
                      throws org.apache.hadoop.fs.FileAlreadyExistsException,
                             org.apache.hadoop.mapred.InvalidJobConfException,
                             IOException

Specified by:

checkOutputSpecs in interface org.apache.hadoop.mapred.OutputFormat<ImmutableBytesWritable,Put>

Overrides:

checkOutputSpecs in class org.apache.hadoop.mapred.FileOutputFormat<ImmutableBytesWritable,Put>

Throws:

org.apache.hadoop.fs.FileAlreadyExistsException

org.apache.hadoop.mapred.InvalidJobConfException

IOException