org.apache.hadoop.hbase.mapreduce

Class TsvImporterTextMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>

org.apache.hadoop.hbase.mapreduce.TsvImporterTextMapper

@InterfaceAudience.Public
public class TsvImporterTextMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>

Write table content out to map output files.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.hadoop.mapreduce.Counter	badLineCount
private boolean	logBadLines
private ImportTsv.TsvParser	parser
private String	separator Column seperator
private boolean	skipBadLines Should skip bad lines

Constructor Summary

Constructors

Constructor and Description
TsvImporterTextMapper()

Method Summary

Modifier and Type	Method and Description
protected void	doSetup(org.apache.hadoop.mapreduce.Mapper.Context context) Handles common parameter initialization that a subclass might want to leverage.
org.apache.hadoop.mapreduce.Counter	getBadLineCount()
boolean	getSkipBadLines()
void	incrementBadLineCount(int count)
void	map(org.apache.hadoop.io.LongWritable offset, org.apache.hadoop.io.Text value, org.apache.hadoop.mapreduce.Mapper.Context context) Convert a line of TSV text into an HBase table row.
protected void	setup(org.apache.hadoop.mapreduce.Mapper.Context context) Handles initializing this class with objects specific to it (i.e., the parser).

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

separator

private String separator

Column seperator

skipBadLines

private boolean skipBadLines

Should skip bad lines

badLineCount

private org.apache.hadoop.mapreduce.Counter badLineCount

logBadLines

private boolean logBadLines

parser

private ImportTsv.TsvParser parser

Constructor Detail

TsvImporterTextMapper

public TsvImporterTextMapper()

Method Detail

getSkipBadLines

public boolean getSkipBadLines()

getBadLineCount

public org.apache.hadoop.mapreduce.Counter getBadLineCount()

incrementBadLineCount

public void incrementBadLineCount(int count)

setup

protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Handles initializing this class with objects specific to it (i.e., the parser). Common initialization that might be leveraged by a subclass is done in doSetup. Hence a subclass may choose to override this method and call doSetup as well before handling it's own custom params. n

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>

doSetup

protected void doSetup(org.apache.hadoop.mapreduce.Mapper.Context context)

Handles common parameter initialization that a subclass might want to leverage. n

map

public void map(org.apache.hadoop.io.LongWritable offset,
                org.apache.hadoop.io.Text value,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException

Convert a line of TSV text into an HBase table row.

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,ImmutableBytesWritable,org.apache.hadoop.io.Text>

Throws:

IOException