org.apache.hadoop.hbase.mapreduce.replication

Class VerifyReplication.Verifier

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,KEYOUT,VALUEOUT>

org.apache.hadoop.hbase.mapreduce.TableMapper<ImmutableBytesWritable,Put>

org.apache.hadoop.hbase.mapreduce.replication.VerifyReplication.Verifier

Enclosing class:

VerifyReplication

public static class VerifyReplication.Verifier
extends TableMapper<ImmutableBytesWritable,Put>

Map-only comparator for 2 tables

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	VerifyReplication.Verifier.Counters

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields

Modifier and Type	Field and Description
private int	batch
private Result	currentCompareRowInPeerTable
private String	delimiter
private Connection	replicatedConnection
private ResultScanner	replicatedScanner
private Table	replicatedTable
private int	sleepMsBeforeReCompare
private Connection	sourceConnection
private Table	sourceTable
private boolean	verbose

Constructor Summary

Constructors

Constructor and Description
Verifier()

Method Summary

Modifier and Type	Method and Description
protected void	cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
private void	logFailRowAndIncreaseCounter(org.apache.hadoop.mapreduce.Mapper.Context context, VerifyReplication.Verifier.Counters counter, Result row)
void	map(ImmutableBytesWritable row, Result value, org.apache.hadoop.mapreduce.Mapper.Context context) Map method that compares every scanned row with the equivalent from a distant cluster.

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sourceConnection

private Connection sourceConnection

sourceTable

private Table sourceTable

replicatedConnection

private Connection replicatedConnection

replicatedTable

private Table replicatedTable

replicatedScanner

private ResultScanner replicatedScanner

currentCompareRowInPeerTable

private Result currentCompareRowInPeerTable

sleepMsBeforeReCompare

private int sleepMsBeforeReCompare

delimiter

private String delimiter

verbose

private boolean verbose

batch

private int batch

Constructor Detail

Verifier

public Verifier()

Method Detail

map

public void map(ImmutableBytesWritable row,
                Result value,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException

Map method that compares every scanned row with the equivalent from a distant cluster.

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>

Parameters:

row - The current table row key.

value - The columns.

context - The current context.

Throws:

IOException - When something is broken with the data.

logFailRowAndIncreaseCounter

private void logFailRowAndIncreaseCounter(org.apache.hadoop.mapreduce.Mapper.Context context,
                                          VerifyReplication.Verifier.Counters counter,
                                          Result row)

cleanup

protected void cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Mapper<ImmutableBytesWritable,Result,ImmutableBytesWritable,Put>