org.apache.hadoop.hbase.replication.regionserver

Class RegionReplicaReplicationEndpoint.RegionReplicaOutputSink

java.lang.Object

org.apache.hadoop.hbase.wal.WALSplitter.OutputSink

org.apache.hadoop.hbase.replication.regionserver.RegionReplicaReplicationEndpoint.RegionReplicaOutputSink

Enclosing class:

RegionReplicaReplicationEndpoint

static class RegionReplicaReplicationEndpoint.RegionReplicaOutputSink
extends WALSplitter.OutputSink

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.hbase.thirdparty.com.google.common.cache.Cache<TableName,Boolean>	memstoreReplicationEnabled
private RegionReplicaReplicationEndpoint.RegionReplicaSinkWriter	sinkWriter
private TableDescriptors	tableDescriptors

Fields inherited from class org.apache.hadoop.hbase.wal.WALSplitter.OutputSink

blacklistedRegions, closeAndCleanCompleted, controller, entryBuffers, numThreads, regionMaximumEditLogSeqNum, reporter, skippedEdits, splits, writers, writersClosed, writerThreads

Constructor Summary

Constructors

Constructor and Description
RegionReplicaOutputSink(WALSplitter.PipelineController controller, TableDescriptors tableDescriptors, WALSplitter.EntryBuffers entryBuffers, ClusterConnection connection, ExecutorService pool, int numWriters, int operationTimeout)

Method Summary

Modifier and Type	Method and Description
void	append(WALSplitter.RegionEntryBuffer buffer)
List<org.apache.hadoop.fs.Path>	finishWritingAndClose()
boolean	flush() WriterThread call this function to help flush internal remaining edits in buffer before close
int	getNumberOfRecoveredRegions()
Map<byte[],Long>	getOutputCounts()
(package private) AtomicLong	getSkippedEditsCounter()
boolean	keepRegionEvent(WAL.Entry entry) Some WALEdit's contain only KV's for account on what happened to a region.
private boolean	requiresReplication(TableName tableName, List<WAL.Entry> entries) returns true if the specified entry must be replicated.

Methods inherited from class org.apache.hadoop.hbase.wal.WALSplitter.OutputSink

finishWriting, startWriterThreads

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sinkWriter

private final RegionReplicaReplicationEndpoint.RegionReplicaSinkWriter sinkWriter

tableDescriptors

private final TableDescriptors tableDescriptors

memstoreReplicationEnabled

private final org.apache.hbase.thirdparty.com.google.common.cache.Cache<TableName,Boolean> memstoreReplicationEnabled

Constructor Detail

RegionReplicaOutputSink

public RegionReplicaOutputSink(WALSplitter.PipelineController controller,
                               TableDescriptors tableDescriptors,
                               WALSplitter.EntryBuffers entryBuffers,
                               ClusterConnection connection,
                               ExecutorService pool,
                               int numWriters,
                               int operationTimeout)

Method Detail

append

public void append(WALSplitter.RegionEntryBuffer buffer)
            throws IOException

Specified by:

append in class WALSplitter.OutputSink

Parameters:

buffer - A WAL Edit Entry

Throws:

IOException

flush

public boolean flush()
              throws IOException

Description copied from class: WALSplitter.OutputSink

WriterThread call this function to help flush internal remaining edits in buffer before close

Overrides:

flush in class WALSplitter.OutputSink

Returns:

true when underlying sink has something to flush

Throws:

IOException

keepRegionEvent

public boolean keepRegionEvent(WAL.Entry entry)

Description copied from class: WALSplitter.OutputSink

Some WALEdit's contain only KV's for account on what happened to a region. Not all sinks will want to get all of those edits.

Specified by:

keepRegionEvent in class WALSplitter.OutputSink

Returns:

Return true if this sink wants to accept this region-level WALEdit.

finishWritingAndClose

public List<org.apache.hadoop.fs.Path> finishWritingAndClose()
                                                      throws IOException

Specified by:

finishWritingAndClose in class WALSplitter.OutputSink

Throws:

IOException

getOutputCounts

public Map<byte[],Long> getOutputCounts()

Specified by:

getOutputCounts in class WALSplitter.OutputSink

Returns:

a map from encoded region ID to the number of edits written out for that region.

getNumberOfRecoveredRegions

public int getNumberOfRecoveredRegions()

Specified by:

getNumberOfRecoveredRegions in class WALSplitter.OutputSink

Returns:

number of regions we've recovered

getSkippedEditsCounter

AtomicLong getSkippedEditsCounter()

requiresReplication

private boolean requiresReplication(TableName tableName,
                                    List<WAL.Entry> entries)
                             throws IOException

returns true if the specified entry must be replicated. We should always replicate meta operations (e.g. flush) and use the user HTD flag to decide whether or not replicate the memstore.

Throws:

IOException