org.apache.hadoop.hbase.replication.regionserver

Class RegionReplicaReplicationEndpoint.RegionReplicaOutputSink

java.lang.Object

org.apache.hadoop.hbase.wal.OutputSink

org.apache.hadoop.hbase.replication.regionserver.RegionReplicaReplicationEndpoint.RegionReplicaOutputSink

Enclosing class:

RegionReplicaReplicationEndpoint

static class RegionReplicaReplicationEndpoint.RegionReplicaOutputSink
extends OutputSink

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.wal.OutputSink

OutputSink.WriterThread

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.hbase.thirdparty.com.google.common.cache.Cache<TableName,Boolean>	memstoreReplicationEnabled
private RegionReplicaReplicationEndpoint.RegionReplicaSinkWriter	sinkWriter
private TableDescriptors	tableDescriptors

Fields inherited from class org.apache.hadoop.hbase.wal.OutputSink

closeCompletionService, closeThreadPool, entryBuffers, numThreads, reporter, splits, status, totalSkippedEdits

Constructor Summary

Constructors

Constructor and Description
RegionReplicaOutputSink(WALSplitter.PipelineController controller, TableDescriptors tableDescriptors, EntryBuffers entryBuffers, ClusterConnection connection, ExecutorService pool, int numWriters, int operationTimeout)

Method Summary

Modifier and Type	Method and Description
void	append(EntryBuffers.RegionEntryBuffer buffer)
List<org.apache.hadoop.fs.Path>	close()
(package private) void	flush()
int	getNumberOfRecoveredRegions()
protected int	getNumOpenWriters()
Map<String,Long>	getOutputCounts()
(package private) AtomicLong	getSkippedEditsCounter()
boolean	keepRegionEvent(WAL.Entry entry) Some WALEdit's contain only KV's for account on what happened to a region.
private boolean	requiresReplication(TableName tableName, List<WAL.Entry> entries) returns true if the specified entry must be replicated.

Methods inherited from class org.apache.hadoop.hbase.wal.OutputSink

finishWriterThreads, restartWriterThreadsIfNeeded, startWriterThreads, updateStatusWithMsg

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

sinkWriter

private final RegionReplicaReplicationEndpoint.RegionReplicaSinkWriter sinkWriter

tableDescriptors

private final TableDescriptors tableDescriptors

memstoreReplicationEnabled

private final org.apache.hbase.thirdparty.com.google.common.cache.Cache<TableName,Boolean> memstoreReplicationEnabled

Constructor Detail

RegionReplicaOutputSink

public RegionReplicaOutputSink(WALSplitter.PipelineController controller,
                               TableDescriptors tableDescriptors,
                               EntryBuffers entryBuffers,
                               ClusterConnection connection,
                               ExecutorService pool,
                               int numWriters,
                               int operationTimeout)

Method Detail

append

public void append(EntryBuffers.RegionEntryBuffer buffer)
            throws IOException

Specified by:

append in class OutputSink

Parameters:

buffer - A buffer of some number of edits for a given region.

Throws:

IOException - For any IO errors

flush

void flush()
    throws IOException

Throws:

IOException

keepRegionEvent

public boolean keepRegionEvent(WAL.Entry entry)

Description copied from class: OutputSink

Some WALEdit's contain only KV's for account on what happened to a region. Not all sinks will want to get all of those edits.

Specified by:

keepRegionEvent in class OutputSink

Returns:

Return true if this sink wants to accept this region-level WALEdit.

close

public List<org.apache.hadoop.fs.Path> close()
                                      throws IOException

Specified by:

close in class OutputSink

Throws:

IOException

getOutputCounts

public Map<String,Long> getOutputCounts()

Specified by:

getOutputCounts in class OutputSink

Returns:

a map from encoded region ID to the number of edits written out for that region.

getNumberOfRecoveredRegions

public int getNumberOfRecoveredRegions()

Specified by:

getNumberOfRecoveredRegions in class OutputSink

Returns:

number of regions we've recovered

getSkippedEditsCounter

AtomicLong getSkippedEditsCounter()

requiresReplication

private boolean requiresReplication(TableName tableName,
                                    List<WAL.Entry> entries)
                             throws IOException

returns true if the specified entry must be replicated. We should always replicate meta operations (e.g. flush) and use the user HTD flag to decide whether or not replicate the memstore.

Throws:

IOException

getNumOpenWriters

protected int getNumOpenWriters()

Specified by:

getNumOpenWriters in class OutputSink

Returns:

the number of currently opened writers