org.apache.hadoop.hbase.wal

Class BoundedRecoveredEditsOutputSink

java.lang.Object

org.apache.hadoop.hbase.wal.OutputSink

org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink

org.apache.hadoop.hbase.wal.BoundedRecoveredEditsOutputSink

@InterfaceAudience.Private
class BoundedRecoveredEditsOutputSink
extends AbstractRecoveredEditsOutputSink

Class that manages the output streams from the log splitting process. Every region may have many recovered edits file. But the opening writers is bounded. Bounded means the output streams will be no more than the size of threadpool.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink

AbstractRecoveredEditsOutputSink.RecoveredEditsWriter

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.wal.OutputSink

OutputSink.WriterThread

Field Summary

Fields

Modifier and Type	Field and Description
private static org.slf4j.Logger	LOG
private AtomicInteger	openingWritersNum
private ConcurrentMap<String,Long>	regionEditsWrittenMap

Fields inherited from class org.apache.hadoop.hbase.wal.OutputSink

closeCompletionService, closeThreadPool, entryBuffers, numThreads, reporter, splits, status, totalSkippedEdits

Constructor Summary

Constructors

Constructor and Description
BoundedRecoveredEditsOutputSink(WALSplitter walSplitter, WALSplitter.PipelineController controller, EntryBuffers entryBuffers, int numWriters)

Method Summary

Modifier and Type	Method and Description
void	append(EntryBuffers.RegionEntryBuffer buffer)
List<org.apache.hadoop.fs.Path>	close()
int	getNumberOfRecoveredRegions()
int	getNumOpenWriters()
Map<String,Long>	getOutputCounts()
private boolean	writeRemainingEntryBuffers() Write out the remaining RegionEntryBuffers and close the writers.

Methods inherited from class org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink

closeRecoveredEditsWriter, createRecoveredEditsWriter, keepRegionEvent, updateRegionMaximumEditLogSeqNum

Methods inherited from class org.apache.hadoop.hbase.wal.OutputSink

finishWriterThreads, getTotalSkippedEdits, restartWriterThreadsIfNeeded, setReporter, setStatus, startWriterThreads, updateStatusWithMsg

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

regionEditsWrittenMap

private ConcurrentMap<String,Long> regionEditsWrittenMap

openingWritersNum

private final AtomicInteger openingWritersNum

Constructor Detail

BoundedRecoveredEditsOutputSink

public BoundedRecoveredEditsOutputSink(WALSplitter walSplitter,
                                       WALSplitter.PipelineController controller,
                                       EntryBuffers entryBuffers,
                                       int numWriters)

Method Detail

append

public void append(EntryBuffers.RegionEntryBuffer buffer)
            throws IOException

Specified by:

append in class OutputSink

Parameters:

buffer - A buffer of some number of edits for a given region.

Throws:

IOException - For any IO errors

close

public List<org.apache.hadoop.fs.Path> close()
                                      throws IOException

Specified by:

close in class OutputSink

Throws:

IOException

writeRemainingEntryBuffers

private boolean writeRemainingEntryBuffers()
                                    throws IOException

Write out the remaining RegionEntryBuffers and close the writers.

Returns:

true when there is no error.

Throws:

IOException

getOutputCounts

public Map<String,Long> getOutputCounts()

Specified by:

getOutputCounts in class OutputSink

Returns:

a map from encoded region ID to the number of edits written out for that region.

getNumberOfRecoveredRegions

public int getNumberOfRecoveredRegions()

Specified by:

getNumberOfRecoveredRegions in class OutputSink

Returns:

number of regions we've recovered

getNumOpenWriters

public int getNumOpenWriters()

Specified by:

getNumOpenWriters in class OutputSink

Returns:

the number of currently opened writers