Package org.apache.hadoop.hbase.wal

Class BoundedRecoveredEditsOutputSink

java.lang.Object

org.apache.hadoop.hbase.wal.OutputSink

org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink

org.apache.hadoop.hbase.wal.BoundedRecoveredEditsOutputSink

@Private
class BoundedRecoveredEditsOutputSink
extends AbstractRecoveredEditsOutputSink

Class that manages the output streams from the log splitting process. Every region may have many recovered edits file. But the opening writers is bounded. Bounded means the output streams will be no more than the size of threadpool.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink

AbstractRecoveredEditsOutputSink.RecoveredEditsWriter

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.wal.OutputSink

OutputSink.WriterThread

Field Summary

Fields

Modifier and Type	Field	Description
private static final org.slf4j.Logger	LOG
private final AtomicInteger	openingWritersNum
private ConcurrentMap<String,Long>	regionEditsWrittenMap

Fields inherited from class org.apache.hadoop.hbase.wal.OutputSink

closeCompletionService, closeThreadPool, entryBuffers, numThreads, reporter, splits, status, totalSkippedEdits

Constructor Summary

Constructors

Constructor	Description
BoundedRecoveredEditsOutputSink(WALSplitter walSplitter, WALSplitter.PipelineController controller, EntryBuffers entryBuffers, int numWriters)

Method Summary

Modifier and Type	Method	Description
void	append(EntryBuffers.RegionEntryBuffer buffer)
List<org.apache.hadoop.fs.Path>	close()
int	getNumberOfRecoveredRegions()	Returns number of regions we've recovered
(package private) int	getNumOpenWriters()	Returns the number of currently opened writers
Map<String,Long>	getOutputCounts()	Returns a map from encoded region ID to the number of edits written out for that region.
private boolean	writeRemainingEntryBuffers()	Write out the remaining RegionEntryBuffers and close the writers.

Methods inherited from class org.apache.hadoop.hbase.wal.AbstractRecoveredEditsOutputSink

closeRecoveredEditsWriter, createRecoveredEditsWriter, keepRegionEvent, updateRegionMaximumEditLogSeqNum

Methods inherited from class org.apache.hadoop.hbase.wal.OutputSink

finishWriterThreads, getTotalSkippedEdits, setReporter, setStatus, startWriterThreads, updateStatusWithMsg

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

regionEditsWrittenMap

private ConcurrentMap<String,Long> regionEditsWrittenMap

openingWritersNum

private final AtomicInteger openingWritersNum

Constructor Details

BoundedRecoveredEditsOutputSink

public BoundedRecoveredEditsOutputSink(WALSplitter walSplitter,
 WALSplitter.PipelineController controller,
 EntryBuffers entryBuffers,
 int numWriters)

Method Details

append

public void append(EntryBuffers.RegionEntryBuffer buffer)
            throws IOException

Specified by:

append in class OutputSink

Parameters:

buffer - A buffer of some number of edits for a given region.

Throws:

IOException - For any IO errors

close

public List<org.apache.hadoop.fs.Path> close()
                                      throws IOException

Specified by:

close in class OutputSink

Throws:

IOException

writeRemainingEntryBuffers

private boolean writeRemainingEntryBuffers()
                                    throws IOException

Write out the remaining RegionEntryBuffers and close the writers.

Returns:

true when there is no error.

Throws:

IOException

getOutputCounts

public Map<String,Long> getOutputCounts()

Description copied from class: OutputSink

Returns a map from encoded region ID to the number of edits written out for that region.

Specified by:

getOutputCounts in class OutputSink

getNumberOfRecoveredRegions

public int getNumberOfRecoveredRegions()

Description copied from class: OutputSink

Returns number of regions we've recovered

Specified by:

getNumberOfRecoveredRegions in class OutputSink

getNumOpenWriters

int getNumOpenWriters()

Description copied from class: OutputSink

Returns the number of currently opened writers

Specified by:

getNumOpenWriters in class OutputSink