Constructor Detail

• WALSplitter.LogRecoveredEditsOutputSink

  public WALSplitter.LogRecoveredEditsOutputSink(WALSplitter.PipelineController controller,
                                         WALSplitter.EntryBuffers entryBuffers,
                                         int numWriters)

Method Detail

• finishWritingAndClose

  public List<org.apache.hadoop.fs.Path> finishWritingAndClose()
                                                        throws IOException

  Specified by:

  finishWritingAndClose in class WALSplitter.OutputSink

  Returns:

  null if failed to report progress

  Throws:

  IOException

• close

  private List<org.apache.hadoop.fs.Path> close()
                                         throws IOException

  Close all of the output streams.

  Returns:

  the list of paths written.

  Throws:

  IOException

• closeLogWriters

  private List<IOException> closeLogWriters(List<IOException> thrown)
                                     throws IOException

  Throws:

  IOException

• getWriterAndPath

  private WALSplitter.WriterAndPath getWriterAndPath(WAL.Entry entry)
                                              throws IOException

  Get a writer and path for a log starting at the given entry. This function is threadsafe so long as multiple threads are always acting on different regions.

  Returns:

  null if this region shouldn't output any logs

  Throws:

  IOException

• createWAP

  private WALSplitter.WriterAndPath createWAP(byte[] region,
                                    WAL.Entry entry,
                                    org.apache.hadoop.fs.Path rootdir)
                                       throws IOException

  Returns:

  a path with a write for that path. caller should close.

  Throws:

  IOException

• filterCellByStore

  private void filterCellByStore(WAL.Entry logEntry)

• append

  public void append(WALSplitter.RegionEntryBuffer buffer)
              throws IOException

  Specified by:

  append in class WALSplitter.OutputSink

  Parameters:

  buffer - A WAL Edit Entry

  Throws:

  IOException

• keepRegionEvent

  public boolean keepRegionEvent(WAL.Entry entry)

  Description copied from class: WALSplitter.OutputSink
  Some WALEdit's contain only KV's for account on what happened to a region. Not all sinks will want to get all of those edits.

  Specified by:

  keepRegionEvent in class WALSplitter.OutputSink

  Returns:

  Return true if this sink wants to accept this region-level WALEdit.

• getOutputCounts

  public Map<byte[],Long> getOutputCounts()

  Specified by:

  getOutputCounts in class WALSplitter.OutputSink

  Returns:

  a map from encoded region ID to the number of edits written out for that region.

• getNumberOfRecoveredRegions

  public int getNumberOfRecoveredRegions()

  Specified by:

  getNumberOfRecoveredRegions in class WALSplitter.OutputSink

  Returns:

  number of regions we've recovered