org.apache.hadoop.hbase.regionserver

Class StripeMultiFileWriter.SizeMultiWriter

java.lang.Object

org.apache.hadoop.hbase.regionserver.AbstractMultiFileWriter

org.apache.hadoop.hbase.regionserver.StripeMultiFileWriter

org.apache.hadoop.hbase.regionserver.StripeMultiFileWriter.SizeMultiWriter

All Implemented Interfaces:

CellSink, ShipperListener

Enclosing class:

StripeMultiFileWriter

public static class StripeMultiFileWriter.SizeMultiWriter
extends StripeMultiFileWriter

MultiWriter that separates the cells based on target cell number per file and file count. New file is started every time the target number of KVs is reached, unless the fixed count of writers has already been created (in that case all the remaining KVs go into the last writer).

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.StripeMultiFileWriter

StripeMultiFileWriter.BoundaryMultiWriter, StripeMultiFileWriter.SizeMultiWriter

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.AbstractMultiFileWriter

AbstractMultiFileWriter.WriterFactory

Field Summary

Fields

Modifier and Type	Field and Description
private long	cellsInCurrentWriter
private long	cellsSeen
private long	cellsSeenInPrevious
private StoreFileWriter	currentWriter
private Cell	lastCell
protected byte[]	lastRowInCurrentWriter
private byte[]	left
private byte[]	right
private long	targetCells
private int	targetCount

Fields inherited from class org.apache.hadoop.hbase.regionserver.StripeMultiFileWriter

boundaries, comparator, existingWriters

Fields inherited from class org.apache.hadoop.hbase.regionserver.AbstractMultiFileWriter

sourceScanner, writerFactory

Constructor Summary

Constructors

Constructor and Description
SizeMultiWriter(CellComparator comparator, int targetCount, long targetKvs, byte[] left, byte[] right)

Method Summary

Modifier and Type	Method and Description
void	append(Cell cell) Append the given cell
protected void	preCommitWritersInternal()

Methods inherited from class org.apache.hadoop.hbase.regionserver.StripeMultiFileWriter

preCloseWriter, preCommitWriters, sanityCheckLeft, sanityCheckRight, setNoStripeMetadata, writers

Methods inherited from class org.apache.hadoop.hbase.regionserver.AbstractMultiFileWriter

abortWriters, beforeShipped, commitWriters, init

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

targetCount

private int targetCount

targetCells

private long targetCells

left

private byte[] left

right

private byte[] right

lastCell

private Cell lastCell

currentWriter

private StoreFileWriter currentWriter

lastRowInCurrentWriter

protected byte[] lastRowInCurrentWriter

cellsInCurrentWriter

private long cellsInCurrentWriter

cellsSeen

private long cellsSeen

cellsSeenInPrevious

private long cellsSeenInPrevious

Constructor Detail

SizeMultiWriter

public SizeMultiWriter(CellComparator comparator,
                       int targetCount,
                       long targetKvs,
                       byte[] left,
                       byte[] right)

Parameters:

targetCount - The maximum count of writers that can be created.

targetKvs - The number of KVs to read from source before starting each new writer.

left - The left boundary of the first writer.

right - The right boundary of the last writer.

Method Detail

append

public void append(Cell cell)
            throws IOException

Description copied from interface: CellSink

Append the given cell

Parameters:

cell - the cell to be added

Throws:

IOException

preCommitWritersInternal

protected void preCommitWritersInternal()
                                 throws IOException

Specified by:

preCommitWritersInternal in class StripeMultiFileWriter

Throws:

IOException