org.apache.hadoop.hbase.regionserver

Class StoreFlusher

java.lang.Object

org.apache.hadoop.hbase.regionserver.StoreFlusher

Direct Known Subclasses:

DefaultStoreFlusher, StripeStoreFlusher

@InterfaceAudience.Private
abstract class StoreFlusher
extends Object

Store flusher interface. Turns a snapshot of memstore into a set of store files (usually one). Custom implementation can be provided.

Field Summary

Fields

Modifier and Type	Field and Description
protected org.apache.hadoop.conf.Configuration	conf
protected HStore	store

Constructor Summary

Constructors

Constructor and Description
StoreFlusher(org.apache.hadoop.conf.Configuration conf, HStore store)

Method Summary

Modifier and Type	Method and Description
protected InternalScanner	createScanner(List<KeyValueScanner> snapshotScanners, FlushLifeCycleTracker tracker) Creates the scanner for flushing snapshot.
protected StoreFileWriter	createWriter(MemStoreSnapshot snapshot, boolean alwaysIncludesTag, Consumer<org.apache.hadoop.fs.Path> writerCreationTracker)
protected void	finalizeWriter(StoreFileWriter writer, long cacheFlushSeqNum, MonitoredTask status)
abstract List<org.apache.hadoop.fs.Path>	flushSnapshot(MemStoreSnapshot snapshot, long cacheFlushSeqNum, MonitoredTask status, ThroughputController throughputController, FlushLifeCycleTracker tracker, Consumer<org.apache.hadoop.fs.Path> writerCreationTracker) Turns a snapshot of memstore into a set of store files.
protected void	performFlush(InternalScanner scanner, CellSink sink, ThroughputController throughputController) Performs memstore flush, writing data from scanner into sink.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

conf

protected org.apache.hadoop.conf.Configuration conf

store

protected HStore store

Constructor Detail

StoreFlusher

public StoreFlusher(org.apache.hadoop.conf.Configuration conf,
                    HStore store)

Method Detail

flushSnapshot

public abstract List<org.apache.hadoop.fs.Path> flushSnapshot(MemStoreSnapshot snapshot,
                                                              long cacheFlushSeqNum,
                                                              MonitoredTask status,
                                                              ThroughputController throughputController,
                                                              FlushLifeCycleTracker tracker,
                                                              Consumer<org.apache.hadoop.fs.Path> writerCreationTracker)
                                                       throws IOException

Turns a snapshot of memstore into a set of store files.

Parameters:

snapshot - Memstore snapshot.

cacheFlushSeqNum - Log cache flush sequence number.

status - Task that represents the flush operation and may be updated with status.

throughputController - A controller to avoid flush too fast

Returns:

List of files written. Can be empty; must not be null.

Throws:

IOException

finalizeWriter

protected void finalizeWriter(StoreFileWriter writer,
                              long cacheFlushSeqNum,
                              MonitoredTask status)
                       throws IOException

Throws:

IOException

createWriter

protected final StoreFileWriter createWriter(MemStoreSnapshot snapshot,
                                             boolean alwaysIncludesTag,
                                             Consumer<org.apache.hadoop.fs.Path> writerCreationTracker)
                                      throws IOException

Throws:

IOException

createScanner

protected final InternalScanner createScanner(List<KeyValueScanner> snapshotScanners,
                                              FlushLifeCycleTracker tracker)
                                       throws IOException

Creates the scanner for flushing snapshot. Also calls coprocessors.

Returns:

The scanner; null if coprocessor is canceling the flush.

Throws:

IOException

performFlush

protected void performFlush(InternalScanner scanner,
                            CellSink sink,
                            ThroughputController throughputController)
                     throws IOException

Performs memstore flush, writing data from scanner into sink.

Parameters:

scanner - Scanner to get data from.

sink - Sink to write data to. Could be StoreFile.Writer.

throughputController - A controller to avoid flush too fast

Throws:

IOException