org.apache.hadoop.hbase.regionserver.compactions

Class DefaultCompactor

java.lang.Object

org.apache.hadoop.hbase.regionserver.compactions.Compactor<StoreFileWriter>

org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor

Direct Known Subclasses:

DefaultMobStoreCompactor

@InterfaceAudience.Private
public class DefaultCompactor
extends Compactor<StoreFileWriter>

Compact passed set of files. Create an instance and then call compact(CompactionRequestImpl, ThroughputController, User)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.compactions.Compactor

Compactor.CellSinkFactory<S>, Compactor.FileDetails, Compactor.InternalScannerFactory

Field Summary

Fields

Modifier and Type	Field and Description
private static org.slf4j.Logger	LOG
private Compactor.CellSinkFactory<StoreFileWriter>	writerFactory

Fields inherited from class org.apache.hadoop.hbase.regionserver.compactions.Compactor

COMPACTION_PROGRESS_LOG_INTERVAL, compactionCompression, compactionKVMax, conf, defaultScannerFactory, keepSeqIdPeriod, MAJOR_COMPACTION_DROP_CACHE, MINOR_COMPACTION_DROP_CACHE, progress, store

Constructor Summary

Constructors

Constructor and Description
DefaultCompactor(org.apache.hadoop.conf.Configuration conf, HStore store)

Method Summary

Modifier and Type	Method and Description
protected void	abortWriter(StoreFileWriter writer)
protected List<org.apache.hadoop.fs.Path>	commitWriter(StoreFileWriter writer, Compactor.FileDetails fd, CompactionRequestImpl request)
List<org.apache.hadoop.fs.Path>	compact(CompactionRequestImpl request, ThroughputController throughputController, User user) Do a minor/major compaction on an explicit set of storefiles from a Store.
List<org.apache.hadoop.fs.Path>	compactForTesting(Collection<HStoreFile> filesToCompact, boolean isMajor) Compact a list of files for testing.

Methods inherited from class org.apache.hadoop.hbase.regionserver.compactions.Compactor

compact, createScanner, createScanner, createTmpWriter, createTmpWriter, getProgress, performCompaction

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

writerFactory

private final Compactor.CellSinkFactory<StoreFileWriter> writerFactory

Constructor Detail

DefaultCompactor

public DefaultCompactor(org.apache.hadoop.conf.Configuration conf,
                        HStore store)

Method Detail

compact

public List<org.apache.hadoop.fs.Path> compact(CompactionRequestImpl request,
                                               ThroughputController throughputController,
                                               User user)
                                        throws IOException

Do a minor/major compaction on an explicit set of storefiles from a Store.

Throws:

IOException

compactForTesting

public List<org.apache.hadoop.fs.Path> compactForTesting(Collection<HStoreFile> filesToCompact,
                                                         boolean isMajor)
                                                  throws IOException

Compact a list of files for testing. Creates a fake CompactionRequestImpl to pass to compact(CompactionRequestImpl, ThroughputController, User);

Parameters:

filesToCompact - the files to compact. These are used as the compactionSelection for the generated CompactionRequestImpl.

isMajor - true to major compact (prune all deletes, max versions, etc)

Returns:

Product of compaction or an empty list if all cells expired or deleted and nothing \ made it through the compaction.

Throws:

IOException

commitWriter

protected List<org.apache.hadoop.fs.Path> commitWriter(StoreFileWriter writer,
                                                       Compactor.FileDetails fd,
                                                       CompactionRequestImpl request)
                                                throws IOException

Specified by:

commitWriter in class Compactor<StoreFileWriter>

Throws:

IOException

abortWriter

protected void abortWriter(StoreFileWriter writer)
                    throws IOException

Specified by:

abortWriter in class Compactor<StoreFileWriter>

Throws:

IOException