StripeCompactionPolicy (Apache HBase 1.2.12 API)

java.lang.Object
- org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy
- - org.apache.hadoop.hbase.regionserver.compactions.StripeCompactionPolicy

@InterfaceAudience.Private
public class StripeCompactionPolicy
extends CompactionPolicy

Stripe store implementation of compaction policy.

Nested Class Summary

Nested Classes
Modifier and Type	Class and Description
`private static class`	`StripeCompactionPolicy.BoundaryStripeCompactionRequest` Request for stripe compactor that will cause it to split the source files into several separate files at the provided boundaries.
`private static class`	`StripeCompactionPolicy.SplitStripeCompactionRequest` Request for stripe compactor that will cause it to split the source files into several separate files into based on key-value count, as well as file count limit.
`static class`	`StripeCompactionPolicy.StripeCompactionRequest` Stripe compaction request wrapper.
`static interface`	`StripeCompactionPolicy.StripeInformationProvider` The information about stripes that the policy needs to do its stuff

Field Summary

Fields
Modifier and Type Field and Description

private StripeStoreConfig config

private static org.apache.commons.logging.Log LOG

private ExploringCompactionPolicy stripePolicy
- Fields inherited from class org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy
  comConf, storeConfigInfo

Fields
Modifier and Type	Field and Description
`private StripeStoreConfig`	`config`
`private static org.apache.commons.logging.Log`	`LOG`
`private ExploringCompactionPolicy`	`stripePolicy`

Constructor Summary

Constructors
Constructor and Description
`StripeCompactionPolicy(org.apache.hadoop.conf.Configuration conf, StoreConfigInformation storeConfigInfo, StripeStoreConfig config)`

Method Summary

Methods
Modifier and Type	Method and Description
`StripeCompactionPolicy.StripeCompactionRequest`	`createEmptyRequest(StripeCompactionPolicy.StripeInformationProvider si, CompactionRequest request)`
`private Pair<Long,Integer>`	`estimateTargetKvs(Collection<StoreFile> files, double splitCount)`
`static long`	`getTotalFileSize(Collection<StoreFile> candidates)`
`private static long`	`getTotalKvCount(Collection<StoreFile> candidates)`
`boolean`	`isMajorCompaction(Collection<StoreFile> filesToCompact)`
`boolean`	`needsCompactions(StripeCompactionPolicy.StripeInformationProvider si, List<StoreFile> filesCompacting)`
`protected boolean`	`needsSingleStripeCompaction(StripeCompactionPolicy.StripeInformationProvider si)`
`List<StoreFile>`	`preSelectFilesForCoprocessor(StripeCompactionPolicy.StripeInformationProvider si, List<StoreFile> filesCompacting)`
`StripeCompactionPolicy.StripeCompactionRequest`	`selectCompaction(StripeCompactionPolicy.StripeInformationProvider si, List<StoreFile> filesCompacting, boolean isOffpeak)`
`private StripeCompactionPolicy.StripeCompactionRequest`	`selectCompactionOfAllFiles(StripeCompactionPolicy.StripeInformationProvider si, int targetStripeCount, long targetSize)` Selects the compaction that compacts all files (to be removed later).
`private StripeCompactionPolicy.StripeCompactionRequest`	`selectExpiredMergeCompaction(StripeCompactionPolicy.StripeInformationProvider si, boolean canDropDeletesNoL0)`
`StripeStoreFlusher.StripeFlushRequest`	`selectFlush(StripeCompactionPolicy.StripeInformationProvider si, int kvCount)`
`private StripeCompactionPolicy.StripeCompactionRequest`	`selectNewStripesCompaction(StripeCompactionPolicy.StripeInformationProvider si)`
`private List<StoreFile>`	`selectSimpleCompaction(List<StoreFile> sfs, boolean allFilesOnly, boolean isOffpeak)` Selects the compaction of a single stripe using default policy.
`protected StripeCompactionPolicy.StripeCompactionRequest`	`selectSingleStripeCompaction(StripeCompactionPolicy.StripeInformationProvider si, boolean includeL0, boolean canDropDeletesWithoutL0, boolean isOffpeak)`
`boolean`	`throttleCompaction(long compactionSize)`

Methods inherited from class org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy
getConf, setConf

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.apache.commons.logging.Log LOG

stripePolicy

private ExploringCompactionPolicy stripePolicy

config
```
private StripeStoreConfig config
```

Constructor Detail

StripeCompactionPolicy

public StripeCompactionPolicy(org.apache.hadoop.conf.Configuration conf,
                      StoreConfigInformation storeConfigInfo,
                      StripeStoreConfig config)

Method Detail

preSelectFilesForCoprocessor

public List<StoreFile> preSelectFilesForCoprocessor(StripeCompactionPolicy.StripeInformationProvider si,
                                           List<StoreFile> filesCompacting)

createEmptyRequest

public StripeCompactionPolicy.StripeCompactionRequest createEmptyRequest(StripeCompactionPolicy.StripeInformationProvider si,
                                                                CompactionRequest request)

selectFlush

public StripeStoreFlusher.StripeFlushRequest selectFlush(StripeCompactionPolicy.StripeInformationProvider si,
                                                int kvCount)

selectCompaction

public StripeCompactionPolicy.StripeCompactionRequest selectCompaction(StripeCompactionPolicy.StripeInformationProvider si,
                                                              List<StoreFile> filesCompacting,
                                                              boolean isOffpeak)
                                                                throws IOException

Throws:: IOException

needsCompactions

public boolean needsCompactions(StripeCompactionPolicy.StripeInformationProvider si,
                       List<StoreFile> filesCompacting)

isMajorCompaction
```
public boolean isMajorCompaction(Collection<StoreFile> filesToCompact)
                          throws IOException
```
Specified by:

isMajorCompaction in class CompactionPolicy

Parameters:
filesToCompact - Files to compact. Can be null.

Returns:
True if we should run a major compaction.

Throws:

IOException

throttleCompaction
```
public boolean throttleCompaction(long compactionSize)
```
Specified by:

throttleCompaction in class CompactionPolicy

Parameters:
compactionSize - Total size of some compaction

Returns:
whether this should be a large or small compaction

needsSingleStripeCompaction
```
protected boolean needsSingleStripeCompaction(StripeCompactionPolicy.StripeInformationProvider si)
```
Parameters:
si - StoreFileManager.

Returns:
Whether any stripe potentially needs compaction.

selectSingleStripeCompaction

protected StripeCompactionPolicy.StripeCompactionRequest selectSingleStripeCompaction(StripeCompactionPolicy.StripeInformationProvider si,
                                                                          boolean includeL0,
                                                                          boolean canDropDeletesWithoutL0,
                                                                          boolean isOffpeak)
                                                                               throws IOException

Throws:: IOException

selectSimpleCompaction
```
private List<StoreFile> selectSimpleCompaction(List<StoreFile> sfs,
                                     boolean allFilesOnly,
                                     boolean isOffpeak)
```
Selects the compaction of a single stripe using default policy.

Parameters:
sfs - Files.
allFilesOnly - Whether a compaction of all-or-none files is needed.

Returns:
The resulting selection.

selectCompactionOfAllFiles

private StripeCompactionPolicy.StripeCompactionRequest selectCompactionOfAllFiles(StripeCompactionPolicy.StripeInformationProvider si,
                                                                        int targetStripeCount,
                                                                        long targetSize)

Selects the compaction that compacts all files (to be removed later).

Parameters:: si - StoreFileManager.; targetStripeCount - Target stripe count.; targetSize - Target stripe size.
Returns:: The compaction.

selectNewStripesCompaction

private StripeCompactionPolicy.StripeCompactionRequest selectNewStripesCompaction(StripeCompactionPolicy.StripeInformationProvider si)

selectExpiredMergeCompaction

private StripeCompactionPolicy.StripeCompactionRequest selectExpiredMergeCompaction(StripeCompactionPolicy.StripeInformationProvider si,
                                                                          boolean canDropDeletesNoL0)

getTotalKvCount

private static long getTotalKvCount(Collection<StoreFile> candidates)

getTotalFileSize

public static long getTotalFileSize(Collection<StoreFile> candidates)

estimateTargetKvs

private Pair<Long,Integer> estimateTargetKvs(Collection<StoreFile> files,
                                   double splitCount)

Class StripeCompactionPolicy

Nested Class Summary

Field Summary

Fields inherited from class org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy

Constructor Summary

Method Summary

Methods inherited from class org.apache.hadoop.hbase.regionserver.compactions.CompactionPolicy

Methods inherited from class java.lang.Object

Field Detail

LOG

stripePolicy

config

Constructor Detail

StripeCompactionPolicy

Method Detail

preSelectFilesForCoprocessor

createEmptyRequest

selectFlush

selectCompaction

needsCompactions

isMajorCompaction

throttleCompaction

needsSingleStripeCompaction

selectSingleStripeCompaction

selectSimpleCompaction

selectCompactionOfAllFiles

selectNewStripesCompaction

selectExpiredMergeCompaction

getTotalKvCount

getTotalFileSize

estimateTargetKvs