org.apache.hadoop.hbase.master.region

Class MasterRegionFlusherAndCompactor

java.lang.Object

org.apache.hadoop.hbase.master.region.MasterRegionFlusherAndCompactor

All Implemented Interfaces:

Closeable, AutoCloseable

@InterfaceAudience.Private
class MasterRegionFlusherAndCompactor
extends Object
implements Closeable

As long as there is no RegionServerServices for a master local region, we need implement the flush and compaction logic by our own.

The flush logic is very simple, every time after calling a modification method in RegionProcedureStore, we will call the onUpdate() method below, and in this method, we will check the memstore size and if it is above the flush size, we will call HRegion.flush(boolean) to force flush all stores.

And for compaction, the logic is also very simple. After flush, we will check the store file count, if it is above the compactMin, we will do a major compaction.

Field Summary

Fields

Modifier and Type	Field and Description
private Abortable	abortable
private String	archivedHFileSuffix
private AtomicLong	changesAfterLastFlush
private boolean	closed
private ExecutorService	compactExecutor
private Lock	compactLock
private int	compactMin
private boolean	compactRequest
private org.apache.hadoop.conf.Configuration	conf
private Condition	flushCond
private long	flushIntervalMs
private Lock	flushLock
private long	flushPerChanges
private boolean	flushRequest
private long	flushSize
private Thread	flushThread
private org.apache.hadoop.fs.Path	globalArchivePath
private long	lastFlushTime
private static org.slf4j.Logger	LOG
private HRegion	region

Constructor Summary

Constructors

Constructor and Description
MasterRegionFlusherAndCompactor(org.apache.hadoop.conf.Configuration conf, Abortable abortable, HRegion region, long flushSize, long flushPerChanges, long flushIntervalMs, int compactMin, org.apache.hadoop.fs.Path globalArchivePath, String archivedHFileSuffix)

Method Summary

Modifier and Type	Method and Description
void	close()
private void	compact()
private void	flushLoop()
private void	moveHFileToGlobalArchiveDir()
private boolean	needCompaction()
(package private) void	onUpdate()
(package private) void	recordLastFlushTime()
(package private) void	requestFlush()
(package private) void	resetChangesAfterLastFlush()
(package private) static void	setupConf(org.apache.hadoop.conf.Configuration conf, long flushSize, long flushPerChanges, long flushIntervalMs)
private boolean	shouldFlush(long changes)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

conf

private final org.apache.hadoop.conf.Configuration conf

abortable

private final Abortable abortable

region

private final HRegion region

changesAfterLastFlush

private final AtomicLong changesAfterLastFlush

flushSize

private final long flushSize

flushPerChanges

private final long flushPerChanges

flushIntervalMs

private final long flushIntervalMs

compactMin

private final int compactMin

globalArchivePath

private final org.apache.hadoop.fs.Path globalArchivePath

archivedHFileSuffix

private final String archivedHFileSuffix

flushThread

private final Thread flushThread

flushLock

private final Lock flushLock

flushCond

private final Condition flushCond

flushRequest

private boolean flushRequest

lastFlushTime

private long lastFlushTime

compactExecutor

private final ExecutorService compactExecutor

compactLock

private final Lock compactLock

compactRequest

private boolean compactRequest

closed

private volatile boolean closed

Constructor Detail

MasterRegionFlusherAndCompactor

MasterRegionFlusherAndCompactor(org.apache.hadoop.conf.Configuration conf,
                                Abortable abortable,
                                HRegion region,
                                long flushSize,
                                long flushPerChanges,
                                long flushIntervalMs,
                                int compactMin,
                                org.apache.hadoop.fs.Path globalArchivePath,
                                String archivedHFileSuffix)

Method Detail

setupConf

static void setupConf(org.apache.hadoop.conf.Configuration conf,
                      long flushSize,
                      long flushPerChanges,
                      long flushIntervalMs)

moveHFileToGlobalArchiveDir

private void moveHFileToGlobalArchiveDir()
                                  throws IOException

Throws:

IOException

compact

private void compact()

needCompaction

private boolean needCompaction()

flushLoop

private void flushLoop()

shouldFlush

private boolean shouldFlush(long changes)

onUpdate

void onUpdate()

requestFlush

void requestFlush()

resetChangesAfterLastFlush

void resetChangesAfterLastFlush()

recordLastFlushTime

void recordLastFlushTime()

close

public void close()

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable