Package org.apache.hadoop.hbase.wal

Class AbstractWALRoller<T extends Abortable>

java.lang.Object

java.lang.Thread

org.apache.hadoop.hbase.wal.AbstractWALRoller<T>

All Implemented Interfaces:

Closeable, AutoCloseable, Runnable

Direct Known Subclasses:

LogRoller, MasterRegionWALRoller

@Private
public abstract class AbstractWALRoller<T extends Abortable>
extends Thread
implements Closeable

Runs periodically to determine if the WAL should be rolled.

NOTE: This class extends Thread rather than Chore because the sleep time can be interrupted when there is something to do, rather than the Chore sleep time which is invariant.

The scheduleFlush(String, List) is abstract here, as sometimes we hold a region without a region server but we still want to roll its WAL.

TODO: change to a pool of threads

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
protected class	AbstractWALRoller.RollController	Independently control the roll of each wal.

Nested classes/interfaces inherited from class java.lang.Thread

Thread.State, Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field	Description
protected final T	abortable
private final long	checkLowReplicationInterval
static final long	DEFAULT_WAL_ROLL_WAIT_TIMEOUT
private static final org.slf4j.Logger	LOG
private final int	maxRollRetry
private final long	rollPeriod
private final long	rollWaitTimeout
private boolean	running
private final int	threadWakeFrequency
protected static final String	WAL_ROLL_PERIOD_KEY
static final String	WAL_ROLL_RETRIES	Configure for the max count of log rolling retry.
static final String	WAL_ROLL_WAIT_TIMEOUT	Configure for the timeout of log rolling retry.
protected final ConcurrentMap<WAL,AbstractWALRoller<T>.RollController>	wals

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	AbstractWALRoller(String name, org.apache.hadoop.conf.Configuration conf, T abortable)

Method Summary

Modifier and Type	Method	Description
private void	abort(String reason, Throwable cause)
void	addWAL(WAL wal)
protected void	afterWALArchive(org.apache.hadoop.fs.Path oldPath, org.apache.hadoop.fs.Path newPath)
private void	checkLowReplication(long now)	we need to check low replication in period, see HBASE-18132
void	close()
private boolean	isWaiting()
void	requestRollAll()
void	run()
protected abstract void	scheduleFlush(String encodedRegionName, List<byte[]> families)
void	waitUntilWalRollFinished()	Wait until all wals have been rolled after calling requestRollAll().
boolean	walRollFinished()	Returns true if all WAL roll finished

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, onSpinWait, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

WAL_ROLL_PERIOD_KEY

protected static final String WAL_ROLL_PERIOD_KEY

See Also:

• Constant Field Values

WAL_ROLL_WAIT_TIMEOUT

public static final String WAL_ROLL_WAIT_TIMEOUT

Configure for the timeout of log rolling retry.

See Also:

• Constant Field Values

DEFAULT_WAL_ROLL_WAIT_TIMEOUT

public static final long DEFAULT_WAL_ROLL_WAIT_TIMEOUT

See Also:

• Constant Field Values

WAL_ROLL_RETRIES

public static final String WAL_ROLL_RETRIES

Configure for the max count of log rolling retry. The real retry count is also limited by the timeout of log rolling via WAL_ROLL_WAIT_TIMEOUT

See Also:

• Constant Field Values

wals

protected final ConcurrentMap<WAL,AbstractWALRoller<T extends Abortable>.RollController> wals

abortable

protected final T extends Abortable abortable

rollPeriod

private final long rollPeriod

threadWakeFrequency

private final int threadWakeFrequency

checkLowReplicationInterval

private final long checkLowReplicationInterval

rollWaitTimeout

private final long rollWaitTimeout

maxRollRetry

private final int maxRollRetry

running

private volatile boolean running

Constructor Details

AbstractWALRoller

protected AbstractWALRoller(String name,
 org.apache.hadoop.conf.Configuration conf,
 T abortable)

Method Details

addWAL

public void addWAL(WAL wal)

requestRollAll

public void requestRollAll()

checkLowReplication

private void checkLowReplication(long now)

we need to check low replication in period, see HBASE-18132

abort

private void abort(String reason,
 Throwable cause)

run

public void run()

Specified by:

run in interface Runnable

Overrides:

run in class Thread

afterWALArchive

protected void afterWALArchive(org.apache.hadoop.fs.Path oldPath,
 org.apache.hadoop.fs.Path newPath)

scheduleFlush

protected abstract void scheduleFlush(String encodedRegionName,
 List<byte[]> families)

Parameters:

encodedRegionName - Encoded name of region to flush.

families - stores of region to flush.

isWaiting

private boolean isWaiting()

walRollFinished

public boolean walRollFinished()

Returns true if all WAL roll finished

waitUntilWalRollFinished

public void waitUntilWalRollFinished()
                              throws InterruptedException

Wait until all wals have been rolled after calling requestRollAll().

Throws:

InterruptedException

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable