org.apache.hadoop.hbase.wal

Class SyncReplicationWALProvider

java.lang.Object

org.apache.hadoop.hbase.wal.SyncReplicationWALProvider

All Implemented Interfaces:

PeerActionListener, WALProvider

@InterfaceAudience.Private
public class SyncReplicationWALProvider
extends Object
implements WALProvider, PeerActionListener

The special WALProvider for synchronous replication.

It works like an interceptor, when getting WAL, first it will check if the given region should be replicated synchronously, if so it will return a special WAL for it, otherwise it will delegate the request to the normal WALProvider.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	SyncReplicationWALProvider.DefaultSyncReplicationPeerInfoProvider

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.wal.WALProvider

WALProvider.AsyncWriter, WALProvider.Writer, WALProvider.WriterBase

Field Summary

Fields

Modifier and Type	Field and Description
private Class<? extends org.apache.hbase.thirdparty.io.netty.channel.Channel>	channelClass
private org.apache.hadoop.conf.Configuration	conf
private KeyLocker<String>	createLock
static String	DUAL_WAL_IMPL
private org.apache.hbase.thirdparty.io.netty.channel.EventLoopGroup	eventLoopGroup
private WALFactory	factory
private AtomicBoolean	initialized
private List<WALActionsListener>	listeners
private static org.slf4j.Logger	LOG
private static Pattern	LOG_PREFIX_PATTERN
private ConcurrentMap<String,Optional<DualAsyncFSWAL>>	peerId2WAL
private SyncReplicationPeerInfoProvider	peerInfoProvider
private WALProvider	provider

Fields inherited from interface org.apache.hadoop.hbase.replication.regionserver.PeerActionListener

DUMMY

Constructor Summary

Constructors

Constructor and Description
SyncReplicationWALProvider(WALProvider provider)

Method Summary

Modifier and Type	Method and Description
void	addWALActionsListener(WALActionsListener listener) Add a WALActionsListener.
void	close() shutdown utstanding WALs and clean up any persisted state.
private DualAsyncFSWAL	createWAL(String peerId, String remoteWALDir)
long	getLogFileSize() Get size of the log files this provider is managing
private String	getLogPrefix(String peerId)
long	getNumLogFiles() Get number of the log files this provider is managing
static Optional<String>	getSyncReplicationPeerIdFromWALName(String name) Returns the peer id if the wal file name is in the special group for a sync replication peer.
WAL	getWAL(RegionInfo region)
private DualAsyncFSWAL	getWAL(String peerId, String remoteWALDir)
List<WAL>	getWALs() Returns the List of WALs that are used by this server
private Stream<WAL>	getWALStream()
(package private) WALProvider	getWrappedProvider()
void	init(WALFactory factory, org.apache.hadoop.conf.Configuration conf, String providerId, Abortable abortable) Set up the provider to create wals.
void	peerSyncReplicationStateChange(String peerId, SyncReplicationState from, SyncReplicationState to, int stage)
private void	safeClose(WAL wal)
void	setPeerInfoProvider(SyncReplicationPeerInfoProvider peerInfoProvider)
void	shutdown() persist outstanding WALs to storage and stop accepting new appends.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.wal.WALProvider

getWALFileLengthProvider

Field Detail

LOG

private static final org.slf4j.Logger LOG

DUAL_WAL_IMPL

public static final String DUAL_WAL_IMPL

See Also:

Constant Field Values

provider

private final WALProvider provider

peerInfoProvider

private SyncReplicationPeerInfoProvider peerInfoProvider

factory

private WALFactory factory

conf

private org.apache.hadoop.conf.Configuration conf

listeners

private List<WALActionsListener> listeners

eventLoopGroup

private org.apache.hbase.thirdparty.io.netty.channel.EventLoopGroup eventLoopGroup

channelClass

private Class<? extends org.apache.hbase.thirdparty.io.netty.channel.Channel> channelClass

initialized

private AtomicBoolean initialized

peerId2WAL

private final ConcurrentMap<String,Optional<DualAsyncFSWAL>> peerId2WAL

createLock

private final KeyLocker<String> createLock

LOG_PREFIX_PATTERN

private static final Pattern LOG_PREFIX_PATTERN

Constructor Detail

SyncReplicationWALProvider

SyncReplicationWALProvider(WALProvider provider)

Method Detail

setPeerInfoProvider

public void setPeerInfoProvider(SyncReplicationPeerInfoProvider peerInfoProvider)

init

public void init(WALFactory factory,
                 org.apache.hadoop.conf.Configuration conf,
                 String providerId,
                 Abortable abortable)
          throws IOException

Description copied from interface: WALProvider

Set up the provider to create wals. will only be called once per instance.

Specified by:

init in interface WALProvider

Parameters:

factory - factory that made us may not be null

conf - may not be null

providerId - differentiate between providers from one factory. may be null

Throws:

IOException

getLogPrefix

private String getLogPrefix(String peerId)

createWAL

private DualAsyncFSWAL createWAL(String peerId,
                                 String remoteWALDir)
                          throws IOException

Throws:

IOException

getWAL

private DualAsyncFSWAL getWAL(String peerId,
                              String remoteWALDir)
                       throws IOException

Throws:

IOException

getWAL

public WAL getWAL(RegionInfo region)
           throws IOException

Specified by:

getWAL in interface WALProvider

Parameters:

region - the region which we want to get a WAL for it. Could be null.

Returns:

a WAL for writing entries for the given region.

Throws:

IOException

getWALStream

private Stream<WAL> getWALStream()

getWALs

public List<WAL> getWALs()

Description copied from interface: WALProvider

Returns the List of WALs that are used by this server

Specified by:

getWALs in interface WALProvider

shutdown

public void shutdown()
              throws IOException

Description copied from interface: WALProvider

persist outstanding WALs to storage and stop accepting new appends. This method serves as shorthand for sending a sync to every WAL provided by a given implementation. Those WALs will also stop accepting new writes.

Specified by:

shutdown in interface WALProvider

Throws:

IOException

close

public void close()
           throws IOException

Description copied from interface: WALProvider

shutdown utstanding WALs and clean up any persisted state. Call this method only when you will not need to replay any of the edits to the WALs from this provider. After this call completes, the underlying resources should have been reclaimed.

Specified by:

close in interface WALProvider

Throws:

IOException

getNumLogFiles

public long getNumLogFiles()

Description copied from interface: WALProvider

Get number of the log files this provider is managing

Specified by:

getNumLogFiles in interface WALProvider

getLogFileSize

public long getLogFileSize()

Description copied from interface: WALProvider

Get size of the log files this provider is managing

Specified by:

getLogFileSize in interface WALProvider

safeClose

private void safeClose(WAL wal)

addWALActionsListener

public void addWALActionsListener(WALActionsListener listener)

Description copied from interface: WALProvider

Add a WALActionsListener.

Notice that you must call this method before calling WALProvider.getWAL(RegionInfo) as this method will not effect the WAL which has already been created. And as long as we can only it when initialization, it is not thread safe.

Specified by:

addWALActionsListener in interface WALProvider

peerSyncReplicationStateChange

public void peerSyncReplicationStateChange(String peerId,
                                           SyncReplicationState from,
                                           SyncReplicationState to,
                                           int stage)

Specified by:

peerSyncReplicationStateChange in interface PeerActionListener

getSyncReplicationPeerIdFromWALName

public static Optional<String> getSyncReplicationPeerIdFromWALName(String name)

Returns the peer id if the wal file name is in the special group for a sync replication peer.

The prefix format is <factoryId>-<ts>-<peerId>.

getWrappedProvider

WALProvider getWrappedProvider()