Package org.apache.hadoop.hbase.master.replication

Class ReplicationPeerManager

java.lang.Object

org.apache.hadoop.hbase.master.replication.ReplicationPeerManager

All Implemented Interfaces:

ConfigurationObserver

@Private
public class ReplicationPeerManager
extends Object
implements ConfigurationObserver

Manages and performs all replication admin operations.

Used to add/remove a replication peer.

Implement ConfigurationObserver mainly for recreating ReplicationPeerStorage, for supporting migrating across different replication peer storages without restarting master.

Field Summary

Fields

Modifier and Type	Field	Description
private final String	clusterId
private org.apache.hadoop.conf.Configuration	conf
private final org.apache.hadoop.fs.FileSystem	fs
private final ConcurrentMap<String,ReplicationPeerDescription>	peers
private ReplicationPeerStorage	peerStorage
private final ReplicationQueueStorage	queueStorage
private final ZKWatcher	zk

Constructor Summary

Constructors

Constructor	Description
ReplicationPeerManager(org.apache.hadoop.fs.FileSystem fs, ZKWatcher zk, ReplicationPeerStorage peerStorage, ReplicationQueueStorage queueStorage, ConcurrentMap<String,ReplicationPeerDescription> peers, org.apache.hadoop.conf.Configuration conf, String clusterId)

Method Summary

Modifier and Type	Method	Description
void	addPeer(String peerId, ReplicationPeerConfig peerConfig, boolean enabled)
private void	checkClusterKey(String clusterKey)
private void	checkConfiguredWALEntryFilters(ReplicationPeerConfig peerConfig)
private void	checkNamespacesAndTableCfsConfigConflict(Set<String> namespaces, Map<TableName,? extends Collection<String>> tableCfs)	Set a namespace in the peer config means that all tables in this namespace will be replicated to the peer cluster.
private void	checkPeerConfig(ReplicationPeerConfig peerConfig)
private ReplicationPeerDescription	checkPeerExists(String peerId)
private void	checkQueuesDeleted(String peerId)
private void	checkSameClusterKey(String clusterKey)
static ReplicationPeerManager	create(org.apache.hadoop.fs.FileSystem fs, ZKWatcher zk, org.apache.hadoop.conf.Configuration conf, String clusterId)
void	disablePeer(String peerId)
void	enablePeer(String peerId)
Optional<ReplicationPeerConfig>	getPeerConfig(String peerId)
boolean	getPeerState(String peerId)
ReplicationQueueStorage	getQueueStorage()
List<String>	getSerialPeerIdsBelongsTo(TableName tableName)
private boolean	isStringEquals(String s1, String s2)	For replication peer cluster key or endpoint class, null and empty string is same.
List<ReplicationPeerDescription>	listPeers(Pattern pattern)
void	onConfigurationChange(org.apache.hadoop.conf.Configuration conf)	This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.
(package private) void	preAddPeer(String peerId, ReplicationPeerConfig peerConfig)
(package private) void	preDisablePeer(String peerId)
(package private) void	preEnablePeer(String peerId)
(package private) ReplicationPeerConfig	preRemovePeer(String peerId)
(package private) ReplicationPeerDescription	preUpdatePeerConfig(String peerId, ReplicationPeerConfig peerConfig)	Return the old peer description.
(package private) void	removeAllLastPushedSeqIds(String peerId)
(package private) void	removeAllQueuesAndHFileRefs(String peerId)
void	removePeer(String peerId)
private void	setPeerState(String peerId, boolean enabled)
void	updatePeerConfig(String peerId, ReplicationPeerConfig peerConfig)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

peerStorage

private volatile ReplicationPeerStorage peerStorage

queueStorage

private final ReplicationQueueStorage queueStorage

peers

private final ConcurrentMap<String,ReplicationPeerDescription> peers

clusterId

private final String clusterId

conf

private volatile org.apache.hadoop.conf.Configuration conf

fs

private final org.apache.hadoop.fs.FileSystem fs

zk

private final ZKWatcher zk

Constructor Details

ReplicationPeerManager

ReplicationPeerManager(org.apache.hadoop.fs.FileSystem fs,
 ZKWatcher zk,
 ReplicationPeerStorage peerStorage,
 ReplicationQueueStorage queueStorage,
 ConcurrentMap<String,ReplicationPeerDescription> peers,
 org.apache.hadoop.conf.Configuration conf,
 String clusterId)

Method Details

checkQueuesDeleted

private void checkQueuesDeleted(String peerId)
                         throws ReplicationException,
DoNotRetryIOException

Throws:

ReplicationException

DoNotRetryIOException

preAddPeer

void preAddPeer(String peerId,
 ReplicationPeerConfig peerConfig)
         throws DoNotRetryIOException,
ReplicationException

Throws:

DoNotRetryIOException

ReplicationException

checkPeerExists

private ReplicationPeerDescription checkPeerExists(String peerId)
                                            throws DoNotRetryIOException

Throws:

DoNotRetryIOException

preRemovePeer

ReplicationPeerConfig preRemovePeer(String peerId)
                             throws DoNotRetryIOException

Throws:

DoNotRetryIOException

preEnablePeer

void preEnablePeer(String peerId)
            throws DoNotRetryIOException

Throws:

DoNotRetryIOException

preDisablePeer

void preDisablePeer(String peerId)
             throws DoNotRetryIOException

Throws:

DoNotRetryIOException

preUpdatePeerConfig

ReplicationPeerDescription preUpdatePeerConfig(String peerId,
 ReplicationPeerConfig peerConfig)
                                        throws DoNotRetryIOException

Return the old peer description. Can never be null.

Throws:

DoNotRetryIOException

addPeer

public void addPeer(String peerId,
 ReplicationPeerConfig peerConfig,
 boolean enabled)
             throws ReplicationException

Throws:

ReplicationException

removePeer

public void removePeer(String peerId)
                throws ReplicationException

Throws:

ReplicationException

setPeerState

private void setPeerState(String peerId,
 boolean enabled)
                   throws ReplicationException

Throws:

ReplicationException

getPeerState

public boolean getPeerState(String peerId)
                     throws ReplicationException

Throws:

ReplicationException

enablePeer

public void enablePeer(String peerId)
                throws ReplicationException

Throws:

ReplicationException

disablePeer

public void disablePeer(String peerId)
                 throws ReplicationException

Throws:

ReplicationException

updatePeerConfig

public void updatePeerConfig(String peerId,
 ReplicationPeerConfig peerConfig)
                      throws ReplicationException

Throws:

ReplicationException

listPeers

public List<ReplicationPeerDescription> listPeers(Pattern pattern)

getPeerConfig

public Optional<ReplicationPeerConfig> getPeerConfig(String peerId)

removeAllLastPushedSeqIds

void removeAllLastPushedSeqIds(String peerId)
                        throws ReplicationException

Throws:

ReplicationException

removeAllQueuesAndHFileRefs

void removeAllQueuesAndHFileRefs(String peerId)
                          throws ReplicationException

Throws:

ReplicationException

checkPeerConfig

private void checkPeerConfig(ReplicationPeerConfig peerConfig)
                      throws DoNotRetryIOException

Throws:

DoNotRetryIOException

checkNamespacesAndTableCfsConfigConflict

private void checkNamespacesAndTableCfsConfigConflict(Set<String> namespaces,
 Map<TableName,? extends Collection<String>> tableCfs)
                                               throws DoNotRetryIOException

Set a namespace in the peer config means that all tables in this namespace will be replicated to the peer cluster.

1. If peer config already has a namespace, then not allow set any table of this namespace to the peer config.
2. If peer config already has a table, then not allow set this table's namespace to the peer config.

Set a exclude namespace in the peer config means that all tables in this namespace can't be replicated to the peer cluster.

1. If peer config already has a exclude namespace, then not allow set any exclude table of this namespace to the peer config.
2. If peer config already has a exclude table, then not allow set this table's namespace as a exclude namespace.

Throws:

DoNotRetryIOException

checkConfiguredWALEntryFilters

private void checkConfiguredWALEntryFilters(ReplicationPeerConfig peerConfig)
                                     throws DoNotRetryIOException

Throws:

DoNotRetryIOException

checkClusterKey

private void checkClusterKey(String clusterKey)
                      throws DoNotRetryIOException

Throws:

DoNotRetryIOException

checkSameClusterKey

private void checkSameClusterKey(String clusterKey)
                          throws DoNotRetryIOException

Throws:

DoNotRetryIOException

getSerialPeerIdsBelongsTo

public List<String> getSerialPeerIdsBelongsTo(TableName tableName)

getQueueStorage

public ReplicationQueueStorage getQueueStorage()

create

public static ReplicationPeerManager create(org.apache.hadoop.fs.FileSystem fs,
 ZKWatcher zk,
 org.apache.hadoop.conf.Configuration conf,
 String clusterId)
                                     throws ReplicationException

Throws:

ReplicationException

isStringEquals

private boolean isStringEquals(String s1,
 String s2)

For replication peer cluster key or endpoint class, null and empty string is same. So here don't use StringUtils.equals(CharSequence, CharSequence) directly.

onConfigurationChange

public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)

Description copied from interface: ConfigurationObserver

This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.

Specified by:

onConfigurationChange in interface ConfigurationObserver