org.apache.hadoop.hbase.replication.regionserver

Class NoopReplicationQueueStorage

java.lang.Object

org.apache.hadoop.hbase.replication.regionserver.NoopReplicationQueueStorage

All Implemented Interfaces:

ReplicationQueueStorage

@InterfaceAudience.Private
class NoopReplicationQueueStorage
extends Object
implements ReplicationQueueStorage

Noop queue storage -- does nothing.

Constructor Summary

Constructors

Constructor and Description
NoopReplicationQueueStorage()

Method Summary

Modifier and Type	Method and Description
void	addHFileRefs(String peerId, List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs) Add new hfile references to the queue.
void	addPeerToHFileRefs(String peerId) Add a peer to hfile reference queue if peer does not exist.
void	addWAL(ServerName serverName, String queueId, String fileName) Add a new WAL file to the given queue for a given regionserver.
Pair<String,SortedSet<String>>	claimQueue(ServerName sourceServerName, String queueId, ServerName destServerName) Change ownership for the queue identified by queueId and belongs to a dead region server.
Set<String>	getAllHFileRefs() Load all hfile references in all replication queues.
List<String>	getAllPeersFromHFileRefsQueue() Get list of all peers from hfile reference queue.
List<String>	getAllQueues(ServerName serverName) Get a list of all queues for the specified region server.
Set<String>	getAllWALs() Load all wals in all replication queues.
long	getLastSequenceId(String encodedRegionName, String peerId) Read the max sequence id of the specific region for a given peer.
List<ServerName>	getListOfReplicators() Get a list of all region servers that have outstanding replication queues.
List<String>	getReplicableHFiles(String peerId) Get a list of all hfile references in the given peer.
String	getRsNode(ServerName serverName) Get full znode name for given region server
long	getWALPosition(ServerName serverName, String queueId, String fileName) Get the current position for a specific WAL in a given queue for a given regionserver.
List<String>	getWALsInQueue(ServerName serverName, String queueId) Get a list of all WALs in the given queue on the given region server.
void	removeHFileRefs(String peerId, List<String> files) Remove hfile references from the queue.
void	removeLastSequenceIds(String peerId) Remove all the max sequence id record for the given peer.
void	removeLastSequenceIds(String peerId, List<String> encodedRegionNames) Remove the max sequence id record for the given peer and regions.
void	removePeerFromHFileRefs(String peerId) Remove a peer from hfile reference queue.
void	removeQueue(ServerName serverName, String queueId) Remove a replication queue for a given regionserver.
void	removeReplicatorIfQueueIsEmpty(ServerName serverName) Remove the record of region server if the queue is empty.
void	removeWAL(ServerName serverName, String queueId, String fileName) Remove an WAL file from the given queue for a given regionserver.
void	setLastSequenceIds(String peerId, Map<String,Long> lastSeqIds) Set the max sequence id of a bunch of regions for a given peer.
void	setWALPosition(ServerName serverName, String queueId, String fileName, long position, Map<String,Long> lastSeqIds) Set the current position for a specific WAL in a given queue for a given regionserver.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NoopReplicationQueueStorage

NoopReplicationQueueStorage()

Method Detail

removeQueue

public void removeQueue(ServerName serverName,
                        String queueId)
                 throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Remove a replication queue for a given regionserver.

Specified by:

removeQueue in interface ReplicationQueueStorage

Parameters:

serverName - the name of the regionserver

queueId - a String that identifies the queue.

Throws:

ReplicationException

addWAL

public void addWAL(ServerName serverName,
                   String queueId,
                   String fileName)
            throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Add a new WAL file to the given queue for a given regionserver. If the queue does not exist it is created.

Specified by:

addWAL in interface ReplicationQueueStorage

Parameters:

serverName - the name of the regionserver

queueId - a String that identifies the queue.

fileName - name of the WAL

Throws:

ReplicationException

removeWAL

public void removeWAL(ServerName serverName,
                      String queueId,
                      String fileName)
               throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Remove an WAL file from the given queue for a given regionserver.

Specified by:

removeWAL in interface ReplicationQueueStorage

Parameters:

serverName - the name of the regionserver

queueId - a String that identifies the queue.

fileName - name of the WAL

Throws:

ReplicationException

setWALPosition

public void setWALPosition(ServerName serverName,
                           String queueId,
                           String fileName,
                           long position,
                           Map<String,Long> lastSeqIds)
                    throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Set the current position for a specific WAL in a given queue for a given regionserver.

Specified by:

setWALPosition in interface ReplicationQueueStorage

Parameters:

serverName - the name of the regionserver

queueId - a String that identifies the queue

fileName - name of the WAL

position - the current position in the file. Will ignore if less than or equal to 0.

lastSeqIds - map with {encodedRegionName, sequenceId} pairs for serial replication.

Throws:

ReplicationException

getLastSequenceId

public long getLastSequenceId(String encodedRegionName,
                              String peerId)
                       throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Read the max sequence id of the specific region for a given peer. For serial replication, we need the max sequenced id to decide whether we can push the next entries.

Specified by:

getLastSequenceId in interface ReplicationQueueStorage

Parameters:

encodedRegionName - the encoded region name

peerId - peer id

Returns:

the max sequence id of the specific region for a given peer.

Throws:

ReplicationException

setLastSequenceIds

public void setLastSequenceIds(String peerId,
                               Map<String,Long> lastSeqIds)
                        throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Set the max sequence id of a bunch of regions for a given peer. Will be called when setting up a serial replication peer.

Specified by:

setLastSequenceIds in interface ReplicationQueueStorage

Parameters:

peerId - peer id

lastSeqIds - map with {encodedRegionName, sequenceId} pairs for serial replication.

Throws:

ReplicationException

removeLastSequenceIds

public void removeLastSequenceIds(String peerId)
                           throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Remove all the max sequence id record for the given peer.

Specified by:

removeLastSequenceIds in interface ReplicationQueueStorage

Parameters:

peerId - peer id

Throws:

ReplicationException

removeLastSequenceIds

public void removeLastSequenceIds(String peerId,
                                  List<String> encodedRegionNames)
                           throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Remove the max sequence id record for the given peer and regions.

Specified by:

removeLastSequenceIds in interface ReplicationQueueStorage

Parameters:

peerId - peer id

encodedRegionNames - the encoded region names

Throws:

ReplicationException

getWALPosition

public long getWALPosition(ServerName serverName,
                           String queueId,
                           String fileName)
                    throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Get the current position for a specific WAL in a given queue for a given regionserver.

Specified by:

getWALPosition in interface ReplicationQueueStorage

Parameters:

serverName - the name of the regionserver

queueId - a String that identifies the queue

fileName - name of the WAL

Returns:

the current position in the file

Throws:

ReplicationException

getWALsInQueue

public List<String> getWALsInQueue(ServerName serverName,
                                   String queueId)
                            throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Get a list of all WALs in the given queue on the given region server.

Specified by:

getWALsInQueue in interface ReplicationQueueStorage

Parameters:

serverName - the server name of the region server that owns the queue

queueId - a String that identifies the queue

Returns:

a list of WALs

Throws:

ReplicationException

getAllQueues

public List<String> getAllQueues(ServerName serverName)
                          throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Get a list of all queues for the specified region server.

Specified by:

getAllQueues in interface ReplicationQueueStorage

Parameters:

serverName - the server name of the region server that owns the set of queues

Returns:

a list of queueIds

Throws:

ReplicationException

claimQueue

public Pair<String,SortedSet<String>> claimQueue(ServerName sourceServerName,
                                                 String queueId,
                                                 ServerName destServerName)
                                          throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Change ownership for the queue identified by queueId and belongs to a dead region server.

Specified by:

claimQueue in interface ReplicationQueueStorage

Parameters:

sourceServerName - the name of the dead region server

queueId - the id of the queue

destServerName - the name of the target region server

Returns:

the new PeerId and A SortedSet of WALs in its queue

Throws:

ReplicationException

removeReplicatorIfQueueIsEmpty

public void removeReplicatorIfQueueIsEmpty(ServerName serverName)
                                    throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Remove the record of region server if the queue is empty.

Specified by:

removeReplicatorIfQueueIsEmpty in interface ReplicationQueueStorage

Throws:

ReplicationException

getListOfReplicators

public List<ServerName> getListOfReplicators()
                                      throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Get a list of all region servers that have outstanding replication queues. These servers could be alive, dead or from a previous run of the cluster.

Specified by:

getListOfReplicators in interface ReplicationQueueStorage

Returns:

a list of server names

Throws:

ReplicationException

getAllWALs

public Set<String> getAllWALs()
                       throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Load all wals in all replication queues. This method guarantees to return a snapshot which contains all WALs at the start of this call even there is concurrent queue failover. However, some newly created WALs during the call may not be included.

Specified by:

getAllWALs in interface ReplicationQueueStorage

Throws:

ReplicationException

addPeerToHFileRefs

public void addPeerToHFileRefs(String peerId)
                        throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Add a peer to hfile reference queue if peer does not exist.

Specified by:

addPeerToHFileRefs in interface ReplicationQueueStorage

Parameters:

peerId - peer cluster id to be added

Throws:

ReplicationException - if fails to add a peer id to hfile reference queue

removePeerFromHFileRefs

public void removePeerFromHFileRefs(String peerId)
                             throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Remove a peer from hfile reference queue.

Specified by:

removePeerFromHFileRefs in interface ReplicationQueueStorage

Parameters:

peerId - peer cluster id to be removed

Throws:

ReplicationException

addHFileRefs

public void addHFileRefs(String peerId,
                         List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
                  throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Add new hfile references to the queue.

Specified by:

addHFileRefs in interface ReplicationQueueStorage

Parameters:

peerId - peer cluster id to which the hfiles need to be replicated

pairs - list of pairs of { HFile location in staging dir, HFile path in region dir which will be added in the queue }

Throws:

ReplicationException - if fails to add a hfile reference

removeHFileRefs

public void removeHFileRefs(String peerId,
                            List<String> files)
                     throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Remove hfile references from the queue.

Specified by:

removeHFileRefs in interface ReplicationQueueStorage

Parameters:

peerId - peer cluster id from which this hfile references needs to be removed

files - list of hfile references to be removed

Throws:

ReplicationException

getAllPeersFromHFileRefsQueue

public List<String> getAllPeersFromHFileRefsQueue()
                                           throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Get list of all peers from hfile reference queue.

Specified by:

getAllPeersFromHFileRefsQueue in interface ReplicationQueueStorage

Returns:

a list of peer ids

Throws:

ReplicationException

getReplicableHFiles

public List<String> getReplicableHFiles(String peerId)
                                 throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Get a list of all hfile references in the given peer.

Specified by:

getReplicableHFiles in interface ReplicationQueueStorage

Parameters:

peerId - a String that identifies the peer

Returns:

a list of hfile references

Throws:

ReplicationException

getAllHFileRefs

public Set<String> getAllHFileRefs()
                            throws ReplicationException

Description copied from interface: ReplicationQueueStorage

Load all hfile references in all replication queues. This method guarantees to return a snapshot which contains all hfile references at the start of this call. However, some newly created hfile references during the call may not be included.

Specified by:

getAllHFileRefs in interface ReplicationQueueStorage

Throws:

ReplicationException

getRsNode

public String getRsNode(ServerName serverName)

Description copied from interface: ReplicationQueueStorage

Get full znode name for given region server

Specified by:

getRsNode in interface ReplicationQueueStorage

Parameters:

serverName - the name of the region server

Returns:

full znode name