org.apache.hadoop.hbase.replication.regionserver

Class Replication

java.lang.Object

org.apache.hadoop.hbase.replication.regionserver.Replication

All Implemented Interfaces:

ReplicationService, ReplicationSinkService, ReplicationSourceService

@InterfaceAudience.Private
public class Replication
extends Object
implements ReplicationSourceService, ReplicationSinkService

Gateway to Replication. Used by HRegionServer.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	Replication.ReplicationStatisticsTask Statistics task.

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.hadoop.conf.Configuration	conf
private boolean	isReplicationForBulkLoadDataEnabled
private static org.slf4j.Logger	LOG
private PeerProcedureHandler	peerProcedureHandler
private ReplicationQueueStorage	queueStorage
private ReplicationLoad	replicationLoad
private ReplicationSourceManager	replicationManager
private ReplicationPeers	replicationPeers
private ReplicationSink	replicationSink
private ReplicationTracker	replicationTracker
private ScheduledExecutorService	scheduleThreadPool Statistics thread schedule pool
private Server	server
private int	statsThreadPeriod

Constructor Summary

Constructors

Constructor and Description
Replication() Empty constructor

Method Summary

Modifier and Type	Method and Description
(package private) void	addHFileRefsToQueue(TableName tableName, byte[] family, List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
private void	buildReplicationLoad()
PeerProcedureHandler	getPeerProcedureHandler() Returns a Handler to handle peer procedures.
ReplicationSourceManager	getReplicationManager() Get the replication sources manager
void	initialize(Server server, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path logDir, org.apache.hadoop.fs.Path oldLogDir, WALProvider walProvider) Initializes the replication service object.
void	join() Join with the replication threads
ReplicationLoad	refreshAndGetReplicationLoad() Refresh and Get ReplicationLoad
void	replicateLogEntries(List<org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.WALEntry> entries, CellScanner cells, String replicationClusterId, String sourceBaseNamespaceDirPath, String sourceHFileArchiveDirPath) Carry on the list of log entries down to the sink
void	startReplicationService() If replication is enabled and this cluster is a master, it starts
void	stopReplicationService() Stops replication service.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

isReplicationForBulkLoadDataEnabled

private boolean isReplicationForBulkLoadDataEnabled

replicationManager

private ReplicationSourceManager replicationManager

queueStorage

private ReplicationQueueStorage queueStorage

replicationPeers

private ReplicationPeers replicationPeers

replicationTracker

private ReplicationTracker replicationTracker

conf

private org.apache.hadoop.conf.Configuration conf

replicationSink

private ReplicationSink replicationSink

server

private Server server

scheduleThreadPool

private ScheduledExecutorService scheduleThreadPool

Statistics thread schedule pool

statsThreadPeriod

private int statsThreadPeriod

replicationLoad

private ReplicationLoad replicationLoad

peerProcedureHandler

private PeerProcedureHandler peerProcedureHandler

Constructor Detail

Replication

public Replication()

Empty constructor

Method Detail

initialize

public void initialize(Server server,
                       org.apache.hadoop.fs.FileSystem fs,
                       org.apache.hadoop.fs.Path logDir,
                       org.apache.hadoop.fs.Path oldLogDir,
                       WALProvider walProvider)
                throws IOException

Description copied from interface: ReplicationService

Initializes the replication service object.

Specified by:

initialize in interface ReplicationService

walProvider - can be null if not initialized inside a live region server environment, for example, ReplicationSyncUp.

Throws:

IOException

getPeerProcedureHandler

public PeerProcedureHandler getPeerProcedureHandler()

Description copied from interface: ReplicationSourceService

Returns a Handler to handle peer procedures.

Specified by:

getPeerProcedureHandler in interface ReplicationSourceService

stopReplicationService

public void stopReplicationService()

Stops replication service.

Specified by:

stopReplicationService in interface ReplicationService

join

public void join()

Join with the replication threads

replicateLogEntries

public void replicateLogEntries(List<org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.WALEntry> entries,
                                CellScanner cells,
                                String replicationClusterId,
                                String sourceBaseNamespaceDirPath,
                                String sourceHFileArchiveDirPath)
                         throws IOException

Carry on the list of log entries down to the sink

Specified by:

replicateLogEntries in interface ReplicationSinkService

Parameters:

entries - list of entries to replicate

cells - The data -- the cells -- that entries describes (the entries do not contain the Cells we are replicating; they are passed here on the side in this CellScanner).

replicationClusterId - Id which will uniquely identify source cluster FS client configurations in the replication configuration directory

sourceBaseNamespaceDirPath - Path that point to the source cluster base namespace directory required for replicating hfiles

sourceHFileArchiveDirPath - Path that point to the source cluster hfile archive directory

Throws:

IOException

startReplicationService

public void startReplicationService()
                             throws IOException

If replication is enabled and this cluster is a master, it starts

Specified by:

startReplicationService in interface ReplicationService

Throws:

IOException

getReplicationManager

public ReplicationSourceManager getReplicationManager()

Get the replication sources manager

Specified by:

getReplicationManager in interface ReplicationSourceService

Returns:

the manager if replication is enabled, else returns false

addHFileRefsToQueue

void addHFileRefsToQueue(TableName tableName,
                         byte[] family,
                         List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
                  throws IOException

Throws:

IOException

refreshAndGetReplicationLoad

public ReplicationLoad refreshAndGetReplicationLoad()

Description copied from interface: ReplicationService

Refresh and Get ReplicationLoad

Specified by:

refreshAndGetReplicationLoad in interface ReplicationService

buildReplicationLoad

private void buildReplicationLoad()