Package org.apache.hadoop.hbase.replication.regionserver

Class Replication

java.lang.Object

org.apache.hadoop.hbase.replication.regionserver.Replication

All Implemented Interfaces:

ConfigurationObserver, PropagatingConfigurationObserver, ReplicationService, ReplicationSinkService, ReplicationSourceService

@Private
public class Replication
extends Object
implements ReplicationSourceService, ReplicationSinkService, PropagatingConfigurationObserver

Gateway to Replication. Used by HRegionServer.

Implement PropagatingConfigurationObserver mainly for registering ReplicationPeers, so we can recreating the replication peer storage.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static final class	Replication.ReplicationStatisticsTask	Statistics task.

Field Summary

Fields

Modifier and Type	Field	Description
private org.apache.hadoop.conf.Configuration	conf
private MetricsReplicationGlobalSourceSource	globalMetricsSource
private boolean	isReplicationForBulkLoadDataEnabled
private static final org.slf4j.Logger	LOG
private PeerProcedureHandler	peerProcedureHandler
private ReplicationQueueStorage	queueStorage
private ReplicationLoad	replicationLoad
private ReplicationSourceManager	replicationManager
private ReplicationPeers	replicationPeers
private ReplicationSink	replicationSink
private ScheduledExecutorService	scheduleThreadPool	Statistics thread schedule pool
private Server	server
private int	statsThreadPeriod

Constructor Summary

Constructors

Constructor	Description
Replication()	Empty constructor

Method Summary

Modifier and Type	Method	Description
(package private) void	addHFileRefsToQueue(TableName tableName, byte[] family, List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
private void	buildReplicationLoad()
void	deregisterChildren(ConfigurationManager manager)	Needs to be called to deregister the children from the manager.
PeerProcedureHandler	getPeerProcedureHandler()	Returns a Handler to handle peer procedures.
ReplicationSourceManager	getReplicationManager()	Get the replication sources manager
void	initialize(Server server, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path logDir, org.apache.hadoop.fs.Path oldLogDir, WALFactory walFactory)	Initializes the replication service object.
void	join()	Join with the replication threads
void	onConfigurationChange(org.apache.hadoop.conf.Configuration conf)	This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.
ReplicationLoad	refreshAndGetReplicationLoad()	Refresh and Get ReplicationLoad
void	registerChildren(ConfigurationManager manager)	Needs to be called to register the children to the manager.
void	replicateLogEntries(List<org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.WALEntry> entries, CellScanner cells, String replicationClusterId, String sourceBaseNamespaceDirPath, String sourceHFileArchiveDirPath)	Carry on the list of log entries down to the sink
void	startReplicationService()	If replication is enabled and this cluster is a master, it starts
void	stopReplicationService()	Stops replication service.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

isReplicationForBulkLoadDataEnabled

private boolean isReplicationForBulkLoadDataEnabled

replicationManager

private ReplicationSourceManager replicationManager

queueStorage

private ReplicationQueueStorage queueStorage

replicationPeers

private ReplicationPeers replicationPeers

conf

private volatile org.apache.hadoop.conf.Configuration conf

replicationSink

private ReplicationSink replicationSink

server

private Server server

scheduleThreadPool

private ScheduledExecutorService scheduleThreadPool

Statistics thread schedule pool

statsThreadPeriod

private int statsThreadPeriod

replicationLoad

private ReplicationLoad replicationLoad

globalMetricsSource

private MetricsReplicationGlobalSourceSource globalMetricsSource

peerProcedureHandler

private PeerProcedureHandler peerProcedureHandler

Constructor Details

Replication

public Replication()

Empty constructor

Method Details

initialize

public void initialize(Server server,
 org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path logDir,
 org.apache.hadoop.fs.Path oldLogDir,
 WALFactory walFactory)
                throws IOException

Description copied from interface: ReplicationService

Initializes the replication service object.

Specified by:

initialize in interface ReplicationService

Throws:

IOException

getPeerProcedureHandler

public PeerProcedureHandler getPeerProcedureHandler()

Description copied from interface: ReplicationSourceService

Returns a Handler to handle peer procedures.

Specified by:

getPeerProcedureHandler in interface ReplicationSourceService

stopReplicationService

public void stopReplicationService()

Stops replication service.

Specified by:

stopReplicationService in interface ReplicationService

join

public void join()

Join with the replication threads

replicateLogEntries

public void replicateLogEntries(List<org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.WALEntry> entries,
 CellScanner cells,
 String replicationClusterId,
 String sourceBaseNamespaceDirPath,
 String sourceHFileArchiveDirPath)
                         throws IOException

Carry on the list of log entries down to the sink

Specified by:

replicateLogEntries in interface ReplicationSinkService

Parameters:

entries - list of entries to replicate

cells - The data -- the cells -- that entries describes (the entries do not contain the Cells we are replicating; they are passed here on the side in this CellScanner).

replicationClusterId - Id which will uniquely identify source cluster FS client configurations in the replication configuration directory

sourceBaseNamespaceDirPath - Path that point to the source cluster base namespace directory required for replicating hfiles

sourceHFileArchiveDirPath - Path that point to the source cluster hfile archive directory

Throws:

IOException

startReplicationService

public void startReplicationService()
                             throws IOException

If replication is enabled and this cluster is a master, it starts

Specified by:

startReplicationService in interface ReplicationService

Throws:

IOException

getReplicationManager

public ReplicationSourceManager getReplicationManager()

Get the replication sources manager

Specified by:

getReplicationManager in interface ReplicationSourceService

Returns:

the manager if replication is enabled, else returns false

addHFileRefsToQueue

void addHFileRefsToQueue(TableName tableName,
 byte[] family,
 List<Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>> pairs)
                  throws IOException

Throws:

IOException

refreshAndGetReplicationLoad

public ReplicationLoad refreshAndGetReplicationLoad()

Description copied from interface: ReplicationService

Refresh and Get ReplicationLoad

Specified by:

refreshAndGetReplicationLoad in interface ReplicationService

buildReplicationLoad

private void buildReplicationLoad()

onConfigurationChange

public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)

Description copied from interface: ConfigurationObserver

This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.

Specified by:

onConfigurationChange in interface ConfigurationObserver

registerChildren

public void registerChildren(ConfigurationManager manager)

Description copied from interface: PropagatingConfigurationObserver

Needs to be called to register the children to the manager.

Specified by:

registerChildren in interface PropagatingConfigurationObserver

Parameters:

manager - : to register to

deregisterChildren

public void deregisterChildren(ConfigurationManager manager)

Description copied from interface: PropagatingConfigurationObserver

Needs to be called to deregister the children from the manager.

Specified by:

deregisterChildren in interface PropagatingConfigurationObserver

Parameters:

manager - : to deregister from