Field Detail

• LOG

  private static final org.apache.commons.logging.Log LOG

• replication

  private boolean replication

• replicationManager

  private ReplicationSourceManager replicationManager

• replicationQueues

  private ReplicationQueues replicationQueues

• replicationPeers

  private ReplicationPeers replicationPeers

• replicationTracker

  private ReplicationTracker replicationTracker

• conf

  private org.apache.hadoop.conf.Configuration conf

• replicationSink

  private ReplicationSink replicationSink

• server

  private Server server

• scheduleThreadPool

  private ScheduledExecutorService scheduleThreadPool

  Statistics thread schedule pool

• statsThreadPeriod

  private int statsThreadPeriod

• replicationLoad

  private ReplicationLoad replicationLoad

Constructor Detail

• Replication

  public Replication(Server server,
             org.apache.hadoop.fs.FileSystem fs,
             org.apache.hadoop.fs.Path logDir,
             org.apache.hadoop.fs.Path oldLogDir)
              throws IOException

  Instantiate the replication management (if rep is enabled).

  Parameters:

  server - Hosting server

  fs - handle to the filesystem

  logDir -

  oldLogDir - directory where logs are archived

  Throws:

  IOException

• Replication

  public Replication()

  Empty constructor

Method Detail

• initialize

  public void initialize(Server server,
                org.apache.hadoop.fs.FileSystem fs,
                org.apache.hadoop.fs.Path logDir,
                org.apache.hadoop.fs.Path oldLogDir)
                  throws IOException

  Description copied from interface: ReplicationService
  Initializes the replication service object.

  Specified by:

  initialize in interface ReplicationService

  Throws:

  IOException

• isReplication

  public static boolean isReplication(org.apache.hadoop.conf.Configuration c)

  Parameters:

  c - Configuration to look at

  Returns:

  True if replication is enabled.

• getWALActionsListener

  public WALActionsListener getWALActionsListener()

  Description copied from interface: ReplicationSourceService
  Returns a WALObserver for the service. This is needed to observe log rolls and log archival events.

  Specified by:

  getWALActionsListener in interface ReplicationSourceService

• stopReplicationService

  public void stopReplicationService()

  Stops replication service.

  Specified by:

  stopReplicationService in interface ReplicationService

• join

  public void join()

  Join with the replication threads

• replicateLogEntries

  public void replicateLogEntries(List<org.apache.hadoop.hbase.protobuf.generated.AdminProtos.WALEntry> entries,
                         CellScanner cells)
                           throws IOException

  Carry on the list of log entries down to the sink

  Specified by:

  replicateLogEntries in interface ReplicationSinkService

  Parameters:

  entries - list of entries to replicate

  cells - The data -- the cells -- that entries describes (the entries do not contain the Cells we are replicating; they are passed here on the side in this CellScanner).

  Throws:

  IOException

• startReplicationService

  public void startReplicationService()
                               throws IOException

  If replication is enabled and this cluster is a master, it starts

  Specified by:

  startReplicationService in interface ReplicationService

  Throws:

  IOException

• getReplicationManager

  public ReplicationSourceManager getReplicationManager()

  Get the replication sources manager

  Returns:

  the manager if replication is enabled, else returns false

• visitLogEntryBeforeWrite

  public void visitLogEntryBeforeWrite(HTableDescriptor htd,
                              WALKey logKey,
                              WALEdit logEdit)

  Specified by:

  visitLogEntryBeforeWrite in interface WALActionsListener

  Overrides:

  visitLogEntryBeforeWrite in class WALActionsListener.Base

  logEdit - TODO: Retire this in favor of WALActionsListener.visitLogEntryBeforeWrite(HRegionInfo, WALKey, WALEdit) It only exists to get scope when replicating. Scope should be in the WALKey and not need us passing in a htd.

• scopeWALEdits

  public static void scopeWALEdits(HTableDescriptor htd,
                   WALKey logKey,
                   WALEdit logEdit)

  Utility method used to set the correct scopes on each log key. Doesn't set a scope on keys from compaction WAL edits and if the scope is local.

  Parameters:

  htd - Descriptor used to find the scope to use

  logKey - Key that may get scoped according to its edits

  logEdit - Edits used to lookup the scopes

• preLogRoll

  public void preLogRoll(org.apache.hadoop.fs.Path oldPath,
                org.apache.hadoop.fs.Path newPath)
                  throws IOException

  Description copied from interface: WALActionsListener
  The WAL is going to be rolled. The oldPath can be null if this is the first log file from the regionserver.

  Specified by:

  preLogRoll in interface WALActionsListener

  Overrides:

  preLogRoll in class WALActionsListener.Base

  Parameters:

  oldPath - the path to the old wal

  newPath - the path to the new wal

  Throws:

  IOException

• postLogRoll

  public void postLogRoll(org.apache.hadoop.fs.Path oldPath,
                 org.apache.hadoop.fs.Path newPath)
                   throws IOException

  Description copied from interface: WALActionsListener
  The WAL has been rolled. The oldPath can be null if this is the first log file from the regionserver.

  Specified by:

  postLogRoll in interface WALActionsListener

  Overrides:

  postLogRoll in class WALActionsListener.Base

  Parameters:

  oldPath - the path to the old wal

  newPath - the path to the new wal

  Throws:

  IOException

• decorateMasterConfiguration

  public static void decorateMasterConfiguration(org.apache.hadoop.conf.Configuration conf)

  This method modifies the master's configuration in order to inject replication-related features

  Parameters:

  conf -

• refreshAndGetReplicationLoad

  public ReplicationLoad refreshAndGetReplicationLoad()

  Description copied from interface: ReplicationService
  Refresh and Get ReplicationLoad

  Specified by:

  refreshAndGetReplicationLoad in interface ReplicationService

• buildReplicationLoad

  private void buildReplicationLoad()