Package org.apache.hadoop.hbase.backup.impl

Class FullTableBackupClient

java.lang.Object

org.apache.hadoop.hbase.backup.impl.TableBackupClient

org.apache.hadoop.hbase.backup.impl.FullTableBackupClient

@Private
public class FullTableBackupClient
extends TableBackupClient

Full table backup implementation

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.backup.impl.TableBackupClient

TableBackupClient.Stage

Field Summary

Fields

Modifier and Type	Field	Description
private static final org.slf4j.Logger	LOG

Fields inherited from class org.apache.hadoop.hbase.backup.impl.TableBackupClient

BACKUP_CLIENT_IMPL_CLASS, BACKUP_TEST_MODE_STAGE, backupId, backupInfo, backupManager, conf, conn, fs, newTimestamps, tableList

Constructor Summary

Constructors

Constructor	Description
FullTableBackupClient()
FullTableBackupClient(Connection conn, String backupId, BackupRequest request)

Method Summary

Modifier and Type	Method	Description
private void	addContinuousBackupReplicationPeer(Admin admin)
(package private) static Map<String,Long>	computeLogBoundaries(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path walRootDir, Map<String,Long> rolledHosts, Admin admin)	Computes the per-host log boundaries stored by this full backup, so that the next incremental backup includes exactly the WALs whose edits may be missing from the snapshot.
private boolean	continuousBackupReplicationPeerExists(Admin admin)
private void	enableTableReplication(Admin admin)
void	execute()	Backup request execution.
private void	handleContinuousBackup(Admin admin)
private void	handleNonContinuousBackup(Admin admin)
private void	performBackupSnapshots(Admin admin)
private Map<String,Long>	performLogRoll()
private void	performSnapshots(Admin admin)
protected void	snapshotCopy(BackupInfo backupInfo)	Do snapshot copy.
protected void	snapshotTable(Admin admin, TableName tableName, String snapshotName)
private long	startContinuousWALBackup(Admin admin)
private void	updateBackupMetadata()
private void	updateContinuousBackupReplicationPeer(Admin admin)

Methods inherited from class org.apache.hadoop.hbase.backup.impl.TableBackupClient

addManifest, beginBackup, cleanupAndRestoreBackupSystem, cleanupExportSnapshotLog, cleanupTargetDir, completeBackup, deleteSnapshots, failBackup, failStageIf, getAncestors, getMessage, getTestStage, init, obtainBackupMetaDataStr

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

Constructor Details

FullTableBackupClient

public FullTableBackupClient()

FullTableBackupClient

public FullTableBackupClient(Connection conn,
 String backupId,
 BackupRequest request)
                      throws IOException

Throws:

IOException

Method Details

snapshotCopy

protected void snapshotCopy(BackupInfo backupInfo)
                     throws IOException

Do snapshot copy.

Parameters:

backupInfo - backup info

Throws:

IOException - exception

execute

public void execute()
             throws IOException

Backup request execution.

Specified by:

execute in class TableBackupClient

Throws:

IOException - if the execution of the backup fails

handleContinuousBackup

private void handleContinuousBackup(Admin admin)
                             throws IOException

Throws:

IOException

handleNonContinuousBackup

private void handleNonContinuousBackup(Admin admin)
                                throws IOException

Throws:

IOException

performLogRoll

private Map<String,Long> performLogRoll()
                                 throws IOException

Throws:

IOException

performBackupSnapshots

private void performBackupSnapshots(Admin admin)
                             throws IOException

Throws:

IOException

performSnapshots

private void performSnapshots(Admin admin)
                       throws IOException

Throws:

IOException

computeLogBoundaries

static Map<String,Long> computeLogBoundaries(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path walRootDir,
 Map<String,Long> rolledHosts,
 Admin admin)
                                      throws IOException

Computes the per-host log boundaries stored by this full backup, so that the next incremental backup includes exactly the WALs whose edits may be missing from the snapshot. It must run right after the log roll, before the snapshot is taken, so that a host starting later gets no boundary and has all of its WALs included in the next incremental backup.

Boundaries are computed by BackupUtils.computeLogBoundaries(java.util.Map<java.lang.String, java.lang.Long>, java.util.Collection<java.lang.String>, java.util.Collection<java.lang.String>):

• A host that took part in this backup's log roll gets its roll result. WALs created after the roll will be included in the next incremental backup, even though some of their edits may already be in the snapshot, which is safe because deletes are replayed along with the puts.
• For any other host, its archived WALs and the WALs of dead servers are covered by the snapshot, so the next incremental backup does not replay them.
• The WALs of a live server that did not take part in the roll (for example one that started during it) are pending, because they can still receive edits that are not in the snapshot.

If the master's server list is incomplete (for example right after a master failover), the backup fails instead of treating live servers as dead.

Throws:

IOException

updateBackupMetadata

private void updateBackupMetadata()
                           throws IOException

Throws:

IOException

startContinuousWALBackup

private long startContinuousWALBackup(Admin admin)
                               throws IOException

Throws:

IOException

enableTableReplication

private void enableTableReplication(Admin admin)
                             throws IOException

Throws:

IOException

updateContinuousBackupReplicationPeer

private void updateContinuousBackupReplicationPeer(Admin admin)
                                            throws IOException

Throws:

IOException

addContinuousBackupReplicationPeer

private void addContinuousBackupReplicationPeer(Admin admin)
                                         throws IOException

Throws:

IOException

continuousBackupReplicationPeerExists

private boolean continuousBackupReplicationPeerExists(Admin admin)
                                               throws IOException

Throws:

IOException

snapshotTable

protected void snapshotTable(Admin admin,
 TableName tableName,
 String snapshotName)
                      throws IOException

Throws:

IOException