@InterfaceAudience.Private @InterfaceStability.Unstable public final class MasterSnapshotVerifier extends Object
This is a light-weight verification mechanism for all the files in a snapshot. It doesn't attempt to verify that the files are exact copies (that would be paramount to taking the snapshot again!), but instead just attempts to ensure that the files match the expected files and are the same length.
Taking an online snapshots can race against other operations and this is an last line of defense. For example, if meta changes between when snapshots are taken not all regions of a table may be present. This can be caused by a region split (daughters present on this scan, but snapshot took parent), or move (snapshots only checks lists of region servers, a move could have caused a region to be skipped or done twice).
Current snapshot files checked:
HRegionInfo matches the current and stored regions| Modifier and Type | Field and Description |
|---|---|
private org.apache.hadoop.fs.FileSystem |
fs |
private static org.apache.commons.logging.Log |
LOG |
private org.apache.hadoop.fs.Path |
rootDir |
private MasterServices |
services |
private org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription |
snapshot |
private TableName |
tableName |
| Constructor and Description |
|---|
MasterSnapshotVerifier(MasterServices services,
org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription snapshot,
org.apache.hadoop.fs.Path rootDir) |
| Modifier and Type | Method and Description |
|---|---|
private void |
verifyRegionInfo(HRegionInfo region,
org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotRegionManifest manifest)
Verify that the regionInfo is valid
|
private void |
verifyRegions(SnapshotManifest manifest)
Check that all the regions in the snapshot are valid, and accounted for.
|
void |
verifySnapshot(org.apache.hadoop.fs.Path snapshotDir,
Set<String> snapshotServers)
Verify that the snapshot in the directory is a valid snapshot
|
private void |
verifySnapshotDescription(org.apache.hadoop.fs.Path snapshotDir)
Check that the snapshot description written in the filesystem matches the current snapshot
|
private void |
verifyTableInfo(SnapshotManifest manifest)
Check that the table descriptor for the snapshot is a valid table descriptor
|
private static final org.apache.commons.logging.Log LOG
private org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription snapshot
private org.apache.hadoop.fs.FileSystem fs
private org.apache.hadoop.fs.Path rootDir
private TableName tableName
private MasterServices services
public MasterSnapshotVerifier(MasterServices services, org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription snapshot, org.apache.hadoop.fs.Path rootDir)
services - services for the mastersnapshot - snapshot to checkrootDir - root directory of the hbase installation.public void verifySnapshot(org.apache.hadoop.fs.Path snapshotDir,
Set<String> snapshotServers)
throws CorruptedSnapshotException,
IOException
snapshotDir - snapshot directory to checksnapshotServers - ServerName
of the servers that are involved in the snapshotCorruptedSnapshotException - if the snapshot is invalidIOException - if there is an unexpected connection issue to the filesystemprivate void verifySnapshotDescription(org.apache.hadoop.fs.Path snapshotDir)
throws CorruptedSnapshotException
snapshotDir - snapshot directory to checkCorruptedSnapshotExceptionprivate void verifyTableInfo(SnapshotManifest manifest) throws IOException
manifest - snapshot manifest to inspectIOExceptionprivate void verifyRegions(SnapshotManifest manifest) throws IOException
manifest - snapshot manifest to inspectIOException - if we can't reach hbase:meta or read the files from the FSprivate void verifyRegionInfo(HRegionInfo region, org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotRegionManifest manifest) throws IOException
region - the region to checkmanifest - snapshot manifest to inspectIOExceptionCopyright © 2007–2019 The Apache Software Foundation. All rights reserved.