Field Detail

• LOG

  private static final org.apache.commons.logging.Log LOG

• SNAPSHOT_MANIFEST_SIZE_LIMIT_CONF_KEY

  public static final String SNAPSHOT_MANIFEST_SIZE_LIMIT_CONF_KEY

  See Also:

  Constant Field Values

• DATA_MANIFEST_NAME

  public static final String DATA_MANIFEST_NAME

  See Also:

  Constant Field Values

• regionManifests

  private List<org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotRegionManifest> regionManifests

• desc

  private org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription desc

• htd

  private HTableDescriptor htd

• monitor

  private final ForeignExceptionSnare monitor

• conf

  private final org.apache.hadoop.conf.Configuration conf

• workingDir

  private final org.apache.hadoop.fs.Path workingDir

• fs

  private final org.apache.hadoop.fs.FileSystem fs

• manifestSizeLimit

  private int manifestSizeLimit

Constructor Detail

• SnapshotManifest

  private SnapshotManifest(org.apache.hadoop.conf.Configuration conf,
                  org.apache.hadoop.fs.FileSystem fs,
                  org.apache.hadoop.fs.Path workingDir,
                  org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription desc,
                  ForeignExceptionSnare monitor)

Method Detail

• create

  public static SnapshotManifest create(org.apache.hadoop.conf.Configuration conf,
                        org.apache.hadoop.fs.FileSystem fs,
                        org.apache.hadoop.fs.Path workingDir,
                        org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription desc,
                        ForeignExceptionSnare monitor)

  Return a SnapshotManifest instance, used for writing a snapshot. There are two usage pattern: - The Master will create a manifest, add the descriptor, offline regions and consolidate the snapshot by writing all the pending stuff on-disk. manifest = SnapshotManifest.create(...) manifest.addRegion(tableDir, hri) manifest.consolidate() - The RegionServer will create a single region manifest manifest = SnapshotManifest.create(...) manifest.addRegion(region)

• open

  public static SnapshotManifest open(org.apache.hadoop.conf.Configuration conf,
                      org.apache.hadoop.fs.FileSystem fs,
                      org.apache.hadoop.fs.Path workingDir,
                      org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription desc)
                               throws IOException

  Return a SnapshotManifest instance with the information already loaded in-memory. SnapshotManifest manifest = SnapshotManifest.open(...) HTableDescriptor htd = manifest.getTableDescriptor() for (SnapshotRegionManifest regionManifest: manifest.getRegionManifests()) hri = regionManifest.getRegionInfo() for (regionManifest.getFamilyFiles()) ...

  Throws:

  IOException

• addTableDescriptor

  public void addTableDescriptor(HTableDescriptor htd)
                          throws IOException

  Add the table descriptor to the snapshot manifest

  Throws:

  IOException

• createRegionVisitor

  private SnapshotManifest.RegionVisitor createRegionVisitor(org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription desc)
                                                      throws IOException

  Throws:

  IOException

• addRegion

  public void addRegion(HRegion region)
                 throws IOException

  Creates a 'manifest' for the specified region, by reading directly from the HRegion object. This is used by the "online snapshot" when the table is enabled.

  Throws:

  IOException

• addRegion

  public void addRegion(org.apache.hadoop.fs.Path tableDir,
               HRegionInfo regionInfo)
                 throws IOException

  Creates a 'manifest' for the specified region, by reading directly from the disk. This is used by the "offline snapshot" when the table is disabled.

  Throws:

  IOException

• load

  private void load()
             throws IOException

  Load the information in the SnapshotManifest. Called by SnapshotManifest.open() If the format is v2 and there is no data-manifest, means that we are loading an in-progress snapshot. Since we support rolling-upgrades, we loook for v1 and v2 regions format.

  Throws:

  IOException

• getSnapshotDir

  public org.apache.hadoop.fs.Path getSnapshotDir()

  Get the current snapshot working dir

• getSnapshotDescription

  public org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription getSnapshotDescription()

  Get the SnapshotDescription

• getTableDescriptor

  public HTableDescriptor getTableDescriptor()

  Get the table descriptor from the Snapshot

• getRegionManifests

  public List<org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotRegionManifest> getRegionManifests()

  Get all the Region Manifest from the snapshot

• getRegionManifestsMap

  public Map<String,org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotRegionManifest> getRegionManifestsMap()

  Get all the Region Manifest from the snapshot. This is an helper to get a map with the region encoded name

• consolidate

  public void consolidate()
                   throws IOException

  Throws:

  IOException

• convertToV2SingleManifest

  private void convertToV2SingleManifest()
                                  throws IOException

  Throws:

  IOException

• writeDataManifest

  private void writeDataManifest(org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotDataManifest manifest)
                          throws IOException

  Throws:

  IOException

• readDataManifest

  private org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotDataManifest readDataManifest()
                                                                                                   throws IOException

  Throws:

  IOException

• createExecutor

  private ThreadPoolExecutor createExecutor(String name)

• createExecutor

  public static ThreadPoolExecutor createExecutor(org.apache.hadoop.conf.Configuration conf,
                                  String name)

• getRegionNameFromManifest

  static String getRegionNameFromManifest(org.apache.hadoop.hbase.protobuf.generated.SnapshotProtos.SnapshotRegionManifest manifest)

  Extract the region encoded name from the region manifest

• getSnapshotFormat

  private static int getSnapshotFormat(org.apache.hadoop.hbase.protobuf.generated.HBaseProtos.SnapshotDescription desc)