Field Detail

• LOG

  private static final org.apache.commons.logging.Log LOG

• HFILE_NAME_REGEX

  public static final String HFILE_NAME_REGEX

  A non-capture group, for hfiles, so that this can be embedded. HFiles are uuid ([0-9a-z]+). Bulk loaded hfiles has (_SeqId_[0-9]+_) has suffix.

  See Also:

  Constant Field Values

• HFILE_NAME_PATTERN

  private static final Pattern HFILE_NAME_PATTERN

  Regex that will work for hfiles

• REF_NAME_PATTERN

  private static final Pattern REF_NAME_PATTERN

  Regex that will work for straight reference names (.) and hfilelink reference names (=-.) If reference, then the regex has more than just one group. Group 1, hfile/hfilelink pattern, is this file's id. Group 2 '(.+)' is the reference's parent region name.

  • conf

    private org.apache.hadoop.conf.Configuration conf

  • fs

    private final org.apache.hadoop.fs.FileSystem fs

  • hdfsBlocksDistribution

    private HDFSBlocksDistribution hdfsBlocksDistribution

  • reference

    private final Reference reference

  • link

    private final HFileLink link

  • initialPath

    private final org.apache.hadoop.fs.Path initialPath

  • coprocessorHost

    private RegionCoprocessorHost coprocessorHost

  • Constructor Detail

    • StoreFileInfo

      public StoreFileInfo(org.apache.hadoop.conf.Configuration conf,
                   org.apache.hadoop.fs.FileSystem fs,
                   org.apache.hadoop.fs.Path initialPath)
                    throws IOException

      Create a Store File Info

      Parameters:

      conf - the Configuration to use

      fs - The current file system to use.

      initialPath - The Path of the file

      Throws:

      IOException

    • StoreFileInfo

      public StoreFileInfo(org.apache.hadoop.conf.Configuration conf,
                   org.apache.hadoop.fs.FileSystem fs,
                   org.apache.hadoop.fs.FileStatus fileStatus)
                    throws IOException

      Create a Store File Info

      Parameters:

      conf - the Configuration to use

      fs - The current file system to use.

      fileStatus - The FileStatus of the file

      Throws:

      IOException

    • StoreFileInfo

      public StoreFileInfo(org.apache.hadoop.conf.Configuration conf,
                   org.apache.hadoop.fs.FileSystem fs,
                   org.apache.hadoop.fs.FileStatus fileStatus,
                   HFileLink link)
                    throws IOException

      Create a Store File Info from an HFileLink

      Parameters:

      conf - the Configuration to use

      fs - The current file system to use.

      fileStatus - The FileStatus of the file

      Throws:

      IOException

    • StoreFileInfo

      public StoreFileInfo(org.apache.hadoop.conf.Configuration conf,
                   org.apache.hadoop.fs.FileSystem fs,
                   org.apache.hadoop.fs.FileStatus fileStatus,
                   Reference reference)
                    throws IOException

      Create a Store File Info from an HFileLink

      Parameters:

      conf -

      fs -

      fileStatus -

      reference -

      Throws:

      IOException

  • Method Detail

    • setRegionCoprocessorHost

      public void setRegionCoprocessorHost(RegionCoprocessorHost coprocessorHost)

      Sets the region coprocessor env.

      Parameters:

      coprocessorHost -

    • getReference

      public Reference getReference()

    • isReference

      public boolean isReference()

      Returns:

      True if the store file is a Reference

    • isTopReference

      public boolean isTopReference()

      Returns:

      True if the store file is a top Reference

    • isLink

      public boolean isLink()

      Returns:

      True if the store file is a link

    • getHDFSBlockDistribution

      public HDFSBlocksDistribution getHDFSBlockDistribution()

      Returns:

      the HDFS block distribution

    • open

      public StoreFile.Reader open(org.apache.hadoop.fs.FileSystem fs,
                          CacheConfig cacheConf,
                          boolean canUseDropBehind)
                            throws IOException

      Open a Reader for the StoreFile

      Parameters:

      fs - The current file system to use.

      cacheConf - The cache configuration and block cache reference.

      Returns:

      The StoreFile.Reader for the file

      Throws:

      IOException

    • computeHDFSBlocksDistribution

      public HDFSBlocksDistribution computeHDFSBlocksDistribution(org.apache.hadoop.fs.FileSystem fs)
                                                           throws IOException

      Compute the HDFS Block Distribution for this StoreFile

      Throws:

      IOException

    • computeHDFSBlocksDistributionInternal

      private HDFSBlocksDistribution computeHDFSBlocksDistributionInternal(org.apache.hadoop.fs.FileSystem fs)
                                                                    throws IOException

      Throws:

      IOException

    • getReferencedFileStatus

      public org.apache.hadoop.fs.FileStatus getReferencedFileStatus(org.apache.hadoop.fs.FileSystem fs)
                                                              throws IOException

      Get the FileStatus of the file referenced by this StoreFileInfo

      Parameters:

      fs - The current file system to use.

      Returns:

      The FileStatus of the file referenced by this StoreFileInfo

      Throws:

      IOException

    • getPath

      public org.apache.hadoop.fs.Path getPath()

      Returns:

      The Path of the file

    • getFileStatus

      public org.apache.hadoop.fs.FileStatus getFileStatus()
                                                    throws IOException

      Returns:

      The FileStatus of the file

      Throws:

      IOException

    • getModificationTime

      public long getModificationTime()
                               throws IOException

      Returns:

      Get the modification time of the file.

      Throws:

      IOException

    • toString

      public String toString()

      Overrides:

      toString in class Object

    • isHFile

      public static boolean isHFile(org.apache.hadoop.fs.Path path)

      Parameters:

      path - Path to check.

      Returns:

      True if the path has format of a HFile.

    • isHFile

      public static boolean isHFile(String fileName)

    • isReference

      public static boolean isReference(org.apache.hadoop.fs.Path path)

      Parameters:

      path - Path to check.

      Returns:

      True if the path has format of a HStoreFile reference.

    • isReference

      public static boolean isReference(String name)

      Parameters:

      name - file name to check.

      Returns:

      True if the path has format of a HStoreFile reference.

    • getReferredToFile

      public static org.apache.hadoop.fs.Path getReferredToFile(org.apache.hadoop.fs.Path p)

    • validateStoreFileName

      public static boolean validateStoreFileName(String fileName)

      Validate the store file name.

      Parameters:

      fileName - name of the file to validate

      Returns:

      true if the file could be a valid store file, false otherwise

    • isValid

      public static boolean isValid(org.apache.hadoop.fs.FileStatus fileStatus)
                             throws IOException

      Return if the specified file is a valid store file or not.

      Parameters:

      fileStatus - The FileStatus of the file

      Returns:

      true if the file is valid

      Throws:

      IOException

    • computeRefFileHDFSBlockDistribution

      private static HDFSBlocksDistribution computeRefFileHDFSBlockDistribution(org.apache.hadoop.fs.FileSystem fs,
                                                               Reference reference,
                                                               org.apache.hadoop.fs.FileStatus status)
                                                                         throws IOException

      helper function to compute HDFS blocks distribution of a given reference file.For reference file, we don't compute the exact value. We use some estimate instead given it might be good enough. we assume bottom part takes the first half of reference file, top part takes the second half of the reference file. This is just estimate, given midkey ofregion != midkey of HFile, also the number and size of keys vary. If this estimate isn't good enough, we can improve it later.

      Parameters:

      fs - The FileSystem

      reference - The reference

      status - The reference FileStatus

      Returns:

      HDFS blocks distribution

      Throws:

      IOException

    • equals

      public boolean equals(Object that)

      Overrides:

      equals in class Object

    • hashCode

      public int hashCode()

      Overrides:

      hashCode in class Object

  • Overview
  • Package
  • Class
  • Use
  • Tree
  • Deprecated
  • Index
  • Help

  • Prev Class
  • Next Class

  • Frames
  • No Frames

  • All Classes

  • Summary: 
  • Nested | 
  • Field | 
  • Constr | 
  • Method

  • Detail: 
  • Field | 
  • Constr | 
  • Method

  Copyright © 2007–2019 The Apache Software Foundation. All rights reserved.