Field Detail

• fs

  private org.apache.hadoop.fs.FileSystem fs

• LOG

  private static final org.apache.commons.logging.Log LOG

• DEFAULT_NUM_OF_THREADS

  private static final int DEFAULT_NUM_OF_THREADS

  See Also:

  Constant Field Values

• PRE_NS_DOT_ARCHIVE

  private static final String PRE_NS_DOT_ARCHIVE

  Pre-namespace archive directory

  See Also:

  Constant Field Values

• PRE_NS_DOT_TMP

  private static final String PRE_NS_DOT_TMP

  Pre-namespace tmp directory

  See Also:

  Constant Field Values

• numOfThreads

  private int numOfThreads

• targetDirPath

  private org.apache.hadoop.fs.Path targetDirPath

  directory to start the processing.

• exec

  private ExecutorService exec

  executor for processing regions.

• processedTables

  private final Set<org.apache.hadoop.fs.Path> processedTables

  Keeps record of processed tables.

• corruptedHFiles

  private final Set<org.apache.hadoop.fs.Path> corruptedHFiles

  set of corrupted HFiles (with undetermined major version)

• hFileV1Set

  private final Set<org.apache.hadoop.fs.Path> hFileV1Set

  set of HfileV1;

• options

  private org.apache.commons.cli.Options options

• defaultNamespace

  private org.apache.hadoop.fs.Path defaultNamespace

  used for computing pre-namespace paths for hfilelinks

Constructor Detail

• HFileV1Detector

  public HFileV1Detector()

Method Detail

• parseOption

  private boolean parseOption(String[] args)
                       throws org.apache.commons.cli.ParseException,
                              IOException

  Throws:

  org.apache.commons.cli.ParseException

  IOException

• run

  public int run(String[] args)
          throws IOException,
                 org.apache.commons.cli.ParseException

  Checks for HFileV1.

  Specified by:

  run in interface org.apache.hadoop.util.Tool

  Returns:

  0 when no HFileV1 is present. 1 when a HFileV1 is present or, when there is a file with corrupt major version (neither V1 nor V2). -1 in case of any error/exception

  Throws:

  IOException

  org.apache.commons.cli.ParseException

• setDefaultNamespaceDir

  private void setDefaultNamespaceDir()
                               throws IOException

  Throws:

  IOException

• processResult

  private int processResult(Set<org.apache.hadoop.fs.Path> regionsWithHFileV1)

• printSet

  private void printSet(Set<org.apache.hadoop.fs.Path> result,
              String msg)

• checkForV1Files

  private Set<org.apache.hadoop.fs.Path> checkForV1Files(org.apache.hadoop.fs.Path targetDir)
                                                  throws IOException

  Takes a directory path, and lists out any HFileV1, if present.

  Parameters:

  targetDir - directory to start looking for HFilev1.

  Returns:

  set of Regions that have HFileV1

  Throws:

  IOException

• isRootTable

  private boolean isRootTable(org.apache.hadoop.fs.Path path)

  Ignore ROOT table as it doesn't exist in 0.96.

  Parameters:

  path -

• processTable

  private Set<org.apache.hadoop.fs.Path> processTable(org.apache.hadoop.fs.Path tableDir)
                                               throws IOException

  Find out regions in the table which have HFileV1.

  Parameters:

  tableDir -

  Returns:

  the set of regions containing HFile v1.

  Throws:

  IOException

• processRegion

  private Future<org.apache.hadoop.fs.Path> processRegion(org.apache.hadoop.fs.Path regionDir)

  Each region is processed by a separate handler. If a HRegion has a hfileV1, its path is returned as the future result, otherwise, a null value is returned.

  Parameters:

  regionDir - Region to process.

  Returns:

  corresponding Future object.

• getFileLinkWithPreNSPath

  public FileLink getFileLinkWithPreNSPath(org.apache.hadoop.fs.Path storeFilePath)
                                    throws IOException

  Creates a FileLink which adds pre-namespace paths in its list of available paths. This is used when reading a snapshot file in a pre-namespace file layout, for example, while upgrading.

  Parameters:

  storeFilePath -

  Returns:

  a FileLink which could read from pre-namespace paths.

  Throws:

  IOException

• getPreNSPathsForHFileLink

  private List<org.apache.hadoop.fs.Path> getPreNSPathsForHFileLink(HFileLink fileLink)
                                                             throws IOException

  Throws:

  IOException

• removeDefaultNSPath

  private String removeDefaultNSPath(org.apache.hadoop.fs.Path originalPath)

  Removes the prefix of defaultNamespace from the path.

  Parameters:

  originalPath -

• getPreNSPath

  private org.apache.hadoop.fs.Path getPreNSPath(String prefix,
                                       String relativeTablePath)
                                          throws IOException

  Throws:

  IOException

• isTableDir

  private static boolean isTableDir(org.apache.hadoop.fs.FileSystem fs,
                   org.apache.hadoop.fs.Path path)
                             throws IOException

  Throws:

  IOException

• isRegionDir

  private static boolean isRegionDir(org.apache.hadoop.fs.FileSystem fs,
                    org.apache.hadoop.fs.Path path)
                              throws IOException

  Throws:

  IOException

• main

  public static void main(String[] args)
                   throws Exception

  Throws:

  Exception