Field Detail

• MASTER_HFILE_CLEANER_PLUGINS

  public static final String MASTER_HFILE_CLEANER_PLUGINS

  See Also:

  Constant Field Values

• HFILE_DELETE_THROTTLE_THRESHOLD

  public static final String HFILE_DELETE_THROTTLE_THRESHOLD

  See Also:

  Constant Field Values

• DEFAULT_HFILE_DELETE_THROTTLE_THRESHOLD

  public static final int DEFAULT_HFILE_DELETE_THROTTLE_THRESHOLD

  See Also:

  Constant Field Values

• LARGE_HFILE_QUEUE_INIT_SIZE

  public static final String LARGE_HFILE_QUEUE_INIT_SIZE

  See Also:

  Constant Field Values

• DEFAULT_LARGE_HFILE_QUEUE_INIT_SIZE

  public static final int DEFAULT_LARGE_HFILE_QUEUE_INIT_SIZE

  See Also:

  Constant Field Values

• SMALL_HFILE_QUEUE_INIT_SIZE

  public static final String SMALL_HFILE_QUEUE_INIT_SIZE

  See Also:

  Constant Field Values

• DEFAULT_SMALL_HFILE_QUEUE_INIT_SIZE

  public static final int DEFAULT_SMALL_HFILE_QUEUE_INIT_SIZE

  See Also:

  Constant Field Values

• LARGE_HFILE_DELETE_THREAD_NUMBER

  public static final String LARGE_HFILE_DELETE_THREAD_NUMBER

  See Also:

  Constant Field Values

• DEFAULT_LARGE_HFILE_DELETE_THREAD_NUMBER

  public static final int DEFAULT_LARGE_HFILE_DELETE_THREAD_NUMBER

  See Also:

  Constant Field Values

• SMALL_HFILE_DELETE_THREAD_NUMBER

  public static final String SMALL_HFILE_DELETE_THREAD_NUMBER

  See Also:

  Constant Field Values

• DEFAULT_SMALL_HFILE_DELETE_THREAD_NUMBER

  public static final int DEFAULT_SMALL_HFILE_DELETE_THREAD_NUMBER

  See Also:

  Constant Field Values

• HFILE_DELETE_THREAD_TIMEOUT_MSEC

  public static final String HFILE_DELETE_THREAD_TIMEOUT_MSEC

  See Also:

  Constant Field Values

• HFILE_DELETE_THREAD_CHECK_INTERVAL_MSEC

  public static final String HFILE_DELETE_THREAD_CHECK_INTERVAL_MSEC

  See Also:

  Constant Field Values

Constructor Detail

• HFileCleaner

  public HFileCleaner(int period,
              Stoppable stopper,
              org.apache.hadoop.conf.Configuration conf,
              org.apache.hadoop.fs.FileSystem fs,
              org.apache.hadoop.fs.Path directory,
              DirScanPool pool)

• HFileCleaner

  public HFileCleaner(int period,
              Stoppable stopper,
              org.apache.hadoop.conf.Configuration conf,
              org.apache.hadoop.fs.FileSystem fs,
              org.apache.hadoop.fs.Path directory,
              DirScanPool pool,
              Map<String,Object> params)

  Parameters:

  period - the period of time to sleep between each run

  stopper - the stopper

  conf - configuration to use

  fs - handle to the FS

  directory - directory to be cleaned

  params - params could be used in subclass of BaseHFileCleanerDelegate

Method Detail

• validate

  protected boolean validate(org.apache.hadoop.fs.Path file)

  Description copied from class: CleanerChore
  Validate the file to see if it even belongs in the directory. If it is valid, then the file will go through the cleaner delegates, but otherwise the file is just deleted.

  Specified by:

  validate in class CleanerChore<BaseHFileCleanerDelegate>

  Parameters:

  file - full Path of the file to be checked

  Returns:

  true if the file is valid, false otherwise

• getDelegatesForTesting

  public List<BaseHFileCleanerDelegate> getDelegatesForTesting()

  Exposed for TESTING!

• deleteFiles

  public int deleteFiles(Iterable<org.apache.hadoop.fs.FileStatus> filesToDelete)

  Description copied from class: CleanerChore
  Delete the given files

  Overrides:

  deleteFiles in class CleanerChore<BaseHFileCleanerDelegate>

  Parameters:

  filesToDelete - files to delete

  Returns:

  number of deleted files

• cleanup

  public void cleanup()

  Description copied from class: ScheduledChore
  Override to run cleanup tasks when the Chore encounters an error and must stop running

  Overrides:

  cleanup in class CleanerChore<BaseHFileCleanerDelegate>

• consumerLoop

  protected void consumerLoop(BlockingQueue<org.apache.hadoop.hbase.master.cleaner.HFileCleaner.HFileDeleteTask> queue)

• getCleanerThreads

  public List<Thread> getCleanerThreads()

• getNumOfDeletedLargeFiles

  public long getNumOfDeletedLargeFiles()

• getNumOfDeletedSmallFiles

  public long getNumOfDeletedSmallFiles()

• getLargeQueueInitSize

  public long getLargeQueueInitSize()

• getSmallQueueInitSize

  public long getSmallQueueInitSize()

• getThrottlePoint

  public long getThrottlePoint()

• onConfigurationChange

  public void onConfigurationChange(org.apache.hadoop.conf.Configuration conf)

  Description copied from interface: ConfigurationObserver
  This method would be called by the ConfigurationManager object when the Configuration object is reloaded from disk.

  Specified by:

  onConfigurationChange in interface ConfigurationObserver