org.apache.hadoop.hbase.replication.master

Class ReplicationHFileCleaner

java.lang.Object

org.apache.hadoop.hbase.BaseConfigurable

org.apache.hadoop.hbase.master.cleaner.BaseFileCleanerDelegate

org.apache.hadoop.hbase.master.cleaner.BaseHFileCleanerDelegate

org.apache.hadoop.hbase.replication.master.ReplicationHFileCleaner

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, FileCleanerDelegate, Stoppable

@InterfaceAudience.LimitedPrivate(value="Configuration")
public class ReplicationHFileCleaner
extends BaseHFileCleanerDelegate

Implementation of a file cleaner that checks if a hfile is still scheduled for replication before deleting it from hfile archive directory.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	ReplicationHFileCleaner.WarnOnlyAbortable

Field Summary

Fields

Modifier and Type	Field and Description
private static org.slf4j.Logger	LOG
private ReplicationQueuesClient	rqc
private boolean	stopped
private ZKWatcher	zkw

Constructor Summary

Constructors

Constructor and Description
ReplicationHFileCleaner()

Method Summary

Modifier and Type	Method and Description
Iterable<org.apache.hadoop.fs.FileStatus>	getDeletableFiles(Iterable<org.apache.hadoop.fs.FileStatus> files) Determines which of the given files are safe to delete
private void	initReplicationQueuesClient(org.apache.hadoop.conf.Configuration conf, ZKWatcher zk)
boolean	isFileDeletable(org.apache.hadoop.fs.FileStatus fStat) Should the master delete the file or keep it?
boolean	isStopped()
private Set<String>	loadHFileRefsFromPeers() Load all hfile references in all replication queues from ZK.
void	setConf(org.apache.hadoop.conf.Configuration config)
void	setConf(org.apache.hadoop.conf.Configuration conf, ZKWatcher zk)
void	stop(String why) Stop this service.

Methods inherited from class org.apache.hadoop.hbase.master.cleaner.BaseFileCleanerDelegate

init

Methods inherited from class org.apache.hadoop.hbase.BaseConfigurable

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.master.cleaner.FileCleanerDelegate

preClean

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf

Field Detail

LOG

private static final org.slf4j.Logger LOG

zkw

private ZKWatcher zkw

rqc

private ReplicationQueuesClient rqc

stopped

private boolean stopped

Constructor Detail

ReplicationHFileCleaner

public ReplicationHFileCleaner()

Method Detail

getDeletableFiles

public Iterable<org.apache.hadoop.fs.FileStatus> getDeletableFiles(Iterable<org.apache.hadoop.fs.FileStatus> files)

Description copied from interface: FileCleanerDelegate

Determines which of the given files are safe to delete

Specified by:

getDeletableFiles in interface FileCleanerDelegate

Overrides:

getDeletableFiles in class BaseFileCleanerDelegate

Parameters:

files - files to check for deletion

Returns:

files that are ok to delete according to this cleaner

loadHFileRefsFromPeers

private Set<String> loadHFileRefsFromPeers()
                                    throws org.apache.zookeeper.KeeperException

Load all hfile references in all replication queues from ZK. This method guarantees to return a snapshot which contains all hfile references in the zookeeper at the start of this call. However, some newly created hfile references during the call may not be included.

Throws:

org.apache.zookeeper.KeeperException

setConf

public void setConf(org.apache.hadoop.conf.Configuration config)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class BaseConfigurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf,
                    ZKWatcher zk)

initReplicationQueuesClient

private void initReplicationQueuesClient(org.apache.hadoop.conf.Configuration conf,
                                         ZKWatcher zk)
                                  throws Exception

Throws:

Exception

stop

public void stop(String why)

Description copied from interface: Stoppable

Stop this service. Implementers should favor logging errors over throwing RuntimeExceptions.

Specified by:

stop in interface Stoppable

Overrides:

stop in class BaseHFileCleanerDelegate

Parameters:

why - Why we're stopping.

isStopped

public boolean isStopped()

Specified by:

isStopped in interface Stoppable

Overrides:

isStopped in class BaseHFileCleanerDelegate

Returns:

True if Stoppable.stop(String) has been closed.

isFileDeletable

public boolean isFileDeletable(org.apache.hadoop.fs.FileStatus fStat)

Description copied from class: BaseFileCleanerDelegate

Should the master delete the file or keep it?

Specified by:

isFileDeletable in class BaseFileCleanerDelegate

Parameters:

fStat - file status of the file to check

Returns:

true if the file is deletable, false if not