Package org.apache.hadoop.hbase.backup

Class BackupHFileCleaner

java.lang.Object

org.apache.hadoop.hbase.BaseConfigurable

org.apache.hadoop.hbase.master.cleaner.BaseFileCleanerDelegate

org.apache.hadoop.hbase.master.cleaner.BaseHFileCleanerDelegate

org.apache.hadoop.hbase.backup.BackupHFileCleaner

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, Abortable, FileCleanerDelegate, Stoppable

@LimitedPrivate("Configuration")
public class BackupHFileCleaner
extends BaseHFileCleanerDelegate
implements Abortable

Implementation of a file cleaner that checks if an hfile is still referenced by backup before deleting it from hfile archive directory.

Field Summary

Fields

Modifier and Type	Field	Description
private boolean	aborted
private boolean	checkForFullyBackedUpTables
private org.apache.hadoop.conf.Configuration	conf
private Connection	connection
private List<TableName>	fullyBackedUpTables
private static final org.slf4j.Logger	LOG
private long	prevReadFromBackupTbl
private long	secondPrevReadFromBackupTbl
private boolean	stopped

Constructor Summary

Constructors

Constructor	Description
BackupHFileCleaner()

Method Summary

Modifier and Type	Method	Description
void	abort(String why, Throwable e)	Abort the server or client.
Iterable<org.apache.hadoop.fs.FileStatus>	getDeletableFiles(Iterable<org.apache.hadoop.fs.FileStatus> files)	Determines which of the given files are safe to delete
private Set<String>	getFilenameFromBulkLoad(Map<byte[],List<org.apache.hadoop.fs.Path>>[] maps)
boolean	isAborted()	Check if the server or client was aborted.
boolean	isFileDeletable(org.apache.hadoop.fs.FileStatus fStat)	Should the master delete the file or keep it?
boolean	isStopped()	Returns True if Stoppable.stop(String) has been closed.
private Set<String>	loadHFileRefs(List<TableName> tableList)
(package private) void	setCheckForFullyBackedUpTables(boolean b)
void	setConf(org.apache.hadoop.conf.Configuration config)
void	stop(String why)	Stop this service.

Methods inherited from class org.apache.hadoop.hbase.master.cleaner.BaseFileCleanerDelegate

init

Methods inherited from class org.apache.hadoop.hbase.BaseConfigurable

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.Abortable

abort

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf

Methods inherited from interface org.apache.hadoop.hbase.master.cleaner.FileCleanerDelegate

isEmptyDirDeletable, postClean, preClean

Field Details

LOG

private static final org.slf4j.Logger LOG

stopped

private boolean stopped

aborted

private boolean aborted

conf

private org.apache.hadoop.conf.Configuration conf

connection

private Connection connection

prevReadFromBackupTbl

private long prevReadFromBackupTbl

secondPrevReadFromBackupTbl

private long secondPrevReadFromBackupTbl

checkForFullyBackedUpTables

private boolean checkForFullyBackedUpTables

fullyBackedUpTables

private List<TableName> fullyBackedUpTables

Constructor Details

BackupHFileCleaner

public BackupHFileCleaner()

Method Details

getFilenameFromBulkLoad

private Set<String> getFilenameFromBulkLoad(Map<byte[],List<org.apache.hadoop.fs.Path>>[] maps)

loadHFileRefs

private Set<String> loadHFileRefs(List<TableName> tableList)
                           throws IOException

Throws:

IOException

setCheckForFullyBackedUpTables

@Private
void setCheckForFullyBackedUpTables(boolean b)

getDeletableFiles

public Iterable<org.apache.hadoop.fs.FileStatus> getDeletableFiles(Iterable<org.apache.hadoop.fs.FileStatus> files)

Description copied from interface: FileCleanerDelegate

Determines which of the given files are safe to delete

Specified by:

getDeletableFiles in interface FileCleanerDelegate

Overrides:

getDeletableFiles in class BaseFileCleanerDelegate

Parameters:

files - files to check for deletion

Returns:

files that are ok to delete according to this cleaner

isFileDeletable

public boolean isFileDeletable(org.apache.hadoop.fs.FileStatus fStat)

Description copied from class: BaseFileCleanerDelegate

Should the master delete the file or keep it?

Specified by:

isFileDeletable in class BaseFileCleanerDelegate

Parameters:

fStat - file status of the file to check

Returns:

true if the file is deletable, false if not

setConf

public void setConf(org.apache.hadoop.conf.Configuration config)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class BaseConfigurable

stop

public void stop(String why)

Description copied from interface: Stoppable

Stop this service. Implementers should favor logging errors over throwing RuntimeExceptions.

Specified by:

stop in interface Stoppable

Overrides:

stop in class BaseHFileCleanerDelegate

Parameters:

why - Why we're stopping.

isStopped

public boolean isStopped()

Description copied from interface: Stoppable

Returns True if Stoppable.stop(String) has been closed.

Specified by:

isStopped in interface Stoppable

Overrides:

isStopped in class BaseHFileCleanerDelegate

abort

public void abort(String why,
 Throwable e)

Description copied from interface: Abortable

Abort the server or client.

Specified by:

abort in interface Abortable

Parameters:

why - Why we're aborting.

e - Throwable that caused abort. Can be null.

isAborted

public boolean isAborted()

Description copied from interface: Abortable

Check if the server or client was aborted.

Specified by:

isAborted in interface Abortable

Returns:

true if the server or client was aborted, false otherwise