Package org.apache.hadoop.hbase.master.cleaner

Class TestCleanerChore

java.lang.Object

org.apache.hadoop.hbase.master.cleaner.TestCleanerChore

@Tag("org.apache.hadoop.hbase.testclassification.MasterTests") @Tag("org.apache.hadoop.hbase.testclassification.SmallTests")
public class TestCleanerChore
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static class	TestCleanerChore.AllValidPaths
static class	TestCleanerChore.AlwaysDelete
static class	TestCleanerChore.GetConcurrency
static class	TestCleanerChore.NeverDelete

Field Summary

Fields

Modifier and Type	Field	Description
private static final org.slf4j.Logger	LOG
private static org.apache.hadoop.hbase.master.cleaner.DirScanPool	POOL
private static org.apache.hadoop.hbase.ChoreService	SERVICE
private static final HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
TestCleanerChore()

Method Summary

Modifier and Type	Method	Description
static void	cleanup()
private void	createFiles(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path parentDir, int numOfFiles)
void	retriesIOExceptionInStatus()
static void	setup()
void	testCleanerDoesNotDeleteDirectoryWithLateAddedFiles()	While cleaning a directory, all the files in the directory may be deleted, but there may be another file added, in which case the directory shouldn't be deleted.
void	testDeleteFileWithCleanerDisabled()
void	testDeleteFileWithCleanerEnabled()
void	testDeletesEmptyDirectories()
void	testDoesNotCheckDirectories()	Test to make sure that we don't attempt to ask the delegate whether or not we should preserve a directory.
void	testMinimumNumberOfThreads()
void	testNoExceptionFromDirectoryWithRacyChildren()	The cleaner runs in a loop, where it first checks to see all the files under a directory can be deleted.
void	testOnConfigurationChange()
void	testOnConfigurationChangeLogCleaner()
void	testRescheduleNoConcurrencyRun()
void	testSavesFilesOnRequest()
void	testStoppedCleanerDoesNotDeleteFiles()
void	testTriggerCleaner()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtil UTIL

POOL

private static org.apache.hadoop.hbase.master.cleaner.DirScanPool POOL

SERVICE

private static org.apache.hadoop.hbase.ChoreService SERVICE

Constructor Details

TestCleanerChore

public TestCleanerChore()

Method Details

setup

@BeforeAll
public static void setup()

cleanup

@AfterAll
public static void cleanup()
                    throws Exception

Throws:

Exception

testSavesFilesOnRequest

@Test
public void testSavesFilesOnRequest()
                             throws Exception

Throws:

Exception

retriesIOExceptionInStatus

@Test
public void retriesIOExceptionInStatus()
                                throws Exception

Throws:

Exception

testDeletesEmptyDirectories

@Test
public void testDeletesEmptyDirectories()
                                 throws Exception

Throws:

Exception

testDoesNotCheckDirectories

@Test
public void testDoesNotCheckDirectories()
                                 throws Exception

Test to make sure that we don't attempt to ask the delegate whether or not we should preserve a directory.

Throws:

Exception - on failure

testStoppedCleanerDoesNotDeleteFiles

@Test
public void testStoppedCleanerDoesNotDeleteFiles()
                                          throws Exception

Throws:

Exception

testCleanerDoesNotDeleteDirectoryWithLateAddedFiles

@Test
public void testCleanerDoesNotDeleteDirectoryWithLateAddedFiles()
                                                         throws IOException

While cleaning a directory, all the files in the directory may be deleted, but there may be another file added, in which case the directory shouldn't be deleted.

Throws:

IOException - on failure

testNoExceptionFromDirectoryWithRacyChildren

@Test
public void testNoExceptionFromDirectoryWithRacyChildren()
                                                  throws Exception

The cleaner runs in a loop, where it first checks to see all the files under a directory can be deleted. If they all can, then we try to delete the directory. However, a file may be added that directory to after the original check. This ensures that we don't accidentally delete that directory on and don't get spurious IOExceptions.

This was from HBASE-7465.

Throws:

Exception - on failure

testDeleteFileWithCleanerEnabled

@Test
public void testDeleteFileWithCleanerEnabled()
                                      throws Exception

Throws:

Exception

testDeleteFileWithCleanerDisabled

@Test
public void testDeleteFileWithCleanerDisabled()
                                       throws Exception

Throws:

Exception

testOnConfigurationChange

@Test
public void testOnConfigurationChange()
                               throws Exception

Throws:

Exception

testOnConfigurationChangeLogCleaner

@Test
public void testOnConfigurationChangeLogCleaner()
                                         throws Exception

Throws:

Exception

testMinimumNumberOfThreads

@Test
public void testMinimumNumberOfThreads()
                                throws Exception

Throws:

Exception

testTriggerCleaner

@Test
public void testTriggerCleaner()
                        throws Exception

Throws:

Exception

testRescheduleNoConcurrencyRun

@Test
public void testRescheduleNoConcurrencyRun()
                                    throws Exception

Throws:

Exception

createFiles

private void createFiles(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path parentDir,
 int numOfFiles)
                  throws IOException

Throws:

IOException