Package org.apache.hadoop.hbase.master.cleaner

Class TestSnapshotFromMaster

java.lang.Object

org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster

@Tag("org.apache.hadoop.hbase.testclassification.MasterTests") @Tag("org.apache.hadoop.hbase.testclassification.MediumTests")
public class TestSnapshotFromMaster
extends Object

Test the master-related aspects of a snapshot

Field Summary

Fields

Modifier and Type	Field	Description
private static org.apache.hadoop.fs.Path	archiveDir
private static final int	blockingStoreFiles
private static final long	cacheRefreshPeriod
private static org.apache.hadoop.fs.FileSystem	fs
private static final org.slf4j.Logger	LOG
private static org.apache.hadoop.hbase.master.HMaster	master
private static final int	NUM_RS
private static org.apache.hadoop.fs.Path	rootDir
private static final org.apache.hadoop.hbase.TableName	TABLE_NAME
private static final byte[]	TEST_FAM
private static final HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
TestSnapshotFromMaster()

Method Summary

Modifier and Type	Method	Description
static void	cleanupTest()
private org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription	createSnapshot(String snapshotName)
private org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription	createSnapshotWithTtl(String snapshotName, long ttl)
private static void	ensureHFileCleanersRun()	Make sure the HFileCleaners run at least once
private final Collection<String>	getHFiles(org.apache.hadoop.fs.Path dir, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.hbase.TableName tableName)
void	setup()
static void	setupCluster()	Setup the config for the cluster
private static void	setupConf(org.apache.hadoop.conf.Configuration conf)
void	tearDown()
void	testAsyncSnapshotWillNotBlockSnapshotHFileCleaner()
void	testDeleteSnapshot()
void	testGetCompletedSnapshots()
void	testGetCompletedSnapshotsWithCleanup()
void	testGetCompletedSnapshotsWithoutCleanup()
void	testIsDoneContract()	Test that the contract from the master for checking on a snapshot are valid.
void	testSnapshotCleanupStatus()
void	testSnapshotHFileArchiving()	Test that the snapshot hfile archive cleaner works correctly.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

private static final HBaseTestingUtil UTIL

NUM_RS

private static final int NUM_RS

See Also:

• Constant Field Values

rootDir

private static org.apache.hadoop.fs.Path rootDir

fs

private static org.apache.hadoop.fs.FileSystem fs

master

private static org.apache.hadoop.hbase.master.HMaster master

archiveDir

private static org.apache.hadoop.fs.Path archiveDir

TEST_FAM

private static final byte[] TEST_FAM

TABLE_NAME

private static final org.apache.hadoop.hbase.TableName TABLE_NAME

cacheRefreshPeriod

private static final long cacheRefreshPeriod

See Also:

• Constant Field Values

blockingStoreFiles

private static final int blockingStoreFiles

See Also:

• Constant Field Values

Constructor Details

TestSnapshotFromMaster

public TestSnapshotFromMaster()

Method Details

setupCluster

@BeforeAll
public static void setupCluster()
                         throws Exception

Setup the config for the cluster

Throws:

Exception

setupConf

private static void setupConf(org.apache.hadoop.conf.Configuration conf)

setup

@BeforeEach
public void setup()
           throws Exception

Throws:

Exception

tearDown

@AfterEach
public void tearDown()
              throws Exception

Throws:

Exception

cleanupTest

@AfterAll
public static void cleanupTest()
                        throws Exception

Throws:

Exception

testIsDoneContract

@Test
public void testIsDoneContract()
                        throws Exception

Test that the contract from the master for checking on a snapshot are valid.

1. If a snapshot fails with an error, we expect to get the source error.
2. If there is no snapshot name supplied, we should get an error.
3. If asking about a snapshot has hasn't occurred, you should get an error.

Throws:

Exception

testGetCompletedSnapshots

@Test
public void testGetCompletedSnapshots()
                               throws Exception

Throws:

Exception

testDeleteSnapshot

@Test
public void testDeleteSnapshot()
                        throws Exception

Throws:

Exception

testGetCompletedSnapshotsWithCleanup

@Test
public void testGetCompletedSnapshotsWithCleanup()
                                          throws Exception

Throws:

Exception

testGetCompletedSnapshotsWithoutCleanup

@Test
public void testGetCompletedSnapshotsWithoutCleanup()
                                             throws Exception

Throws:

Exception

testSnapshotCleanupStatus

@Test
public void testSnapshotCleanupStatus()
                               throws Exception

Throws:

Exception

testSnapshotHFileArchiving

@Test
public void testSnapshotHFileArchiving()
                                throws Exception

Test that the snapshot hfile archive cleaner works correctly. HFiles that are in snapshots should be retained, while those that are not in a snapshot should be deleted.

Throws:

Exception - on failure

getHFiles

private final Collection<String> getHFiles(org.apache.hadoop.fs.Path dir,
 org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.hbase.TableName tableName)
                                    throws IOException

Returns:

all the HFiles for a given table in the specified dir

Throws:

IOException - on expected failure

ensureHFileCleanersRun

private static void ensureHFileCleanersRun()

Make sure the HFileCleaners run at least once

createSnapshot

private org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription createSnapshot(String snapshotName)
                                                                                                     throws IOException

Throws:

IOException

createSnapshotWithTtl

private org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription createSnapshotWithTtl(String snapshotName,
 long ttl)
                                                                                                            throws IOException

Throws:

IOException

testAsyncSnapshotWillNotBlockSnapshotHFileCleaner

@Test
public void testAsyncSnapshotWillNotBlockSnapshotHFileCleaner()
                                                       throws Exception

Throws:

Exception