Package org.apache.hadoop.hbase.client

Class SnapshotCloneIndependenceTestBase

java.lang.Object

org.apache.hadoop.hbase.client.SnapshotCloneIndependenceTestBase

Direct Known Subclasses:

TestMobSnapshotCloneIndependence, TestSnapshotCloneIndependence

public abstract class SnapshotCloneIndependenceTestBase
extends Object

Test to verify that the cloned table is independent of the table from which it was cloned

Field Summary

Fields

Modifier and Type	Field	Description
private org.apache.hadoop.hbase.client.Admin	admin
private static final int	CLEANER_INTERVAL
private org.apache.hadoop.hbase.TableName	cloneTableName
private int	countOriginalTable
private org.apache.hadoop.fs.FileSystem	fs
private static final org.slf4j.Logger	LOG
protected static final int	NUM_RS
private org.apache.hadoop.hbase.client.Table	originalTable
private org.apache.hadoop.hbase.TableName	originalTableName
private org.apache.hadoop.fs.Path	rootDir
(package private) String	snapshotName
(package private) String	snapshotNameAsString
protected static final byte[]	TEST_FAM
private static final String	TEST_FAM_STR
protected static final HBaseTestingUtil	UTIL

Constructor Summary

Constructors

Constructor	Description
SnapshotCloneIndependenceTestBase()

Method Summary

Modifier and Type	Method	Description
static void	cleanupTest()
protected int	countRows(org.apache.hadoop.hbase.client.Table table, byte[]... families)
private void	createAndCloneSnapshot(boolean online)	Takes the snapshot of originalTable and clones the snapshot to another tables.
protected org.apache.hadoop.hbase.client.Table	createTable(org.apache.hadoop.hbase.TableName table, byte[] family)
void	loadData(org.apache.hadoop.hbase.client.Table table, byte[]... families)
private void	runTestRegionOperationsIndependent()	Do a split, and verify that this only affects one table
private void	runTestSnapshotAppendIndependent()	Verify that adding data to original table or clone table doesn't affect other table.
private void	runTestSnapshotDeleteIndependent()	Verify that deleting the snapshot does not affect either table.
private void	runTestSnapshotMetadataChangesIndependent()	Add metadata, and verify that this only affects one table
void	setup(org.junit.jupiter.api.TestInfo testInfo)
protected static void	setupConf(org.apache.hadoop.conf.Configuration conf)
void	tearDown()
void	testOfflineSnapshotAppendIndependent()	Verify that adding data to the cloned table will not affect the original, and vice-versa when it is taken as an offline snapshot.
void	testOfflineSnapshotDeleteIndependent()
void	testOfflineSnapshotMetadataChangesIndependent()	Verify that adding netadata to the cloned table will not affect the original, and vice-versa when is taken as an online snapshot.
void	testOfflineSnapshotRegionOperationsIndependent()	Verify that region operations, in this case splitting a region, are independent between the cloned table and the original.
void	testOnlineSnapshotAppendIndependent()	Verify that adding data to the cloned table will not affect the original, and vice-versa when it is taken as an online snapshot.
void	testOnlineSnapshotDeleteIndependent()
void	testOnlineSnapshotMetadataChangesIndependent()	Verify that adding metadata to the cloned table will not affect the original, and vice-versa when it is taken as an online snapshot.
void	testOnlineSnapshotRegionOperationsIndependent()	Verify that region operations, in this case splitting a region, are independent between the cloned table and the original.
private static void	waitOnSplit(org.apache.hadoop.hbase.client.Connection c, org.apache.hadoop.hbase.client.Table t, int originalCount)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

UTIL

protected static final HBaseTestingUtil UTIL

NUM_RS

protected static final int NUM_RS

See Also:

• Constant Field Values

TEST_FAM_STR

private static final String TEST_FAM_STR

See Also:

• Constant Field Values

TEST_FAM

protected static final byte[] TEST_FAM

CLEANER_INTERVAL

private static final int CLEANER_INTERVAL

See Also:

• Constant Field Values

fs

private org.apache.hadoop.fs.FileSystem fs

rootDir

private org.apache.hadoop.fs.Path rootDir

admin

private org.apache.hadoop.hbase.client.Admin admin

originalTableName

private org.apache.hadoop.hbase.TableName originalTableName

originalTable

private org.apache.hadoop.hbase.client.Table originalTable

cloneTableName

private org.apache.hadoop.hbase.TableName cloneTableName

countOriginalTable

private int countOriginalTable

snapshotNameAsString

String snapshotNameAsString

snapshotName

String snapshotName

Constructor Details

SnapshotCloneIndependenceTestBase

public SnapshotCloneIndependenceTestBase()

Method Details

setupConf

protected static void setupConf(org.apache.hadoop.conf.Configuration conf)

setup

@BeforeEach
public void setup(org.junit.jupiter.api.TestInfo testInfo)
           throws Exception

Throws:

Exception

tearDown

@AfterEach
public void tearDown()
              throws Exception

Throws:

Exception

cleanupTest

@AfterAll
public static void cleanupTest()
                        throws Exception

Throws:

Exception

testOnlineSnapshotAppendIndependent

@Test
public void testOnlineSnapshotAppendIndependent()
                                         throws Exception

Verify that adding data to the cloned table will not affect the original, and vice-versa when it is taken as an online snapshot.

Throws:

Exception

testOfflineSnapshotAppendIndependent

@Test
public void testOfflineSnapshotAppendIndependent()
                                          throws Exception

Verify that adding data to the cloned table will not affect the original, and vice-versa when it is taken as an offline snapshot.

Throws:

Exception

testOnlineSnapshotMetadataChangesIndependent

@Test
public void testOnlineSnapshotMetadataChangesIndependent()
                                                  throws Exception

Verify that adding metadata to the cloned table will not affect the original, and vice-versa when it is taken as an online snapshot.

Throws:

Exception

testOfflineSnapshotMetadataChangesIndependent

@Test
public void testOfflineSnapshotMetadataChangesIndependent()
                                                   throws Exception

Verify that adding netadata to the cloned table will not affect the original, and vice-versa when is taken as an online snapshot.

Throws:

Exception

testOfflineSnapshotRegionOperationsIndependent

@Test
public void testOfflineSnapshotRegionOperationsIndependent()
                                                    throws Exception

Verify that region operations, in this case splitting a region, are independent between the cloned table and the original.

Throws:

Exception

testOnlineSnapshotRegionOperationsIndependent

@Test
public void testOnlineSnapshotRegionOperationsIndependent()
                                                   throws Exception

Verify that region operations, in this case splitting a region, are independent between the cloned table and the original.

Throws:

Exception

testOfflineSnapshotDeleteIndependent

@Test
public void testOfflineSnapshotDeleteIndependent()
                                          throws Exception

Throws:

Exception

testOnlineSnapshotDeleteIndependent

@Test
public void testOnlineSnapshotDeleteIndependent()
                                         throws Exception

Throws:

Exception

waitOnSplit

private static void waitOnSplit(org.apache.hadoop.hbase.client.Connection c,
 org.apache.hadoop.hbase.client.Table t,
 int originalCount)
                         throws Exception

Throws:

Exception

createAndCloneSnapshot

private void createAndCloneSnapshot(boolean online)
                             throws Exception

Takes the snapshot of originalTable and clones the snapshot to another tables. If online is false, the original table is disabled during taking snapshot, so also enables it again.

Parameters:

online - - Whether the table is online or not during the snapshot

Throws:

Exception

runTestSnapshotAppendIndependent

private void runTestSnapshotAppendIndependent()
                                       throws Exception

Verify that adding data to original table or clone table doesn't affect other table.

Throws:

Exception

runTestRegionOperationsIndependent

private void runTestRegionOperationsIndependent()
                                         throws Exception

Do a split, and verify that this only affects one table

Throws:

Exception

runTestSnapshotMetadataChangesIndependent

private void runTestSnapshotMetadataChangesIndependent()
                                                throws Exception

Add metadata, and verify that this only affects one table

Throws:

Exception

runTestSnapshotDeleteIndependent

private void runTestSnapshotDeleteIndependent()
                                       throws Exception

Verify that deleting the snapshot does not affect either table.

Throws:

Exception

createTable

protected org.apache.hadoop.hbase.client.Table createTable(org.apache.hadoop.hbase.TableName table,
 byte[] family)
                                                    throws Exception

Throws:

Exception

loadData

public void loadData(org.apache.hadoop.hbase.client.Table table,
 byte[]... families)
              throws Exception

Throws:

Exception

countRows

protected int countRows(org.apache.hadoop.hbase.client.Table table,
 byte[]... families)
                 throws Exception

Throws:

Exception