Package org.apache.hadoop.hbase.backup.mapreduce

Class TestBulkLoadCollectorJobIntegration

java.lang.Object

org.apache.hadoop.hbase.backup.mapreduce.TestBulkLoadCollectorJobIntegration

@Tag("org.apache.hadoop.hbase.testclassification.MapReduceTests") @Tag("org.apache.hadoop.hbase.testclassification.LargeTests")
public class TestBulkLoadCollectorJobIntegration
extends Object

Integration-like unit test for BulkLoadCollectorJob.

- Creates a WAL with a BULK_LOAD descriptor (ProtobufLogWriter).

- Runs BulkLoadCollectorJob.

- Verifies the job emits the expected store-file path.

Field Summary

Fields

Modifier and Type	Field	Description
private static org.apache.hadoop.conf.Configuration	conf
private static final byte[]	family
private static org.apache.hadoop.fs.FileSystem	fs
private static org.apache.hadoop.fs.Path	hbaseDir
(package private) static final org.apache.hadoop.hbase.client.RegionInfo	info
private static final org.slf4j.Logger	LOG
private static org.apache.hadoop.fs.Path	logDir
protected org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl	mvcc
protected static NavigableMap<byte[],Integer>	scopes
(package private) static final org.apache.hadoop.hbase.TableName	tableName
private static final HBaseTestingUtil	TEST_UTIL

Constructor Summary

Constructors

Constructor	Description
TestBulkLoadCollectorJobIntegration()

Method Summary

Modifier and Type	Method	Description
private org.apache.hadoop.hbase.wal.WAL.Entry	createBulkLoadWalEntry(String regionName, String family, String... storeFiles)
private static String	getName()
protected org.apache.hadoop.hbase.wal.WALKeyImpl	getWalKeyImpl(long time, NavigableMap<byte[],Integer> scopes)
void	setUp()
static void	setUpBeforeClass()
static void	tearDownAfterClass()
void	testBulkLoadCollectorEmitsStoreFilesFromWAL()	Test that BulkLoadCollectorJob discovers and emits store-file paths from WAL files created using WALFactory (no RegionServer needed).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

TEST_UTIL

private static final HBaseTestingUtil TEST_UTIL

conf

private static org.apache.hadoop.conf.Configuration conf

fs

private static org.apache.hadoop.fs.FileSystem fs

hbaseDir

private static org.apache.hadoop.fs.Path hbaseDir

tableName

static final org.apache.hadoop.hbase.TableName tableName

info

static final org.apache.hadoop.hbase.client.RegionInfo info

family

private static final byte[] family

logDir

private static org.apache.hadoop.fs.Path logDir

mvcc

protected org.apache.hadoop.hbase.regionserver.MultiVersionConcurrencyControl mvcc

scopes

protected static NavigableMap<byte[],Integer> scopes

Constructor Details

TestBulkLoadCollectorJobIntegration

public TestBulkLoadCollectorJobIntegration()

Method Details

getName

private static String getName()

setUp

@BeforeEach
public void setUp()
           throws Exception

Throws:

Exception

setUpBeforeClass

@BeforeAll
public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

tearDownAfterClass

@AfterAll
public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

testBulkLoadCollectorEmitsStoreFilesFromWAL

@Test
public void testBulkLoadCollectorEmitsStoreFilesFromWAL()
                                                 throws Exception

Test that BulkLoadCollectorJob discovers and emits store-file paths from WAL files created using WALFactory (no RegionServer needed).

Throws:

Exception

createBulkLoadWalEntry

private org.apache.hadoop.hbase.wal.WAL.Entry createBulkLoadWalEntry(String regionName,
 String family,
 String... storeFiles)

getWalKeyImpl

protected org.apache.hadoop.hbase.wal.WALKeyImpl getWalKeyImpl(long time,
 NavigableMap<byte[],Integer> scopes)