Package org.apache.hadoop.hbase.regionserver

Class TestSecureBulkLoadManager

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestSecureBulkLoadManager

@Tag("org.apache.hadoop.hbase.testclassification.RegionServerTests") @Tag("org.apache.hadoop.hbase.testclassification.MediumTests")
public class TestSecureBulkLoadManager
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
(package private) class	TestSecureBulkLoadManager.MyExceptionToAvoidRetry	A trick is used to make sure server-side failures( if any ) not being covered up by a client retry.

Field Summary

Fields

Modifier and Type	Field	Description
private static byte[]	COLUMN
private static org.apache.hadoop.conf.Configuration	conf
private Thread	ealierBulkload
private static byte[]	FAMILY
private static byte[]	key1
private static byte[]	key2
private static byte[]	key3
private Thread	laterBulkload
private static final org.slf4j.Logger	LOG
private static byte[]	SPLIT_ROWKEY
private static org.apache.hadoop.hbase.TableName	TABLE
protected static final HBaseTestingUtil	testUtil
protected Boolean	useFileBasedSFT
private static byte[]	value1
private static byte[]	value3

Constructor Summary

Constructors

Constructor	Description
TestSecureBulkLoadManager(Boolean useFileBasedSFT)

Method Summary

Modifier and Type	Method	Description
private void	doBulkloadWithoutRetry(org.apache.hadoop.fs.Path dir)
static Stream<org.junit.jupiter.params.provider.Arguments>	parameters()
private void	prepareHFile(org.apache.hadoop.fs.Path dir, byte[] key, byte[] value)
void	setUp()
void	tearDown()
void	testForRaceCondition()	After a secure bulkload finished , there is a clean-up for FileSystems used in the bulkload.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

TABLE

private static org.apache.hadoop.hbase.TableName TABLE

FAMILY

private static byte[] FAMILY

COLUMN

private static byte[] COLUMN

key1

private static byte[] key1

key2

private static byte[] key2

key3

private static byte[] key3

value1

private static byte[] value1

value3

private static byte[] value3

SPLIT_ROWKEY

private static byte[] SPLIT_ROWKEY

ealierBulkload

private Thread ealierBulkload

laterBulkload

private Thread laterBulkload

useFileBasedSFT

protected Boolean useFileBasedSFT

testUtil

protected static final HBaseTestingUtil testUtil

conf

private static org.apache.hadoop.conf.Configuration conf

Constructor Details

TestSecureBulkLoadManager

public TestSecureBulkLoadManager(Boolean useFileBasedSFT)

Method Details

parameters

public static Stream<org.junit.jupiter.params.provider.Arguments> parameters()

setUp

@BeforeEach
public void setUp()
           throws Exception

Throws:

Exception

tearDown

@AfterEach
public void tearDown()
              throws Exception

Throws:

Exception

testForRaceCondition

@TestTemplate
public void testForRaceCondition()
                          throws Exception

After a secure bulkload finished , there is a clean-up for FileSystems used in the bulkload. Sometimes, FileSystems used in the finished bulkload might also be used in other bulkload calls, or there are other FileSystems created by the same user, they could be closed by a FileSystem.closeAllForUGI call. So during the clean-up, those FileSystems need to be used later can not get closed ,or else a race condition occurs. testForRaceCondition tests the case that two secure bulkload calls from the same UGI go into two different regions and one bulkload finishes earlier when the other bulkload still needs its FileSystems, checks that both bulkloads succeed.

Throws:

Exception

doBulkloadWithoutRetry

private void doBulkloadWithoutRetry(org.apache.hadoop.fs.Path dir)
                             throws Exception

Throws:

Exception

prepareHFile

private void prepareHFile(org.apache.hadoop.fs.Path dir,
 byte[] key,
 byte[] value)
                   throws Exception

Throws:

Exception