Package org.apache.hadoop.hbase.mapreduce

Class IntegrationTestImportTsv

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.mapreduce.IntegrationTestImportTsv

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class IntegrationTestImportTsv
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

Validate ImportTsv + BulkLoadFiles on a distributed cluster.

Field Summary

Fields

Modifier and Type	Field	Description
private static final String	GENERATED_HFILE_FOLDER_PARAM_KEY
private static final org.slf4j.Logger	LOG
org.junit.rules.TestName	name
private static final String	NAME
protected static final Set<org.apache.hadoop.hbase.KeyValue>	simple_expected
protected static final String	simple_tsv
protected static IntegrationTestingUtility	util

Constructor Summary

Constructors

Constructor	Description
IntegrationTestImportTsv()

Method Summary

Modifier and Type	Method	Description
protected void	doLoadIncrementalHFiles(org.apache.hadoop.fs.Path hfiles, org.apache.hadoop.hbase.TableName tableName)	Verify the data described by simple_tsv matches simple_expected.
(package private) void	generateAndLoad(org.apache.hadoop.hbase.TableName table)
org.apache.hadoop.conf.Configuration	getConf()
private org.apache.hadoop.fs.Path	initGeneratedHFilePath(org.apache.hadoop.hbase.TableName table)
static void	main(String[] args)
static void	provisionCluster()
static void	releaseCluster()
int	run(String[] args)
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	testGenerateAndLoad()
protected static void	validateDeletedPartitionsFile(org.apache.hadoop.conf.Configuration conf)	Confirm the absence of the TotalOrderPartitioner partitions file.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

NAME

private static final String NAME

LOG

private static final org.slf4j.Logger LOG

GENERATED_HFILE_FOLDER_PARAM_KEY

private static final String GENERATED_HFILE_FOLDER_PARAM_KEY

See Also:

• Constant Field Values

simple_tsv

protected static final String simple_tsv

See Also:

• Constant Field Values

name

public org.junit.rules.TestName name

simple_expected

protected static final Set<org.apache.hadoop.hbase.KeyValue> simple_expected

util

protected static IntegrationTestingUtility util

Constructor Details

IntegrationTestImportTsv

public IntegrationTestImportTsv()

Method Details

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Overrides:

getConf in class org.apache.hadoop.conf.Configured

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

provisionCluster

public static void provisionCluster()
                             throws Exception

Throws:

Exception

releaseCluster

public static void releaseCluster()
                           throws Exception

Throws:

Exception

doLoadIncrementalHFiles

protected void doLoadIncrementalHFiles(org.apache.hadoop.fs.Path hfiles,
 org.apache.hadoop.hbase.TableName tableName)
                                throws Exception

Verify the data described by simple_tsv matches simple_expected.

Throws:

Exception

validateDeletedPartitionsFile

protected static void validateDeletedPartitionsFile(org.apache.hadoop.conf.Configuration conf)
                                             throws IOException

Confirm the absence of the TotalOrderPartitioner partitions file.

Throws:

IOException

testGenerateAndLoad

public void testGenerateAndLoad()
                         throws Exception

Throws:

Exception

generateAndLoad

void generateAndLoad(org.apache.hadoop.hbase.TableName table)
              throws Exception

Throws:

Exception

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

initGeneratedHFilePath

private org.apache.hadoop.fs.Path initGeneratedHFilePath(org.apache.hadoop.hbase.TableName table)
                                                  throws IOException

Throws:

IOException

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception