org.apache.hadoop.hbase.tool

Interface BulkLoadHFiles

All Known Implementing Classes:

BulkLoadHFilesTool

@InterfaceAudience.Public
public interface BulkLoadHFiles

The tool to let you load the output of HFileOutputFormat into an existing table programmatically. Not thread safe.

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	BulkLoadHFiles.LoadQueueItem Represents an HFile waiting to be loaded.

Field Summary

Fields

Modifier and Type	Field and Description
static String	ALWAYS_COPY_FILES
static String	ASSIGN_SEQ_IDS
static String	BULK_LOAD_HFILES_BY_FAMILY HBASE-24221 Support bulkLoadHFile by family to avoid long time waiting of bulkLoadHFile because of compacting at server side
static String	CREATE_TABLE_CONF_KEY
static String	IGNORE_UNMATCHED_CF_CONF_KEY
static String	MAX_FILES_PER_REGION_PER_FAMILY
static String	RETRY_ON_IO_EXCEPTION

Method Summary

Modifier and Type	Method and Description
Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer>	bulkLoad(TableName tableName, Map<byte[],List<org.apache.hadoop.fs.Path>> family2Files) Perform a bulk load of the given directory into the given pre-existing table.
Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer>	bulkLoad(TableName tableName, org.apache.hadoop.fs.Path dir) Perform a bulk load of the given directory into the given pre-existing table.
static BulkLoadHFiles	create(org.apache.hadoop.conf.Configuration conf)

Field Detail

RETRY_ON_IO_EXCEPTION

static final String RETRY_ON_IO_EXCEPTION

See Also:

Constant Field Values

MAX_FILES_PER_REGION_PER_FAMILY

static final String MAX_FILES_PER_REGION_PER_FAMILY

See Also:

Constant Field Values

ASSIGN_SEQ_IDS

static final String ASSIGN_SEQ_IDS

See Also:

Constant Field Values

CREATE_TABLE_CONF_KEY

static final String CREATE_TABLE_CONF_KEY

See Also:

Constant Field Values

IGNORE_UNMATCHED_CF_CONF_KEY

static final String IGNORE_UNMATCHED_CF_CONF_KEY

See Also:

Constant Field Values

ALWAYS_COPY_FILES

static final String ALWAYS_COPY_FILES

See Also:

Constant Field Values

BULK_LOAD_HFILES_BY_FAMILY

static final String BULK_LOAD_HFILES_BY_FAMILY

HBASE-24221 Support bulkLoadHFile by family to avoid long time waiting of bulkLoadHFile because of compacting at server side

See Also:

Constant Field Values

Method Detail

bulkLoad

Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer> bulkLoad(TableName tableName,
                                                      Map<byte[],List<org.apache.hadoop.fs.Path>> family2Files)
                                               throws TableNotFoundException,
                                                      IOException

Perform a bulk load of the given directory into the given pre-existing table.

Parameters:

tableName - the table to load into

family2Files - map of family to List of hfiles

Throws:

TableNotFoundException - if table does not yet exist

IOException

bulkLoad

Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer> bulkLoad(TableName tableName,
                                                      org.apache.hadoop.fs.Path dir)
                                               throws TableNotFoundException,
                                                      IOException

Perform a bulk load of the given directory into the given pre-existing table.

Parameters:

tableName - the table to load into

dir - the directory that was provided as the output path of a job using HFileOutputFormat

Throws:

TableNotFoundException - if table does not yet exist

IOException

create

static BulkLoadHFiles create(org.apache.hadoop.conf.Configuration conf)