Package org.apache.hadoop.hbase.tool

Interface BulkLoadHFiles

All Known Implementing Classes:

BulkLoadHFilesTool

@Public
public interface BulkLoadHFiles

The tool to let you load the output of HFileOutputFormat into an existing table programmatically. Not thread safe.

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static class	BulkLoadHFiles.LoadQueueItem	Represents an HFile waiting to be loaded.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	ALWAYS_COPY_FILES
static final String	ASSIGN_SEQ_IDS
static final String	CREATE_TABLE_CONF_KEY
static final String	IGNORE_UNMATCHED_CF_CONF_KEY
static final String	MAX_FILES_PER_REGION_PER_FAMILY
static final String	RETRY_ON_IO_EXCEPTION

Method Summary

Modifier and Type	Method	Description
Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer>	bulkLoad(TableName tableName, Map<byte[],List<org.apache.hadoop.fs.Path>> family2Files)	Perform a bulk load of the given directory into the given pre-existing table.
Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer>	bulkLoad(TableName tableName, org.apache.hadoop.fs.Path dir)	Perform a bulk load of the given directory into the given pre-existing table.
static BulkLoadHFiles	create(org.apache.hadoop.conf.Configuration conf)
void	disableReplication()	Disables replication for all bulkloads done via this instance, when bulkload replication is configured.
boolean	isReplicationDisabled()	Returns true if replication has been disabled.

Field Details

RETRY_ON_IO_EXCEPTION

static final String RETRY_ON_IO_EXCEPTION

See Also:

• Constant Field Values

MAX_FILES_PER_REGION_PER_FAMILY

static final String MAX_FILES_PER_REGION_PER_FAMILY

See Also:

• Constant Field Values

ASSIGN_SEQ_IDS

static final String ASSIGN_SEQ_IDS

See Also:

• Constant Field Values

CREATE_TABLE_CONF_KEY

static final String CREATE_TABLE_CONF_KEY

See Also:

• Constant Field Values

IGNORE_UNMATCHED_CF_CONF_KEY

static final String IGNORE_UNMATCHED_CF_CONF_KEY

See Also:

• Constant Field Values

ALWAYS_COPY_FILES

static final String ALWAYS_COPY_FILES

See Also:

• Constant Field Values

Method Details

bulkLoad

Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer> bulkLoad(TableName tableName,
 Map<byte[],List<org.apache.hadoop.fs.Path>> family2Files)
                                               throws TableNotFoundException,
IOException

Perform a bulk load of the given directory into the given pre-existing table.

Parameters:

tableName - the table to load into

family2Files - map of family to List of hfiles

Throws:

TableNotFoundException - if table does not yet exist

IOException

disableReplication

void disableReplication()

Disables replication for all bulkloads done via this instance, when bulkload replication is configured.

isReplicationDisabled

boolean isReplicationDisabled()

Returns true if replication has been disabled.

bulkLoad

Map<BulkLoadHFiles.LoadQueueItem,ByteBuffer> bulkLoad(TableName tableName,
 org.apache.hadoop.fs.Path dir)
                                               throws TableNotFoundException,
IOException

Perform a bulk load of the given directory into the given pre-existing table.

Parameters:

tableName - the table to load into

dir - the directory that was provided as the output path of a job using HFileOutputFormat

Throws:

TableNotFoundException - if table does not yet exist

IOException

create

static BulkLoadHFiles create(org.apache.hadoop.conf.Configuration conf)