Package org.apache.hadoop.hbase.backup.util

Class BulkLoadProcessor

java.lang.Object

org.apache.hadoop.hbase.backup.util.BulkLoadProcessor

@Private
public final class BulkLoadProcessor
extends Object

Processes bulk load files from Write-Ahead Log (WAL) entries.

Used by backup/restore and replication flows to discover HFiles referenced by bulk-load WALEdits. Returned Paths are constructed from the namespace/table/region/family/file components.

Constructor Summary

Constructors

Modifier	Constructor	Description
private	BulkLoadProcessor()

Method Summary

Modifier and Type	Method	Description
private static List<org.apache.hadoop.fs.Path>	processBulkLoadDescriptor(Cell cell, String namespace, String table)
static List<org.apache.hadoop.fs.Path>	processBulkLoadFiles(List<WAL.Entry> walEntries)	Extract bulk-load file Paths from a list of WAL.Entry.
static List<org.apache.hadoop.fs.Path>	processBulkLoadFiles(WALKey key, WALEdit edit)	Extract bulk-load file Paths from a single WAL entry.
private static List<org.apache.hadoop.fs.Path>	processStoreDescriptor(org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.StoreDescriptor storeDescriptor, String namespace, String table, String regionName)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

BulkLoadProcessor

private BulkLoadProcessor()

Method Details

processBulkLoadFiles

public static List<org.apache.hadoop.fs.Path> processBulkLoadFiles(List<WAL.Entry> walEntries)
                                                            throws IOException

Extract bulk-load file Paths from a list of WAL.Entry.

Parameters:

walEntries - list of WAL entries.

Returns:

list of Paths in discovery order; empty list if none

Throws:

IOException - if descriptor parsing fails

processBulkLoadFiles

public static List<org.apache.hadoop.fs.Path> processBulkLoadFiles(WALKey key,
 WALEdit edit)
                                                            throws IOException

Extract bulk-load file Paths from a single WAL entry.

Parameters:

key - WALKey containing table information; if null returns empty list

edit - WALEdit to scan; if null returns empty list

Returns:

list of Paths referenced by bulk-load descriptor(s) in this edit; may be empty or contain duplicates

Throws:

IOException - if descriptor parsing fails

processBulkLoadDescriptor

private static List<org.apache.hadoop.fs.Path> processBulkLoadDescriptor(Cell cell,
 String namespace,
 String table)
                                                                  throws IOException

Throws:

IOException

processStoreDescriptor

private static List<org.apache.hadoop.fs.Path> processStoreDescriptor(org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.StoreDescriptor storeDescriptor,
 String namespace,
 String table,
 String regionName)