Class BulkLoadCollectorJob.BulkLoadCollectorMapper
- Enclosing class:
- BulkLoadCollectorJob
public static class BulkLoadCollectorJob.BulkLoadCollectorMapper
extends org.apache.hadoop.mapreduce.Mapper<WALKey,WALEdit,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable>
Mapper that extracts relative bulk-load paths from a WAL entry (via
BulkLoadProcessor),
resolves them to full paths (via
BackupFileSystemManager#resolveBulkLoadFullPath(Path, Path)), and emits each full path
as the map key (Text). Uses the same table-filtering semantics as other WAL mappers: if no
tables are configured, all tables are processed; otherwise only the configured table set is
processed. Map output: (Text fullPathString, NullWritable)-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper
org.apache.hadoop.mapreduce.Mapper.Context -
Field Summary
Fields -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionprotected voidmap(WALKey key, WALEdit value, org.apache.hadoop.mapreduce.Mapper<WALKey, WALEdit, org.apache.hadoop.io.Text, org.apache.hadoop.io.NullWritable>.org.apache.hadoop.mapreduce.Mapper.Context context) private Stringprotected voidsetup(org.apache.hadoop.mapreduce.Mapper<WALKey, WALEdit, org.apache.hadoop.io.Text, org.apache.hadoop.io.NullWritable>.org.apache.hadoop.mapreduce.Mapper.Context context) Methods inherited from class org.apache.hadoop.mapreduce.Mapper
cleanup, run
-
Field Details
-
tables
-
out
-
-
Constructor Details
-
BulkLoadCollectorMapper
public BulkLoadCollectorMapper()
-
-
Method Details
-
map
protected void map(WALKey key, WALEdit value, org.apache.hadoop.mapreduce.Mapper<WALKey, WALEdit, throws IOException, InterruptedExceptionorg.apache.hadoop.io.Text, org.apache.hadoop.io.NullWritable>.org.apache.hadoop.mapreduce.Mapper.Context context) - Overrides:
mapin classorg.apache.hadoop.mapreduce.Mapper<WALKey,WALEdit, org.apache.hadoop.io.Text, org.apache.hadoop.io.NullWritable> - Throws:
IOExceptionInterruptedException
-
setup
protected void setup(org.apache.hadoop.mapreduce.Mapper<WALKey, WALEdit, throws IOExceptionorg.apache.hadoop.io.Text, org.apache.hadoop.io.NullWritable>.org.apache.hadoop.mapreduce.Mapper.Context context) - Overrides:
setupin classorg.apache.hadoop.mapreduce.Mapper<WALKey,WALEdit, org.apache.hadoop.io.Text, org.apache.hadoop.io.NullWritable> - Throws:
IOException
-
safeTable
-