Package | Description |
---|---|
org.apache.hadoop.hbase.test | |
org.apache.hadoop.hbase.test.util.warc |
Modifier and Type | Method and Description |
---|---|
protected void |
IntegrationTestLoadCommonCrawl.Loader.LoaderMapper.map(org.apache.hadoop.io.LongWritable key,
WARCWritable value,
org.apache.hadoop.mapreduce.Mapper.Context output) |
Modifier and Type | Field and Description |
---|---|
private WARCWritable |
WARCInputFormat.WARCReader.value |
Modifier and Type | Method and Description |
---|---|
WARCWritable |
WARCInputFormat.WARCReader.getCurrentValue() |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WARCWritable> |
WARCInputFormat.createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context)
Opens a WARC file (possibly compressed) for reading, and returns a RecordReader for accessing
it.
|
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,WARCWritable> |
WARCOutputFormat.getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Creates a new output file in WARC format, and returns a RecordWriter for writing to it.
|
Modifier and Type | Method and Description |
---|---|
void |
WARCOutputFormat.WARCWriter.write(org.apache.hadoop.io.NullWritable key,
WARCWritable value) |
void |
WARCFileWriter.write(WARCWritable record)
Appends a
WARCRecord wrapped in a WARCWritable to the file. |
Copyright © 2007–2020 The Apache Software Foundation. All rights reserved.