| Package | Description | 
|---|---|
| org.apache.hadoop.hbase.test | |
| org.apache.hadoop.hbase.test.util.warc | 
| Modifier and Type | Method and Description | 
|---|---|
protected void | 
IntegrationTestLoadCommonCrawl.Loader.LoaderMapper.map(org.apache.hadoop.io.LongWritable key,
   WARCWritable value,
   org.apache.hadoop.mapreduce.Mapper.Context output)  | 
| Modifier and Type | Field and Description | 
|---|---|
private WARCWritable | 
WARCInputFormat.WARCReader.value  | 
| Modifier and Type | Method and Description | 
|---|---|
WARCWritable | 
WARCInputFormat.WARCReader.getCurrentValue()  | 
| Modifier and Type | Method and Description | 
|---|---|
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,WARCWritable> | 
WARCInputFormat.createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                  org.apache.hadoop.mapreduce.TaskAttemptContext context)
Opens a WARC file (possibly compressed) for reading, and returns a RecordReader for accessing
 it. 
 | 
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,WARCWritable> | 
WARCOutputFormat.getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
Creates a new output file in WARC format, and returns a RecordWriter for writing to it. 
 | 
| Modifier and Type | Method and Description | 
|---|---|
void | 
WARCOutputFormat.WARCWriter.write(org.apache.hadoop.io.NullWritable key,
     WARCWritable value)  | 
void | 
WARCFileWriter.write(WARCWritable record)
Appends a  
WARCRecord wrapped in a WARCWritable to the file. | 
Copyright © 2007–2020 The Apache Software Foundation. All rights reserved.