Field Detail

• LOG

  private static final org.apache.commons.logging.Log LOG

  Deprecated. 

• DATABLOCK_ENCODING_OVERRIDE_CONF_KEY

  public static final String DATABLOCK_ENCODING_OVERRIDE_CONF_KEY

  Deprecated. 

  See Also:

  Constant Field Values

Constructor Detail

• HFileOutputFormat

  public HFileOutputFormat()

  Deprecated. 

Method Detail

• getRecordWriter

  public org.apache.hadoop.mapreduce.RecordWriter<ImmutableBytesWritable,KeyValue> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                            throws IOException,
                                                                                                   InterruptedException

  Deprecated. 

  Specified by:

  getRecordWriter in class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<ImmutableBytesWritable,KeyValue>

  Throws:

  IOException

  InterruptedException

• configureIncrementalLoad

  public static void configureIncrementalLoad(org.apache.hadoop.mapreduce.Job job,
                              HTable table)
                                       throws IOException

  Deprecated. 
  Configure a MapReduce Job to perform an incremental load into the given table. This

  • Inspects the table to configure a total order partitioner
  • Uploads the partitions file to the cluster and adds it to the DistributedCache
  • Sets the number of reduce tasks to match the current number of regions
  • Sets the output key/value class to match HFileOutputFormat's requirements
  • Sets the reducer up to perform the appropriate sorting (either KeyValueSortReducer or PutSortReducer)

  The user should be sure to set the map output value class to either KeyValue or Put before running this function.

  Throws:

  IOException

• createFamilyCompressionMap

  static Map<byte[],Compression.Algorithm> createFamilyCompressionMap(org.apache.hadoop.conf.Configuration conf)

  Deprecated. 
  Runs inside the task to deserialize column family to compression algorithm map from the configuration.

  Parameters:

  conf - to read the serialized values from

  Returns:

  a map from column family to the configured compression algorithm

• createFamilyBloomTypeMap

  static Map<byte[],BloomType> createFamilyBloomTypeMap(org.apache.hadoop.conf.Configuration conf)

  Deprecated. 
  Runs inside the task to deserialize column family to bloom filter type map from the configuration.

  Parameters:

  conf - to read the serialized values from

  Returns:

  a map from column family to the the configured bloom filter type

• createFamilyBlockSizeMap

  static Map<byte[],Integer> createFamilyBlockSizeMap(org.apache.hadoop.conf.Configuration conf)

  Deprecated. 
  Runs inside the task to deserialize column family to block size map from the configuration.

  Parameters:

  conf - to read the serialized values from

  Returns:

  a map from column family to the configured block size

• createFamilyDataBlockEncodingMap

  static Map<byte[],DataBlockEncoding> createFamilyDataBlockEncodingMap(org.apache.hadoop.conf.Configuration conf)

  Deprecated. 
  Runs inside the task to deserialize column family to data block encoding type map from the configuration.

  Parameters:

  conf - to read the serialized values from

  Returns:

  a map from column family to HFileDataBlockEncoder for the configured data block type for the family

• configurePartitioner

  static void configurePartitioner(org.apache.hadoop.mapreduce.Job job,
                          List<ImmutableBytesWritable> splitPoints)
                            throws IOException

  Deprecated. 
  Configure job with a TotalOrderPartitioner, partitioning against splitPoints. Cleans up the partitions file after job exists.

  Throws:

  IOException

• configureCompression

  static void configureCompression(Table table,
                          org.apache.hadoop.conf.Configuration conf)
                            throws IOException

  Deprecated. 

  Throws:

  IOException

• configureBlockSize

  static void configureBlockSize(Table table,
                        org.apache.hadoop.conf.Configuration conf)
                          throws IOException

  Deprecated. 
  Serialize column family to block size map to configuration. Invoked while configuring the MR job for incremental load.

  Parameters:

  table - to read the properties from

  conf - to persist serialized values into

  Throws:

  IOException - on failure to read column family descriptors

• configureBloomType

  static void configureBloomType(Table table,
                        org.apache.hadoop.conf.Configuration conf)
                          throws IOException

  Deprecated. 
  Serialize column family to bloom type map to configuration. Invoked while configuring the MR job for incremental load.

  Parameters:

  table - to read the properties from

  conf - to persist serialized values into

  Throws:

  IOException - on failure to read column family descriptors

• configureDataBlockEncoding

  static void configureDataBlockEncoding(Table table,
                                org.apache.hadoop.conf.Configuration conf)
                                  throws IOException

  Deprecated. 
  Serialize column family to data block encoding map to configuration. Invoked while configuring the MR job for incremental load.

  Parameters:

  table - to read the properties from

  conf - to persist serialized values into

  Throws:

  IOException - on failure to read column family descriptors