FastDiffDeltaEncoder (Apache HBase 1.2.12 API)

java.lang.Object
- org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder
- - org.apache.hadoop.hbase.io.encoding.FastDiffDeltaEncoder

All Implemented Interfaces:

DataBlockEncoder
```
@InterfaceAudience.Private
public class FastDiffDeltaEncoder
extends BufferedDataBlockEncoder
```
Encoder similar to DiffKeyDeltaEncoder but supposedly faster. Compress using: - store size of common prefix - save column family once in the first KeyValue - use integer compression for key, value and prefix (7-bit encoding) - use bits to avoid duplication key length, value length and type if it same as previous - store in 3 bits length of prefix timestamp with previous KeyValue's timestamp - one bit which allow to omit value if it is the same Format: - 1 byte: flag - 1-5 bytes: key length (only if FLAG_SAME_KEY_LENGTH is not set in flag) - 1-5 bytes: value length (only if FLAG_SAME_VALUE_LENGTH is not set in flag) - 1-5 bytes: prefix length - ... bytes: rest of the row (if prefix length is small enough) - ... bytes: qualifier (or suffix depending on prefix length) - 1-8 bytes: timestamp suffix - 1 byte: type (only if FLAG_SAME_TYPE is not set in the flag) - ... bytes: value (only if FLAG_SAME_VALUE is not set in the flag)

Nested Class Summary

Nested Classes
Modifier and Type	Class and Description
`private static class`	`FastDiffDeltaEncoder.FastDiffCompressionState`
`protected static class`	`FastDiffDeltaEncoder.FastDiffSeekerState`

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder
BufferedDataBlockEncoder.BufferedEncodedSeeker<STATE extends BufferedDataBlockEncoder.SeekerState>, BufferedDataBlockEncoder.ClonedSeekerState, BufferedDataBlockEncoder.SeekerState

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.io.encoding.DataBlockEncoder
DataBlockEncoder.EncodedSeeker

Field Summary

Fields
Modifier and Type	Field and Description
`(package private) int`	`FLAG_SAME_KEY_LENGTH`
`(package private) int`	`FLAG_SAME_TYPE`
`(package private) int`	`FLAG_SAME_VALUE`
`(package private) int`	`FLAG_SAME_VALUE_LENGTH`
`(package private) int`	`MASK_TIMESTAMP_LENGTH`
`(package private) int`	`SHIFT_TIMESTAMP_LENGTH`

Constructor Summary

Constructors
Constructor and Description

FastDiffDeltaEncoder()

Constructors
Constructor and Description
`FastDiffDeltaEncoder()`

Method Summary

Methods
Modifier and Type	Method and Description
`private int`	`compressSingleKeyValue(DataOutputStream out, Cell cell, Cell prevCell)`
`DataBlockEncoder.EncodedSeeker`	`createSeeker(KeyValue.KVComparator comparator, HFileBlockDecodingContext decodingCtx)` Create a HFileBlock seeker which find KeyValues within a block.
`private int`	`findCommonTimestampPrefix(byte[] curTsBuf, byte[] prevTsBuf)`
`ByteBuffer`	`getFirstKeyInBlock(ByteBuffer block)` Return first key in block.
`protected ByteBuffer`	`internalDecodeKeyValues(DataInputStream source, int allocateHeaderLength, int skipLastBytes, HFileBlockDefaultDecodingContext decodingCtx)`
`int`	`internalEncode(Cell cell, HFileBlockDefaultEncodingContext encodingContext, DataOutputStream out)`
`String`	`toString()`
`private void`	`uncompressSingleKeyValue(DataInputStream source, ByteBuffer out, FastDiffDeltaEncoder.FastDiffCompressionState state)`

Methods inherited from class org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder
afterDecodingKeyValue, afterEncodingKeyValue, decodeKeyValues, encode, endBlockEncoding, ensureSpace, newDataBlockDecodingContext, newDataBlockEncodingContext, startBlockEncoding

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail
- MASK_TIMESTAMP_LENGTH
```
final int MASK_TIMESTAMP_LENGTH
```
  See Also:
  Constant Field Values
- SHIFT_TIMESTAMP_LENGTH
```
final int SHIFT_TIMESTAMP_LENGTH
```
  See Also:
  Constant Field Values
- FLAG_SAME_KEY_LENGTH
```
final int FLAG_SAME_KEY_LENGTH
```
  See Also:
  Constant Field Values
- FLAG_SAME_VALUE_LENGTH
```
final int FLAG_SAME_VALUE_LENGTH
```
  See Also:
  Constant Field Values
- FLAG_SAME_TYPE
```
final int FLAG_SAME_TYPE
```
  See Also:
  Constant Field Values
- FLAG_SAME_VALUE
```
final int FLAG_SAME_VALUE
```
  See Also:
  Constant Field Values

Constructor Detail
- FastDiffDeltaEncoder
```
public FastDiffDeltaEncoder()
```

Method Detail

findCommonTimestampPrefix

private int findCommonTimestampPrefix(byte[] curTsBuf,
                            byte[] prevTsBuf)

uncompressSingleKeyValue

private void uncompressSingleKeyValue(DataInputStream source,
                            ByteBuffer out,
                            FastDiffDeltaEncoder.FastDiffCompressionState state)
                               throws IOException,
                                      EncoderBufferTooSmallException

Throws:: IOException; EncoderBufferTooSmallException

internalEncode

public int internalEncode(Cell cell,
                 HFileBlockDefaultEncodingContext encodingContext,
                 DataOutputStream out)
                   throws IOException

Specified by:: internalEncode in class BufferedDataBlockEncoder
Throws:: IOException

compressSingleKeyValue

private int compressSingleKeyValue(DataOutputStream out,
                         Cell cell,
                         Cell prevCell)
                            throws IOException

Throws:: IOException

internalDecodeKeyValues

protected ByteBuffer internalDecodeKeyValues(DataInputStream source,
                                 int allocateHeaderLength,
                                 int skipLastBytes,
                                 HFileBlockDefaultDecodingContext decodingCtx)
                                      throws IOException

Specified by:: internalDecodeKeyValues in class BufferedDataBlockEncoder
Throws:: IOException

getFirstKeyInBlock
```
public ByteBuffer getFirstKeyInBlock(ByteBuffer block)
```
Description copied from interface: DataBlockEncoder

Return first key in block. Useful for indexing. Typically does not make a deep copy but returns a buffer wrapping a segment of the actual block's byte array. This is because the first key in block is usually stored unencoded.

Parameters:
block - encoded block we want index, the position will not change

Returns:
First key in block.

toString
```
public String toString()
```
Overrides:

toString in class Object

createSeeker

public DataBlockEncoder.EncodedSeeker createSeeker(KeyValue.KVComparator comparator,
                                          HFileBlockDecodingContext decodingCtx)

Description copied from interface: DataBlockEncoder

Create a HFileBlock seeker which find KeyValues within a block.

Parameters:: comparator - what kind of comparison should be used
Returns:: A newly created seeker.

Class FastDiffDeltaEncoder

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.io.encoding.DataBlockEncoder

Field Summary

Constructor Summary

Method Summary

Methods inherited from class org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder

Methods inherited from class java.lang.Object

Field Detail

MASK_TIMESTAMP_LENGTH

SHIFT_TIMESTAMP_LENGTH

FLAG_SAME_KEY_LENGTH

FLAG_SAME_VALUE_LENGTH

FLAG_SAME_TYPE

FLAG_SAME_VALUE

Constructor Detail

FastDiffDeltaEncoder

Method Detail

findCommonTimestampPrefix

uncompressSingleKeyValue

internalEncode

compressSingleKeyValue

internalDecodeKeyValues

getFirstKeyInBlock

toString

createSeeker