Field Detail

• streamWrapper

  protected FSDataInputStreamWrapper streamWrapper

  The file system stream of the underlying HFile that does or doesn't do checksum validations in the filesystem

• encodedBlockDecodingCtx

  private HFileBlockDecodingContext encodedBlockDecodingCtx

• defaultDecodingCtx

  private final HFileBlockDefaultDecodingContext defaultDecodingCtx

  Default context used when BlockType != BlockType.ENCODED_DATA.

• prefetchedHeaderForThread

  private ThreadLocal<HFileBlock.PrefetchedHeader> prefetchedHeaderForThread

Constructor Detail

• HFileBlock.FSReaderImpl

  public HFileBlock.FSReaderImpl(FSDataInputStreamWrapper stream,
                         long fileSize,
                         HFileSystem hfs,
                         org.apache.hadoop.fs.Path path,
                         HFileContext fileContext)
                          throws IOException

  Throws:

  IOException

• HFileBlock.FSReaderImpl

  HFileBlock.FSReaderImpl(org.apache.hadoop.fs.FSDataInputStream istream,
                         long fileSize,
                         HFileContext fileContext)
                    throws IOException

  A constructor that reads files with the latest minor version. This is used by unit tests only.

  Throws:

  IOException

Method Detail

• readBlockData

  public HFileBlock readBlockData(long offset,
                         long onDiskSizeWithHeaderL,
                         int uncompressedSize,
                         boolean pread)
                           throws IOException

  Reads a version 2 block (version 1 blocks not supported and not expected). Tries to do as little memory allocation as possible, using the provided on-disk size.

  Parameters:

  offset - the offset in the stream to read at

  onDiskSizeWithHeaderL - the on-disk size of the block, including the header, or -1 if unknown

  uncompressedSize - the uncompressed size of the the block. Always expected to be -1. This parameter is only used in version 1.

  pread - whether to use a positional read

  Returns:

  the newly read block

  Throws:

  IOException

• readBlockDataInternal

  protected HFileBlock readBlockDataInternal(org.apache.hadoop.fs.FSDataInputStream is,
                                 long offset,
                                 int onDiskSizeWithHeader,
                                 int uncompressedSize,
                                 boolean pread,
                                 boolean verifyChecksum)
                                      throws IOException

  Reads a version 2 block.

  Parameters:

  offset - the offset in the stream to read at

  onDiskSizeWithHeader - the on-disk size of the block, including the header, or -1 if unknown

  uncompressedSize - the uncompressed size of the the block. Always expected to be -1. This parameter is only used in version 1.

  pread - whether to use a positional read

  verifyChecksum - Whether to use HBase checksums. If HBase checksum is switched off, then use HDFS checksum.

  Returns:

  the HFileBlock or null if there is a HBase checksum mismatch

  Throws:

  IOException

• setIncludesMemstoreTS

  void setIncludesMemstoreTS(boolean includesMemstoreTS)

• setDataBlockEncoder

  void setDataBlockEncoder(HFileDataBlockEncoder encoder)

• getBlockDecodingContext

  public HFileBlockDecodingContext getBlockDecodingContext()

  Description copied from interface: HFileBlock.FSReader
  Get a decoder for BlockType.ENCODED_DATA blocks from this file.

• getDefaultBlockDecodingContext

  public HFileBlockDecodingContext getDefaultBlockDecodingContext()

  Description copied from interface: HFileBlock.FSReader
  Get the default decoder for blocks from this file.

• validateChecksum

  protected boolean validateChecksum(long offset,
                         ByteBuffer data,
                         int hdrSize)
                              throws IOException

  Generates the checksum for the header as well as the data and then validates it. If the block doesn't uses checksum, returns false.

  Returns:

  True if checksum matches, else false.

  Throws:

  IOException

• closeStreams

  public void closeStreams()
                    throws IOException

  Description copied from interface: HFileBlock.FSReader
  Closes the backing streams

  Throws:

  IOException

• unbufferStream

  public void unbufferStream()

  Description copied from interface: HFileBlock.FSReader
  To close the stream's socket. Note: This can be concurrently called from multiple threads and implementation should take care of thread safety.

• toString

  public String toString()

  Overrides:

  toString in class Object