org.apache.hadoop.hbase.ipc

Class CellBlockBuilder

java.lang.Object

org.apache.hadoop.hbase.ipc.CellBlockBuilder

@InterfaceAudience.Private
class CellBlockBuilder
extends Object

Helper class for building cell block.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	CellBlockBuilder.ByteBufferOutputStreamSupplier
private static class	CellBlockBuilder.ByteBufOutputStreamSupplier
private static interface	CellBlockBuilder.OutputStreamSupplier

Field Summary

Fields

Modifier and Type	Field and Description
private int	cellBlockBuildingInitialBufferSize
private int	cellBlockDecompressionMultiplier How much we think the decompressor will expand the original compressed content.
private org.apache.hadoop.conf.Configuration	conf
(package private) static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
CellBlockBuilder(org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
ByteBuffer	buildCellBlock(Codec codec, org.apache.hadoop.io.compress.CompressionCodec compressor, CellScanner cellScanner) Puts CellScanner Cells into a cell block using passed in codec and/or compressor.
org.apache.hbase.thirdparty.io.netty.buffer.ByteBuf	buildCellBlock(Codec codec, org.apache.hadoop.io.compress.CompressionCodec compressor, CellScanner cellScanner, org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator alloc)
private boolean	buildCellBlock(Codec codec, org.apache.hadoop.io.compress.CompressionCodec compressor, CellScanner cellScanner, CellBlockBuilder.OutputStreamSupplier supplier)
ByteBufferListOutputStream	buildCellBlockStream(Codec codec, org.apache.hadoop.io.compress.CompressionCodec compressor, CellScanner cellScanner, ByteBufferPool pool) Puts CellScanner Cells into a cell block using passed in codec and/or compressor.
CellScanner	createCellScanner(Codec codec, org.apache.hadoop.io.compress.CompressionCodec compressor, byte[] cellBlock)
CellScanner	createCellScannerReusingBuffers(Codec codec, org.apache.hadoop.io.compress.CompressionCodec compressor, ByteBuff cellBlock)
private ByteBuffer	decompress(org.apache.hadoop.io.compress.CompressionCodec compressor, byte[] compressedCellBlock)
private ByteBuff	decompress(org.apache.hadoop.io.compress.CompressionCodec compressor, ByteBuff compressedCellBlock)
private ByteBuffer	decompress(org.apache.hadoop.io.compress.CompressionCodec compressor, InputStream cellBlockStream, int osInitialSize)
private void	encodeCellsTo(OutputStream os, CellScanner cellScanner, Codec codec, org.apache.hadoop.io.compress.CompressionCodec compressor)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

static final org.slf4j.Logger LOG

conf

private final org.apache.hadoop.conf.Configuration conf

cellBlockDecompressionMultiplier

private final int cellBlockDecompressionMultiplier

How much we think the decompressor will expand the original compressed content.

cellBlockBuildingInitialBufferSize

private final int cellBlockBuildingInitialBufferSize

Constructor Detail

CellBlockBuilder

public CellBlockBuilder(org.apache.hadoop.conf.Configuration conf)

Method Detail

buildCellBlock

public ByteBuffer buildCellBlock(Codec codec,
                                 org.apache.hadoop.io.compress.CompressionCodec compressor,
                                 CellScanner cellScanner)
                          throws IOException

Puts CellScanner Cells into a cell block using passed in codec and/or compressor.

Parameters:

codec -

compressor -

cellScanner -

Returns:

Null or byte buffer filled with a cellblock filled with passed-in Cells encoded using passed in codec and/or compressor; the returned buffer has been flipped and is ready for reading. Use limit to find total size.

Throws:

IOException

buildCellBlock

public org.apache.hbase.thirdparty.io.netty.buffer.ByteBuf buildCellBlock(Codec codec,
                                                                          org.apache.hadoop.io.compress.CompressionCodec compressor,
                                                                          CellScanner cellScanner,
                                                                          org.apache.hbase.thirdparty.io.netty.buffer.ByteBufAllocator alloc)
                                                                   throws IOException

Throws:

IOException

buildCellBlock

private boolean buildCellBlock(Codec codec,
                               org.apache.hadoop.io.compress.CompressionCodec compressor,
                               CellScanner cellScanner,
                               CellBlockBuilder.OutputStreamSupplier supplier)
                        throws IOException

Throws:

IOException

encodeCellsTo

private void encodeCellsTo(OutputStream os,
                           CellScanner cellScanner,
                           Codec codec,
                           org.apache.hadoop.io.compress.CompressionCodec compressor)
                    throws IOException

Throws:

IOException

buildCellBlockStream

public ByteBufferListOutputStream buildCellBlockStream(Codec codec,
                                                       org.apache.hadoop.io.compress.CompressionCodec compressor,
                                                       CellScanner cellScanner,
                                                       ByteBufferPool pool)
                                                throws IOException

Puts CellScanner Cells into a cell block using passed in codec and/or compressor.

Parameters:

codec - to use for encoding

compressor - to use for encoding

cellScanner - to encode

pool - Pool of ByteBuffers to make use of.

Returns:

Null or byte buffer filled with a cellblock filled with passed-in Cells encoded using passed in codec and/or compressor; the returned buffer has been flipped and is ready for reading. Use limit to find total size. If pool was not null, then this returned ByteBuffer came from there and should be returned to the pool when done.

Throws:

IOException - if encoding the cells fail

createCellScanner

public CellScanner createCellScanner(Codec codec,
                                     org.apache.hadoop.io.compress.CompressionCodec compressor,
                                     byte[] cellBlock)
                              throws IOException

Parameters:

codec - to use for cellblock

cellBlock - to encode

Returns:

CellScanner to work against the content of cellBlock

Throws:

IOException - if encoding fails

createCellScannerReusingBuffers

public CellScanner createCellScannerReusingBuffers(Codec codec,
                                                   org.apache.hadoop.io.compress.CompressionCodec compressor,
                                                   ByteBuff cellBlock)
                                            throws IOException

Parameters:

codec - to use for cellblock

cellBlock - ByteBuffer containing the cells written by the Codec. The buffer should be position()'ed at the start of the cell block and limit()'ed at the end.

Returns:

CellScanner to work against the content of cellBlock. All cells created out of the CellScanner will share the same ByteBuffer being passed.

Throws:

IOException - if cell encoding fails

decompress

private ByteBuffer decompress(org.apache.hadoop.io.compress.CompressionCodec compressor,
                              byte[] compressedCellBlock)
                       throws IOException

Throws:

IOException

decompress

private ByteBuff decompress(org.apache.hadoop.io.compress.CompressionCodec compressor,
                            ByteBuff compressedCellBlock)
                     throws IOException

Throws:

IOException

decompress

private ByteBuffer decompress(org.apache.hadoop.io.compress.CompressionCodec compressor,
                              InputStream cellBlockStream,
                              int osInitialSize)
                       throws IOException

Throws:

IOException