Class ZstdCodec
java.lang.Object
org.apache.hadoop.hbase.io.compress.aircompressor.ZstdCodec
- All Implemented Interfaces:
org.apache.hadoop.conf.Configurable
,org.apache.hadoop.io.compress.CompressionCodec
@Private
public class ZstdCodec
extends Object
implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.compress.CompressionCodec
Hadoop codec implementation for Zstandard, implemented with aircompressor.
Unlike the other codecs this one should be considered as under development and unstable (as in changing), reflecting the status of aircompressor's zstandard implementation.
NOTE: This codec is NOT data format compatible with the Hadoop native zstandard codec. There are issues with both framing and limitations of the aircompressor zstandard compressor. This codec can be used as an alternative to the native codec, if the native codec cannot be made available and/or an eventual migration will never be necessary (i.e. this codec's performance meets anticipated requirements). Once you begin using this alternative you will be locked into it.
-
Nested Class Summary
Modifier and TypeClassDescriptionclass
class
Nested classes/interfaces inherited from interface org.apache.hadoop.io.compress.CompressionCodec
org.apache.hadoop.io.compress.CompressionCodec.Util
-
Field Summary
Modifier and TypeFieldDescriptionprivate int
private org.apache.hadoop.conf.Configuration
static final int
static final String
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionorg.apache.hadoop.io.compress.Compressor
org.apache.hadoop.io.compress.Decompressor
org.apache.hadoop.io.compress.CompressionInputStream
org.apache.hadoop.io.compress.CompressionInputStream
createInputStream
(InputStream in, org.apache.hadoop.io.compress.Decompressor d) org.apache.hadoop.io.compress.CompressionOutputStream
org.apache.hadoop.io.compress.CompressionOutputStream
createOutputStream
(OutputStream out, org.apache.hadoop.io.compress.Compressor c) (package private) static int
getBufferSize
(org.apache.hadoop.conf.Configuration conf) Class<? extends org.apache.hadoop.io.compress.Compressor>
org.apache.hadoop.conf.Configuration
getConf()
Class<? extends org.apache.hadoop.io.compress.Decompressor>
void
setConf
(org.apache.hadoop.conf.Configuration conf)
-
Field Details
-
ZSTD_BUFFER_SIZE_KEY
- See Also:
-
ZSTD_BUFFER_SIZE_DEFAULT
- See Also:
-
conf
-
bufferSize
-
-
Constructor Details
-
ZstdCodec
public ZstdCodec()
-
-
Method Details
-
setConf
- Specified by:
setConf
in interfaceorg.apache.hadoop.conf.Configurable
-
getConf
- Specified by:
getConf
in interfaceorg.apache.hadoop.conf.Configurable
-
createCompressor
- Specified by:
createCompressor
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
-
createDecompressor
- Specified by:
createDecompressor
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
-
createInputStream
public org.apache.hadoop.io.compress.CompressionInputStream createInputStream(InputStream in) throws IOException - Specified by:
createInputStream
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
- Throws:
IOException
-
createInputStream
public org.apache.hadoop.io.compress.CompressionInputStream createInputStream(InputStream in, org.apache.hadoop.io.compress.Decompressor d) throws IOException - Specified by:
createInputStream
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
- Throws:
IOException
-
createOutputStream
public org.apache.hadoop.io.compress.CompressionOutputStream createOutputStream(OutputStream out) throws IOException - Specified by:
createOutputStream
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
- Throws:
IOException
-
createOutputStream
public org.apache.hadoop.io.compress.CompressionOutputStream createOutputStream(OutputStream out, org.apache.hadoop.io.compress.Compressor c) throws IOException - Specified by:
createOutputStream
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
- Throws:
IOException
-
getCompressorType
- Specified by:
getCompressorType
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
-
getDecompressorType
- Specified by:
getDecompressorType
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
-
getDefaultExtension
- Specified by:
getDefaultExtension
in interfaceorg.apache.hadoop.io.compress.CompressionCodec
-
getBufferSize
-