org.apache.hadoop.hbase.io.hfile

Class TestChecksum.CorruptedFSReaderImpl

java.lang.Object

org.apache.hadoop.hbase.io.hfile.TestChecksum.CorruptedFSReaderImpl

Enclosing class:

TestChecksum

private static class TestChecksum.CorruptedFSReaderImpl
extends Object

This class is to test checksum behavior when data is corrupted. It mimics the following behavior: - When fs checksum is disabled, hbase may get corrupted data from hdfs. If verifyChecksum is true, it means hbase checksum is on and fs checksum is off, so we corrupt the data. - When fs checksum is enabled, hdfs will get a different copy from another node, and will always return correct data. So we don't corrupt the data when verifyChecksum for hbase is off.

Field Summary

Fields

Modifier and Type	Field and Description
(package private) boolean	corruptDataStream If set to true, corrupt reads using readAtOffset(...).
protected int	hdrSize

Constructor Summary

Constructors

Constructor and Description
CorruptedFSReaderImpl(org.apache.hadoop.hbase.io.FSDataInputStreamWrapper istream, long fileSize, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, org.apache.hadoop.hbase.io.hfile.HFileContext meta)

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.hbase.io.hfile.HFileBlock.BlockIterator	blockRange(long arg0, long arg1)
void	closeStreams()
org.apache.hadoop.hbase.io.encoding.HFileBlockDecodingContext	getBlockDecodingContext()
org.apache.hadoop.hbase.io.encoding.HFileBlockDecodingContext	getDefaultBlockDecodingContext()
protected int	readAtOffset(org.apache.hadoop.fs.FSDataInputStream istream, byte[] dest, int destOffset, int size, boolean peekIntoNextBlock, long fileOffset, boolean pread)
org.apache.hadoop.hbase.io.hfile.HFileBlock	readBlockData(long arg0, long arg1, boolean arg2, boolean arg3)
protected org.apache.hadoop.hbase.io.hfile.HFileBlock	readBlockDataInternal(org.apache.hadoop.fs.FSDataInputStream is, long offset, long onDiskSizeWithHeaderL, boolean pread, boolean verifyChecksum, boolean updateMetrics)
void	setDataBlockEncoder(org.apache.hadoop.hbase.io.hfile.HFileDataBlockEncoder arg0)
void	setIncludesMemStoreTS(boolean arg0)
String	toString()
void	unbufferStream()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

corruptDataStream

boolean corruptDataStream

If set to true, corrupt reads using readAtOffset(...).

hdrSize

protected final int hdrSize

Constructor Detail

CorruptedFSReaderImpl

public CorruptedFSReaderImpl(org.apache.hadoop.hbase.io.FSDataInputStreamWrapper istream,
                             long fileSize,
                             org.apache.hadoop.fs.FileSystem fs,
                             org.apache.hadoop.fs.Path path,
                             org.apache.hadoop.hbase.io.hfile.HFileContext meta)
                      throws IOException

Throws:

IOException

Method Detail

readBlockDataInternal

protected org.apache.hadoop.hbase.io.hfile.HFileBlock readBlockDataInternal(org.apache.hadoop.fs.FSDataInputStream is,
                                                                            long offset,
                                                                            long onDiskSizeWithHeaderL,
                                                                            boolean pread,
                                                                            boolean verifyChecksum,
                                                                            boolean updateMetrics)
                                                                     throws IOException

Throws:

IOException

readAtOffset

protected int readAtOffset(org.apache.hadoop.fs.FSDataInputStream istream,
                           byte[] dest,
                           int destOffset,
                           int size,
                           boolean peekIntoNextBlock,
                           long fileOffset,
                           boolean pread)
                    throws IOException

Throws:

IOException

blockRange

public org.apache.hadoop.hbase.io.hfile.HFileBlock.BlockIterator blockRange(long arg0,
                                                                            long arg1)

readBlockData

public org.apache.hadoop.hbase.io.hfile.HFileBlock readBlockData(long arg0,
                                                                 long arg1,
                                                                 boolean arg2,
                                                                 boolean arg3)
                                                          throws IOException

Throws:

IOException

setIncludesMemStoreTS

public void setIncludesMemStoreTS(boolean arg0)

setDataBlockEncoder

public void setDataBlockEncoder(org.apache.hadoop.hbase.io.hfile.HFileDataBlockEncoder arg0)

getBlockDecodingContext

public org.apache.hadoop.hbase.io.encoding.HFileBlockDecodingContext getBlockDecodingContext()

getDefaultBlockDecodingContext

public org.apache.hadoop.hbase.io.encoding.HFileBlockDecodingContext getDefaultBlockDecodingContext()

closeStreams

public void closeStreams()
                  throws IOException

Throws:

IOException

unbufferStream

public void unbufferStream()

toString

public String toString()

Overrides:

toString in class Object