org.apache.hadoop.hbase.io.hfile.bucket

Class PersistentIOEngine

java.lang.Object

org.apache.hadoop.hbase.io.hfile.bucket.PersistentIOEngine

All Implemented Interfaces:

IOEngine

Direct Known Subclasses:

FileIOEngine, FileMmapIOEngine

@InterfaceAudience.Private
public abstract class PersistentIOEngine
extends Object
implements IOEngine

A class implementing PersistentIOEngine interface supports file integrity verification for BucketCache which use persistent IOEngine

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	PersistentIOEngine.DuFileCommand

Field Summary

Fields

Modifier and Type	Field and Description
private static PersistentIOEngine.DuFileCommand	DU
protected String[]	filePaths
private static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
PersistentIOEngine(String... filePaths)

Method Summary

Modifier and Type	Method and Description
protected byte[]	calculateChecksum(String algorithm) Using an encryption algorithm to calculate a checksum, the default encryption algorithm is MD5
private static long	getFileSize(String filePath) Using Linux command du to get file's real size
protected void	verifyFileIntegrity(byte[] persistentChecksum, String algorithm) Verify cache files's integrity

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.io.hfile.bucket.IOEngine

isPersistent, read, shutdown, sync, usesSharedMemory, write, write

Field Detail

LOG

private static final org.slf4j.Logger LOG

DU

private static final PersistentIOEngine.DuFileCommand DU

filePaths

protected final String[] filePaths

Constructor Detail

PersistentIOEngine

public PersistentIOEngine(String... filePaths)

Method Detail

verifyFileIntegrity

protected void verifyFileIntegrity(byte[] persistentChecksum,
                                   String algorithm)
                            throws IOException

Verify cache files's integrity

Parameters:

algorithm - the backingMap persistence path

Throws:

IOException

calculateChecksum

protected byte[] calculateChecksum(String algorithm)

Using an encryption algorithm to calculate a checksum, the default encryption algorithm is MD5

Returns:

the checksum which is convert to HexString

Throws:

IOException - something happened like file not exists

NoSuchAlgorithmException - no such algorithm

getFileSize

private static long getFileSize(String filePath)
                         throws IOException

Using Linux command du to get file's real size

Parameters:

filePath - the file

Returns:

file's real size

Throws:

IOException - something happened like file not exists