org.apache.hadoop.hbase.io.hfile.bucket

Class FileIOEngine

java.lang.Object

org.apache.hadoop.hbase.io.hfile.bucket.PersistentIOEngine

org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine

All Implemented Interfaces:

IOEngine

@InterfaceAudience.Private
public class FileIOEngine
extends PersistentIOEngine

IO engine that stores data to a file on the local file system.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static interface	FileIOEngine.FileAccessor
private static class	FileIOEngine.FileReadAccessor
private static class	FileIOEngine.FileWriteAccessor

Field Summary

Fields

Modifier and Type	Field and Description
private long	capacity
private ReentrantLock[]	channelLocks
static String	FILE_DELIMITER
private FileChannel[]	fileChannels
private static org.slf4j.Logger	LOG
private RandomAccessFile[]	rafs
private FileIOEngine.FileReadAccessor	readAccessor
private long	sizePerFile
private FileIOEngine.FileWriteAccessor	writeAccessor

Fields inherited from class org.apache.hadoop.hbase.io.hfile.bucket.PersistentIOEngine

filePaths

Constructor Summary

Constructors

Constructor and Description
FileIOEngine(long capacity, boolean maintainPersistence, String... filePaths)

Method Summary

Modifier and Type	Method and Description
private void	accessFile(FileIOEngine.FileAccessor accessor, ByteBuff buff, long globalOffset)
(package private) void	closeFileChannels()
private long	getAbsoluteOffsetInFile(int fileNum, long globalOffset) Get the absolute offset in given file with the relative global offset.
(package private) FileChannel[]	getFileChannels()
private int	getFileNum(long offset)
boolean	isPersistent() File IO engine is always able to support persistent storage for the cache n
Cacheable	read(BucketEntry be) Transfers data from file to the given byte buffer
(package private) void	refreshFileConnection(int accessFileNum, IOException ioe)
void	shutdown() Close the file
void	sync() Sync the data to file after writing n
String	toString()
void	write(ByteBuffer srcBuffer, long offset) Transfers data from the given byte buffer to file
void	write(ByteBuff srcBuff, long offset) Transfers the data from the given MultiByteBuffer to IOEngine

Methods inherited from class org.apache.hadoop.hbase.io.hfile.bucket.PersistentIOEngine

calculateChecksum, verifyFileIntegrity

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.io.hfile.bucket.IOEngine

usesSharedMemory

Field Detail

LOG

private static final org.slf4j.Logger LOG

FILE_DELIMITER

public static final String FILE_DELIMITER

See Also:

Constant Field Values

fileChannels

private final FileChannel[] fileChannels

rafs

private final RandomAccessFile[] rafs

channelLocks

private final ReentrantLock[] channelLocks

sizePerFile

private final long sizePerFile

capacity

private final long capacity

readAccessor

private FileIOEngine.FileReadAccessor readAccessor

writeAccessor

private FileIOEngine.FileWriteAccessor writeAccessor

Constructor Detail

FileIOEngine

public FileIOEngine(long capacity,
                    boolean maintainPersistence,
                    String... filePaths)
             throws IOException

Throws:

IOException

Method Detail

toString

public String toString()

Overrides:

toString in class Object

isPersistent

public boolean isPersistent()

File IO engine is always able to support persistent storage for the cache n

read

public Cacheable read(BucketEntry be)
               throws IOException

Transfers data from file to the given byte buffer

Parameters:

be - an BucketEntry which maintains an (offset, len, refCnt)

Returns:

the Cacheable with block data inside.

Throws:

IOException - if any IO error happen.

closeFileChannels

void closeFileChannels()

write

public void write(ByteBuffer srcBuffer,
                  long offset)
           throws IOException

Transfers data from the given byte buffer to file

Parameters:

srcBuffer - the given byte buffer from which bytes are to be read

offset - The offset in the file where the first byte to be written n

Throws:

IOException

sync

public void sync()
          throws IOException

Sync the data to file after writing n

Throws:

IOException

shutdown

public void shutdown()

Close the file

write

public void write(ByteBuff srcBuff,
                  long offset)
           throws IOException

Description copied from interface: IOEngine

Transfers the data from the given MultiByteBuffer to IOEngine

Parameters:

srcBuff - the given MultiBytebufffers from which bytes are to be read

offset - the offset in the IO engine where the first byte to be written n

Throws:

IOException

accessFile

private void accessFile(FileIOEngine.FileAccessor accessor,
                        ByteBuff buff,
                        long globalOffset)
                 throws IOException

Throws:

IOException

getAbsoluteOffsetInFile

private long getAbsoluteOffsetInFile(int fileNum,
                                     long globalOffset)

Get the absolute offset in given file with the relative global offset. nn * @return the absolute offset

getFileNum

private int getFileNum(long offset)

getFileChannels

FileChannel[] getFileChannels()

refreshFileConnection

void refreshFileConnection(int accessFileNum,
                           IOException ioe)
                    throws IOException

Throws:

IOException