Package org.apache.hadoop.hbase.io.hfile.bucket

Class FileIOEngine

java.lang.Object

org.apache.hadoop.hbase.io.hfile.bucket.PersistentIOEngine

org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine

All Implemented Interfaces:

IOEngine

@Private
public class FileIOEngine
extends PersistentIOEngine

IO engine that stores data to a file on the local file system.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
private static interface	FileIOEngine.FileAccessor
private static class	FileIOEngine.FileReadAccessor
private static class	FileIOEngine.FileWriteAccessor

Field Summary

Fields

Modifier and Type	Field	Description
private final long	capacity
private final ReentrantLock[]	channelLocks
static final String	FILE_DELIMITER
private final FileChannel[]	fileChannels
private static final org.slf4j.Logger	LOG
private boolean	maintainPersistence
private final RandomAccessFile[]	rafs
private FileIOEngine.FileReadAccessor	readAccessor
private final long	sizePerFile
private FileIOEngine.FileWriteAccessor	writeAccessor

Fields inherited from class org.apache.hadoop.hbase.io.hfile.bucket.PersistentIOEngine

filePaths

Constructor Summary

Constructors

Constructor	Description
FileIOEngine(long capacity, boolean maintainPersistence, String... filePaths)

Method Summary

Modifier and Type	Method	Description
private void	accessFile(FileIOEngine.FileAccessor accessor, ByteBuff buff, long globalOffset)
(package private) void	checkCacheTime(BucketEntry be)
(package private) void	closeFileChannels()
private long	getAbsoluteOffsetInFile(int fileNum, long globalOffset)	Get the absolute offset in given file with the relative global offset.
(package private) FileChannel[]	getFileChannels()
private int	getFileNum(long offset)
boolean	isPersistent()	File IO engine is always able to support persistent storage for the cache
Cacheable	read(BucketEntry be)	Transfers data from file to the given byte buffer
(package private) void	refreshFileConnection(int accessFileNum, IOException ioe)
void	shutdown()	Close the file
void	sync()	Sync the data to file after writing
String	toString()
void	write(ByteBuffer srcBuffer, long offset)	Transfers data from the given byte buffer to file
void	write(ByteBuff srcBuff, long offset)	Transfers the data from the given MultiByteBuffer to IOEngine

Methods inherited from class org.apache.hadoop.hbase.io.hfile.bucket.PersistentIOEngine

calculateChecksum, verifyFileIntegrity

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.io.hfile.bucket.IOEngine

usesSharedMemory

Field Details

LOG

private static final org.slf4j.Logger LOG

FILE_DELIMITER

public static final String FILE_DELIMITER

See Also:

• Constant Field Values

fileChannels

private final FileChannel[] fileChannels

rafs

private final RandomAccessFile[] rafs

channelLocks

private final ReentrantLock[] channelLocks

sizePerFile

private final long sizePerFile

capacity

private final long capacity

maintainPersistence

private boolean maintainPersistence

readAccessor

private FileIOEngine.FileReadAccessor readAccessor

writeAccessor

private FileIOEngine.FileWriteAccessor writeAccessor

Constructor Details

FileIOEngine

public FileIOEngine(long capacity,
 boolean maintainPersistence,
 String... filePaths)
             throws IOException

Throws:

IOException

Method Details

toString

public String toString()

Overrides:

toString in class Object

isPersistent

public boolean isPersistent()

File IO engine is always able to support persistent storage for the cache

read

public Cacheable read(BucketEntry be)
               throws IOException

Transfers data from file to the given byte buffer

Parameters:

be - an BucketEntry which maintains an (offset, len, refCnt)

Returns:

the Cacheable with block data inside.

Throws:

IOException - if any IO error happen.

checkCacheTime

void checkCacheTime(BucketEntry be)
             throws IOException

Throws:

IOException

closeFileChannels

void closeFileChannels()

write

public void write(ByteBuffer srcBuffer,
 long offset)
           throws IOException

Transfers data from the given byte buffer to file

Parameters:

srcBuffer - the given byte buffer from which bytes are to be read

offset - The offset in the file where the first byte to be written

Throws:

IOException

sync

public void sync()
          throws IOException

Sync the data to file after writing

Throws:

IOException

shutdown

public void shutdown()

Close the file

write

public void write(ByteBuff srcBuff,
 long offset)
           throws IOException

Description copied from interface: IOEngine

Transfers the data from the given MultiByteBuffer to IOEngine

Parameters:

srcBuff - the given MultiBytebufffers from which bytes are to be read

offset - the offset in the IO engine where the first byte to be written

Throws:

IOException

accessFile

private void accessFile(FileIOEngine.FileAccessor accessor,
 ByteBuff buff,
 long globalOffset)
                 throws IOException

Throws:

IOException

getAbsoluteOffsetInFile

private long getAbsoluteOffsetInFile(int fileNum,
 long globalOffset)

Get the absolute offset in given file with the relative global offset.

Returns:

the absolute offset

getFileNum

private int getFileNum(long offset)

getFileChannels

FileChannel[] getFileChannels()

refreshFileConnection

void refreshFileConnection(int accessFileNum,
 IOException ioe)
                    throws IOException

Throws:

IOException