org.apache.hadoop.hbase.io.hfile.bucket

Class FileIOEngine

java.lang.Object

org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine

All Implemented Interfaces:

IOEngine

@InterfaceAudience.Private
public class FileIOEngine
extends Object
implements IOEngine

IO engine that stores data to a file on the local file system.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static interface	FileIOEngine.FileAccessor
private static class	FileIOEngine.FileReadAccessor
private static class	FileIOEngine.FileWriteAccessor

Field Summary

Fields

Modifier and Type	Field and Description
private long	capacity
private ReentrantLock[]	channelLocks
static String	FILE_DELIMITER
private FileChannel[]	fileChannels
private String[]	filePaths
private static org.slf4j.Logger	LOG
private RandomAccessFile[]	rafs
private FileIOEngine.FileReadAccessor	readAccessor
private long	sizePerFile
private FileIOEngine.FileWriteAccessor	writeAccessor

Constructor Summary

Constructors

Constructor and Description
FileIOEngine(long capacity, boolean maintainPersistence, String... filePaths)

Method Summary

Modifier and Type	Method and Description
private void	accessFile(FileIOEngine.FileAccessor accessor, ByteBuffer buffer, long globalOffset)
(package private) void	closeFileChannels()
private long	getAbsoluteOffsetInFile(int fileNum, long globalOffset) Get the absolute offset in given file with the relative global offset.
(package private) FileChannel[]	getFileChannels()
private int	getFileNum(long offset)
boolean	isPersistent() File IO engine is always able to support persistent storage for the cache
Cacheable	read(long offset, int length, CacheableDeserializer<Cacheable> deserializer) Transfers data from file to the given byte buffer
(package private) void	refreshFileConnection(int accessFileNum, IOException ioe)
void	shutdown() Close the file
void	sync() Sync the data to file after writing
String	toString()
void	write(ByteBuffer srcBuffer, long offset) Transfers data from the given byte buffer to file
void	write(ByteBuff srcBuffer, long offset) Transfers the data from the given MultiByteBuffer to IOEngine

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.io.hfile.bucket.IOEngine

usesSharedMemory

Field Detail

LOG

private static final org.slf4j.Logger LOG

FILE_DELIMITER

public static final String FILE_DELIMITER

See Also:

Constant Field Values

filePaths

private final String[] filePaths

fileChannels

private final FileChannel[] fileChannels

rafs

private final RandomAccessFile[] rafs

channelLocks

private final ReentrantLock[] channelLocks

sizePerFile

private final long sizePerFile

capacity

private final long capacity

readAccessor

private FileIOEngine.FileReadAccessor readAccessor

writeAccessor

private FileIOEngine.FileWriteAccessor writeAccessor

Constructor Detail

FileIOEngine

public FileIOEngine(long capacity,
                    boolean maintainPersistence,
                    String... filePaths)
             throws IOException

Throws:

IOException

Method Detail

toString

public String toString()

Overrides:

toString in class Object

isPersistent

public boolean isPersistent()

File IO engine is always able to support persistent storage for the cache

Specified by:

isPersistent in interface IOEngine

Returns:

true

read

public Cacheable read(long offset,
                      int length,
                      CacheableDeserializer<Cacheable> deserializer)
               throws IOException

Transfers data from file to the given byte buffer

Specified by:

read in interface IOEngine

Parameters:

offset - The offset in the file where the first byte to be read

length - The length of buffer that should be allocated for reading from the file channel

deserializer - The deserializer to be used to make a Cacheable from the data.

Returns:

number of bytes read

Throws:

IOException

closeFileChannels

void closeFileChannels()

write

public void write(ByteBuffer srcBuffer,
                  long offset)
           throws IOException

Transfers data from the given byte buffer to file

Specified by:

write in interface IOEngine

Parameters:

srcBuffer - the given byte buffer from which bytes are to be read

offset - The offset in the file where the first byte to be written

Throws:

IOException

sync

public void sync()
          throws IOException

Sync the data to file after writing

Specified by:

sync in interface IOEngine

Throws:

IOException

shutdown

public void shutdown()

Close the file

Specified by:

shutdown in interface IOEngine

write

public void write(ByteBuff srcBuffer,
                  long offset)
           throws IOException

Description copied from interface: IOEngine

Transfers the data from the given MultiByteBuffer to IOEngine

Specified by:

write in interface IOEngine

Parameters:

srcBuffer - the given MultiBytebufffers from which bytes are to be read

offset - the offset in the IO engine where the first byte to be written

Throws:

IOException

accessFile

private void accessFile(FileIOEngine.FileAccessor accessor,
                        ByteBuffer buffer,
                        long globalOffset)
                 throws IOException

Throws:

IOException

getAbsoluteOffsetInFile

private long getAbsoluteOffsetInFile(int fileNum,
                                     long globalOffset)

Get the absolute offset in given file with the relative global offset.

Parameters:

fileNum -

globalOffset -

Returns:

the absolute offset

getFileNum

private int getFileNum(long offset)

getFileChannels

FileChannel[] getFileChannels()

refreshFileConnection

void refreshFileConnection(int accessFileNum,
                           IOException ioe)
                    throws IOException

Throws:

IOException