org.apache.hadoop.hbase.wal

Class EntryBuffers

java.lang.Object

org.apache.hadoop.hbase.wal.EntryBuffers

@InterfaceAudience.Private
public class EntryBuffers
extends Object

Class which accumulates edits and separates them into a buffer per region while simultaneously accounting RAM usage. Blocks if the RAM usage crosses a predefined threshold. Writer threads then pull region-specific buffers from this class.

Field Summary

Fields

Modifier and Type	Field and Description
(package private) Map<byte[],WALSplitter.RegionEntryBuffer>	buffers
(package private) WALSplitter.PipelineController	controller
(package private) Set<byte[]>	currentlyWriting
private static org.slf4j.Logger	LOG
(package private) long	maxHeapUsage
(package private) boolean	splitWriterCreationBounded
(package private) long	totalBuffered

Constructor Summary

Constructors

Constructor and Description
EntryBuffers(WALSplitter.PipelineController controller, long maxHeapUsage)
EntryBuffers(WALSplitter.PipelineController controller, long maxHeapUsage, boolean splitWriterCreationBounded)

Method Summary

Modifier and Type	Method and Description
void	appendEntry(WAL.Entry entry) Append a log entry into the corresponding region buffer.
(package private) void	doneWriting(WALSplitter.RegionEntryBuffer buffer)
(package private) WALSplitter.RegionEntryBuffer	getChunkToWrite()
(package private) boolean	isRegionCurrentlyWriting(byte[] region)
void	waitUntilDrained()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

controller

WALSplitter.PipelineController controller

buffers

Map<byte[],WALSplitter.RegionEntryBuffer> buffers

currentlyWriting

Set<byte[]> currentlyWriting

totalBuffered

long totalBuffered

maxHeapUsage

long maxHeapUsage

splitWriterCreationBounded

boolean splitWriterCreationBounded

Constructor Detail

EntryBuffers

public EntryBuffers(WALSplitter.PipelineController controller,
                    long maxHeapUsage)

EntryBuffers

public EntryBuffers(WALSplitter.PipelineController controller,
                    long maxHeapUsage,
                    boolean splitWriterCreationBounded)

Method Detail

appendEntry

public void appendEntry(WAL.Entry entry)
                 throws InterruptedException,
                        IOException

Append a log entry into the corresponding region buffer. Blocks if the total heap usage has crossed the specified threshold.

Throws:

InterruptedException

IOException

getChunkToWrite

WALSplitter.RegionEntryBuffer getChunkToWrite()

Returns:

RegionEntryBuffer a buffer of edits to be written.

doneWriting

void doneWriting(WALSplitter.RegionEntryBuffer buffer)

isRegionCurrentlyWriting

boolean isRegionCurrentlyWriting(byte[] region)

waitUntilDrained

public void waitUntilDrained()