Modifier and Type | Field and Description |
---|---|
private static org.slf4j.Logger |
LOG |
static String |
WAL_BLOCK_SIZE |
Modifier | Constructor and Description |
---|---|
private |
WALUtil() |
Modifier and Type | Method and Description |
---|---|
private static WALKeyImpl |
doFullMarkerAppendTransaction(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
WALEdit edit,
MultiVersionConcurrencyControl mvcc,
Map<String,byte[]> extendedAttributes,
boolean sync)
A 'full' WAL transaction involves starting an mvcc transaction followed by an append, an
optional sync, and then a call to complete the mvcc transaction.
|
static void |
filterCells(WALEdit edit,
Function<Cell,Cell> mapper) |
static long |
getWALBlockSize(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path dir)
Blocksize returned here is 2x the default HDFS blocksize unless explicitly set in
Configuration.
|
static long |
getWALBlockSize(org.apache.hadoop.conf.Configuration conf,
org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path dir,
boolean isRecoverEdits)
Public because of FSHLog.
|
static WALKeyImpl |
writeBulkLoadMarkerAndSync(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.BulkLoadDescriptor desc,
MultiVersionConcurrencyControl mvcc)
Write a log marker that a bulk load has succeeded and is about to be committed.
|
static WALKeyImpl |
writeCompactionMarker(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.CompactionDescriptor c,
MultiVersionConcurrencyControl mvcc)
Write the marker that a compaction has succeeded and is about to be committed.
|
static WALKeyImpl |
writeFlushMarker(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.FlushDescriptor f,
boolean sync,
MultiVersionConcurrencyControl mvcc)
Write a flush marker indicating a start / abort or a complete of a region flush
This write is for internal use only.
|
private static WALKeyImpl |
writeMarker(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
WALEdit edit,
MultiVersionConcurrencyControl mvcc,
Map<String,byte[]> extendedAttributes) |
static WALKeyImpl |
writeRegionEventMarker(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.RegionEventDescriptor r,
MultiVersionConcurrencyControl mvcc)
Write a region open marker indicating that the region is opened.
|
private static final org.slf4j.Logger LOG
public static final String WAL_BLOCK_SIZE
private WALUtil()
public static WALKeyImpl writeCompactionMarker(WAL wal, NavigableMap<byte[],Integer> replicationScope, RegionInfo hri, org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.CompactionDescriptor c, MultiVersionConcurrencyControl mvcc) throws IOException
mvcc
- Used by WAL to get sequence Id for the waledit.IOException
public static WALKeyImpl writeFlushMarker(WAL wal, NavigableMap<byte[],Integer> replicationScope, RegionInfo hri, org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.FlushDescriptor f, boolean sync, MultiVersionConcurrencyControl mvcc) throws IOException
IOException
public static WALKeyImpl writeRegionEventMarker(WAL wal, NavigableMap<byte[],Integer> replicationScope, RegionInfo hri, org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.RegionEventDescriptor r, MultiVersionConcurrencyControl mvcc) throws IOException
IOException
public static WALKeyImpl writeBulkLoadMarkerAndSync(WAL wal, NavigableMap<byte[],Integer> replicationScope, RegionInfo hri, org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.BulkLoadDescriptor desc, MultiVersionConcurrencyControl mvcc) throws IOException
wal
- The log to write into.replicationScope
- The replication scope of the families in the HRegionhri
- A description of the region in the table that we are bulk loading into.desc
- A protocol buffers based description of the client's bulk loading
requestIOException
- We will throw an IOException if we can not append to the HLog.private static WALKeyImpl writeMarker(WAL wal, NavigableMap<byte[],Integer> replicationScope, RegionInfo hri, WALEdit edit, MultiVersionConcurrencyControl mvcc, Map<String,byte[]> extendedAttributes) throws IOException
IOException
private static WALKeyImpl doFullMarkerAppendTransaction(WAL wal, NavigableMap<byte[],Integer> replicationScope, RegionInfo hri, WALEdit edit, MultiVersionConcurrencyControl mvcc, Map<String,byte[]> extendedAttributes, boolean sync) throws IOException
IOException
public static long getWALBlockSize(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dir) throws IOException
IOException
public static long getWALBlockSize(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dir, boolean isRecoverEdits) throws IOException
isRecoverEdits
- the created writer is for recovered edits or WAL. For recovered edits, it
is true and for WAL it is false.IOException
public static void filterCells(WALEdit edit, Function<Cell,Cell> mapper)
Copyright © 2007–2020 The Apache Software Foundation. All rights reserved.