Package org.apache.hadoop.hbase.backup.replication

Class ObjectStoreProtobufWalWriter

java.lang.Object

org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter

org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter

org.apache.hadoop.hbase.backup.replication.ObjectStoreProtobufWalWriter

All Implemented Interfaces:

Closeable, AutoCloseable, FSHLogProvider.Writer, WALProvider.Writer, WALProvider.WriterBase

@Private
public class ObjectStoreProtobufWalWriter
extends ProtobufLogWriter

A custom implementation of ProtobufLogWriter that provides support for writing protobuf-based WAL (Write-Ahead Log) entries to object store-backed files.

This class overrides the ProtobufLogWriter.sync(boolean) and ProtobufLogWriter.initOutput(FileSystem, Path, boolean, int, short, long, StreamSlowMonitor, boolean) methods to ensure compatibility with object stores, while ignoring specific capability checks such as HFLUSH and HSYNC. These checks are often not supported by some object stores, and bypassing them ensures smooth operation in such environments.

Field Summary

Fields

Modifier and Type	Field	Description
private final AtomicLong	syncedLength

Fields inherited from class org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter

output

Fields inherited from class org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter

cellEncoder, compressionContext, compressor, conf, encryptor, length, trailer, trailerWarnSize, trailerWritten

Constructor Summary

Constructors

Constructor	Description
ObjectStoreProtobufWalWriter()

Method Summary

Modifier and Type	Method	Description
protected void	initOutput(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path, boolean overwritable, int bufferSize, short replication, long blockSize, StreamSlowMonitor monitor, boolean noLocalWrite)
void	sync(boolean forceSync)

Methods inherited from class org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter

append, close, closeOutputIfNecessary, getOutputStreamForCellEncoder, getStream, getSyncedLength, writeMagicAndWALHeader, writeWALTrailerAndMagic

Methods inherited from class org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter

getLength, init, writeWALTrailer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.wal.FSHLogProvider.Writer

init

Methods inherited from interface org.apache.hadoop.hbase.wal.WALProvider.WriterBase

getLength

Field Details

syncedLength

private final AtomicLong syncedLength

Constructor Details

ObjectStoreProtobufWalWriter

public ObjectStoreProtobufWalWriter()

Method Details

sync

public void sync(boolean forceSync)
          throws IOException

Specified by:

sync in interface WALProvider.Writer

Overrides:

sync in class ProtobufLogWriter

Throws:

IOException

initOutput

protected void initOutput(org.apache.hadoop.fs.FileSystem fs,
 org.apache.hadoop.fs.Path path,
 boolean overwritable,
 int bufferSize,
 short replication,
 long blockSize,
 StreamSlowMonitor monitor,
 boolean noLocalWrite)
                   throws IOException

Overrides:

initOutput in class ProtobufLogWriter

Throws:

IOException