Package | Description |
---|---|
org.apache.hadoop.hbase.client |
Provides HBase Client
|
org.apache.hadoop.hbase.mapreduce |
Provides HBase MapReduce
Input/OutputFormats, a table indexing MapReduce job, and utility methods.
|
org.apache.hadoop.hbase.regionserver.wal | |
org.apache.hadoop.hbase.replication |
Multi Cluster Replication
|
org.apache.hadoop.hbase.replication.regionserver | |
org.apache.hadoop.hbase.wal |
Modifier and Type | Field and Description |
---|---|
private WAL.Entry[] |
AsyncRegionReplicationRetryingCaller.entries |
Modifier and Type | Method and Description |
---|---|
CompletableFuture<Void> |
AsyncClusterConnection.replicate(RegionInfo replica,
List<WAL.Entry> entries,
int numRetries,
long rpcTimeoutNs,
long operationTimeoutNs)
Replicate wal edits to a secondary replica.
|
CompletableFuture<Void> |
AsyncClusterConnectionImpl.replicate(RegionInfo replica,
List<WAL.Entry> entries,
int retries,
long rpcTimeoutNs,
long operationTimeoutNs) |
Constructor and Description |
---|
AsyncRegionReplicationRetryingCaller(org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer retryTimer,
AsyncClusterConnectionImpl conn,
int maxAttempts,
long rpcTimeoutNs,
long operationTimeoutNs,
RegionInfo replica,
List<WAL.Entry> entries) |
Modifier and Type | Field and Description |
---|---|
(package private) WAL.Entry |
WALInputFormat.WALRecordReader.currentEntry |
Modifier and Type | Class and Description |
---|---|
(package private) class |
FSWALEntry
A WAL Entry for
AbstractFSWAL implementation. |
Modifier and Type | Field and Description |
---|---|
(package private) WAL.Entry |
ProtobufWALTailingReader.ReadWALKeyResult.entry |
Modifier and Type | Method and Description |
---|---|
WAL.Entry |
ProtobufWALStreamReader.next(WAL.Entry reuse) |
Modifier and Type | Method and Description |
---|---|
void |
AsyncProtobufLogWriter.append(WAL.Entry entry) |
void |
CombinedWriter.append(WAL.Entry entry) |
void |
ProtobufLogWriter.append(WAL.Entry entry) |
void |
CombinedAsyncWriter.append(WAL.Entry entry) |
WAL.Entry |
ProtobufWALStreamReader.next(WAL.Entry reuse) |
private long |
AbstractFSWAL.postAppend(WAL.Entry e,
long elapsedTime) |
private WALTailingReader.Result |
ProtobufWALTailingReader.readWALEdit(WAL.Entry entry,
int followingKvCount) |
Constructor and Description |
---|
ReadWALKeyResult(WALTailingReader.State state,
WAL.Entry entry,
int followingKvCount) |
Modifier and Type | Field and Description |
---|---|
(package private) List<WAL.Entry> |
ReplicationEndpoint.ReplicateContext.entries |
Modifier and Type | Method and Description |
---|---|
WAL.Entry |
WALEntryFilter.filter(WAL.Entry entry)
Applies the filter, possibly returning a different Entry instance.
|
WAL.Entry |
ChainWALEmptyEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
ScopeWALEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
NamespaceTableCfWALEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
ChainWALEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
ClusterMarkingEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
SystemTableWALEntryFilter.filter(WAL.Entry entry) |
protected WAL.Entry |
ChainWALEntryFilter.filterEntry(WAL.Entry entry) |
Modifier and Type | Method and Description |
---|---|
List<WAL.Entry> |
ReplicationEndpoint.ReplicateContext.getEntries() |
Modifier and Type | Method and Description |
---|---|
WAL.Entry |
WALEntryFilter.filter(WAL.Entry entry)
Applies the filter, possibly returning a different Entry instance.
|
WAL.Entry |
ChainWALEmptyEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
ScopeWALEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
NamespaceTableCfWALEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
ChainWALEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
ClusterMarkingEntryFilter.filter(WAL.Entry entry) |
WAL.Entry |
SystemTableWALEntryFilter.filter(WAL.Entry entry) |
Cell |
ScopeWALEntryFilter.filterCell(WAL.Entry entry,
Cell cell) |
Cell |
WALCellFilter.filterCell(WAL.Entry entry,
Cell cell)
Applies the filter, possibly returning a different Cell instance.
|
Cell |
NamespaceTableCfWALEntryFilter.filterCell(WAL.Entry entry,
Cell cell) |
private Cell |
ChainWALEntryFilter.filterCell(WAL.Entry entry,
Cell cell) |
protected void |
ChainWALEntryFilter.filterCells(WAL.Entry entry) |
protected WAL.Entry |
ChainWALEntryFilter.filterEntry(WAL.Entry entry) |
Modifier and Type | Method and Description |
---|---|
ReplicationEndpoint.ReplicateContext |
ReplicationEndpoint.ReplicateContext.setEntries(List<WAL.Entry> entries) |
Modifier and Type | Field and Description |
---|---|
private WAL.Entry |
WALEntryStream.currentEntry |
Modifier and Type | Field and Description |
---|---|
private List<Pair<WAL.Entry,Long>> |
WALEntryBatch.walEntriesWithSize |
Modifier and Type | Method and Description |
---|---|
protected WAL.Entry |
ReplicationSourceWALReader.filterEntry(WAL.Entry entry) |
WAL.Entry |
WALEntryStream.next()
Returns the next WAL entry in this stream and advance the stream.
|
WAL.Entry |
WALEntryStream.peek()
Returns the next WAL entry in this stream but does not advance.
|
Modifier and Type | Method and Description |
---|---|
private List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.createBatches(List<WAL.Entry> entries)
Divide the entries into multiple batches, so that we can replicate each batch in a thread pool
concurrently.
|
private List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.createParallelBatches(List<WAL.Entry> entries) |
private List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.createSerialBatches(List<WAL.Entry> entries) |
(package private) List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.filterNotExistColumnFamilyEdits(List<List<WAL.Entry>> oldEntryList) |
(package private) List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.filterNotExistTableEdits(List<List<WAL.Entry>> oldEntryList) |
List<WAL.Entry> |
WALEntryBatch.getWalEntries()
Returns the WAL Entries.
|
List<Pair<WAL.Entry,Long>> |
WALEntryBatch.getWalEntriesWithSize()
Returns the WAL Entries.
|
private List<WAL.Entry> |
ReplaySyncReplicationWALCallable.readWALEntries(WALStreamReader reader,
String wal) |
Modifier and Type | Method and Description |
---|---|
(package private) boolean |
ReplicationSourceManager.acquireWALEntryBufferQuota(WALEntryBatch walEntryBatch,
WAL.Entry entry)
Acquire the buffer quota for
WAL.Entry which is added to WALEntryBatch . |
void |
WALEntryBatch.addEntry(WAL.Entry entry,
long entrySize) |
protected boolean |
ReplicationSourceWALReader.addEntryToBatch(WALEntryBatch batch,
WAL.Entry entry) |
private boolean |
SerialReplicationChecker.canPush(WAL.Entry entry,
byte[] row) |
boolean |
SerialReplicationChecker.canPush(WAL.Entry entry,
Cell firstCellInEdit) |
private boolean |
ReplaySyncReplicationWALCallable.filter(WAL.Entry entry) |
protected WAL.Entry |
ReplicationSourceWALReader.filterEntry(WAL.Entry entry) |
(package private) static long |
WALEntryBatch.getEntrySizeExcludeBulkLoad(WAL.Entry entry) |
private long |
ReplicationSourceWALReader.getEntrySizeIncludeBulkLoad(WAL.Entry entry) |
private int |
HBaseInterClusterReplicationEndpoint.getEstimatedEntrySize(WAL.Entry e) |
long |
WALEntryBatch.incrementUsedBufferSize(WAL.Entry entry) |
private void |
ReplicationSourceWALReader.updateBatchStats(WALEntryBatch batch,
WAL.Entry entry,
long entrySize) |
private void |
ReplicationSourceWALReader.updateReplicationMarkerEdit(WAL.Entry entry,
long offset) |
void |
SerialReplicationChecker.waitUntilCanPush(WAL.Entry entry,
Cell firstCellInEdit) |
Modifier and Type | Method and Description |
---|---|
protected CompletableFuture<Integer> |
HBaseInterClusterReplicationEndpoint.asyncReplicate(List<WAL.Entry> entries,
int batchIndex,
int timeout)
Replicate entries to peer cluster by async API.
|
private List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.createBatches(List<WAL.Entry> entries)
Divide the entries into multiple batches, so that we can replicate each batch in a thread pool
concurrently.
|
private List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.createParallelBatches(List<WAL.Entry> entries) |
private List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.createSerialBatches(List<WAL.Entry> entries) |
(package private) List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.filterNotExistColumnFamilyEdits(List<List<WAL.Entry>> oldEntryList) |
(package private) List<List<WAL.Entry>> |
HBaseInterClusterReplicationEndpoint.filterNotExistTableEdits(List<List<WAL.Entry>> oldEntryList) |
private long |
HBaseInterClusterReplicationEndpoint.parallelReplicate(ReplicationEndpoint.ReplicateContext replicateContext,
List<List<WAL.Entry>> batches) |
void |
ReplicationSourceInterface.postShipEdits(List<WAL.Entry> entries,
long batchSize)
Call this after the shipper thread ship some entries to peer cluster.
|
void |
ReplicationSource.postShipEdits(List<WAL.Entry> entries,
long batchSize) |
protected CompletableFuture<Integer> |
HBaseInterClusterReplicationEndpoint.replicateEntries(List<WAL.Entry> entries,
int batchIndex,
int timeout) |
private CompletableFuture<Integer> |
HBaseInterClusterReplicationEndpoint.serialReplicateRegionEntries(org.apache.hbase.thirdparty.com.google.common.collect.PeekingIterator<WAL.Entry> walEntryPeekingIterator,
int batchIndex,
int timeout)
Here for
HBaseInterClusterReplicationEndpoint#isSerialis is true, we iterator over the
WAL WAL.Entry list, once we reached a batch limit, we send it out, and in the callback, we
send the next batch, until we send all entries out. |
void |
MetricsSource.updateTableLevelMetrics(List<Pair<WAL.Entry,Long>> walEntries)
Update the table level replication metrics per table
|
Modifier and Type | Field and Description |
---|---|
private WAL.Entry |
WALTailingReader.Result.entry |
Modifier and Type | Field and Description |
---|---|
(package private) List<WAL.Entry> |
EntryBuffers.RegionEntryBuffer.entryBuffer |
Modifier and Type | Method and Description |
---|---|
WAL.Entry |
WALTailingReader.Result.getEntry() |
private WAL.Entry |
WALSplitter.getNextLogLine(WALStreamReader in,
org.apache.hadoop.fs.Path path,
boolean skipErrors) |
default WAL.Entry |
WALStreamReader.next()
Read the next entry in WAL.
|
WAL.Entry |
WALStreamReader.next(WAL.Entry reuse)
Read the next entry in WAL, use the given
WAL.Entry if not null to hold the
data. |
Modifier and Type | Method and Description |
---|---|
void |
WALProvider.Writer.append(WAL.Entry entry) |
void |
WALProvider.AsyncWriter.append(WAL.Entry entry) |
(package private) void |
EntryBuffers.appendEntry(WAL.Entry entry)
Append a log entry into the corresponding region buffer.
|
(package private) long |
EntryBuffers.RegionEntryBuffer.appendEntry(WAL.Entry entry) |
private void |
AbstractRecoveredEditsOutputSink.RecoveredEditsWriter.filterCellByStore(WAL.Entry logEntry) |
private void |
EntryBuffers.RegionEntryBuffer.internify(WAL.Entry entry) |
(package private) abstract boolean |
OutputSink.keepRegionEvent(WAL.Entry entry)
Some WALEdit's contain only KV's for account on what happened to a region.
|
(package private) boolean |
BoundedRecoveredHFilesOutputSink.keepRegionEvent(WAL.Entry entry) |
boolean |
AbstractRecoveredEditsOutputSink.keepRegionEvent(WAL.Entry entry) |
private void |
AbstractRecoveredEditsOutputSink.RecoveredEditsWriter.logAndThrowWriterAppendFailure(WAL.Entry logEntry,
IOException e) |
WAL.Entry |
WALStreamReader.next(WAL.Entry reuse)
Read the next entry in WAL, use the given
WAL.Entry if not null to hold the
data. |
(package private) void |
AbstractRecoveredEditsOutputSink.updateRegionMaximumEditLogSeqNum(WAL.Entry entry)
Update region's maximum edit log SeqNum.
|
Modifier and Type | Method and Description |
---|---|
(package private) void |
AbstractRecoveredEditsOutputSink.RecoveredEditsWriter.writeRegionEntries(List<WAL.Entry> entries) |
Constructor and Description |
---|
Result(WALTailingReader.State state,
WAL.Entry entry,
long entryEndPos) |
Copyright © 2007–2020 The Apache Software Foundation. All rights reserved.