Package | Description |
---|---|
org.apache.hadoop.hbase.constraint |
Restrict the domain of a data attribute, often times to fulfill business rules/requirements.
|
org.apache.hadoop.hbase.coprocessor |
Table of Contents
|
org.apache.hadoop.hbase.mapreduce |
Provides HBase MapReduce
Input/OutputFormats, a table indexing MapReduce job, and utility methods.
|
org.apache.hadoop.hbase.regionserver | |
org.apache.hadoop.hbase.regionserver.regionreplication | |
org.apache.hadoop.hbase.regionserver.wal | |
org.apache.hadoop.hbase.replication.regionserver | |
org.apache.hadoop.hbase.security.access | |
org.apache.hadoop.hbase.wal |
Modifier and Type | Method and Description |
---|---|
void |
ConstraintProcessor.prePut(ObserverContext<RegionCoprocessorEnvironment> e,
Put put,
WALEdit edit,
Durability durability) |
Modifier and Type | Method and Description |
---|---|
default Result |
RegionObserver.postAppend(ObserverContext<RegionCoprocessorEnvironment> c,
Append append,
Result result,
WALEdit edit)
Called after Append
|
default void |
RegionObserver.postDelete(ObserverContext<RegionCoprocessorEnvironment> c,
Delete delete,
WALEdit edit)
Called after the client deletes a value.
|
default void |
RegionObserver.postDelete(ObserverContext<RegionCoprocessorEnvironment> c,
Delete delete,
WALEdit edit,
Durability durability)
Deprecated.
since 3.0.0 and will be removed in 4.0.0. Use
RegionObserver.postDelete(ObserverContext, Delete, WALEdit) instead. |
default Result |
RegionObserver.postIncrement(ObserverContext<RegionCoprocessorEnvironment> c,
Increment increment,
Result result,
WALEdit edit)
Called after increment
|
default void |
RegionObserver.postPut(ObserverContext<RegionCoprocessorEnvironment> c,
Put put,
WALEdit edit)
Called after the client stores a value.
|
default void |
RegionObserver.postPut(ObserverContext<RegionCoprocessorEnvironment> c,
Put put,
WALEdit edit,
Durability durability)
Deprecated.
since 3.0.0 and will be removed in 4.0.0. Use
RegionObserver.postPut(ObserverContext, Put, WALEdit) instead. |
default void |
RegionObserver.postWALRestore(ObserverContext<? extends RegionCoprocessorEnvironment> ctx,
RegionInfo info,
WALKey logKey,
WALEdit logEdit)
Called after a
WALEdit replayed for this region. |
default void |
WALObserver.postWALWrite(ObserverContext<? extends WALCoprocessorEnvironment> ctx,
RegionInfo info,
WALKey logKey,
WALEdit logEdit)
Deprecated.
Since hbase-2.0.0. To be replaced with an alternative that does not expose
InterfaceAudience classes such as WALKey and WALEdit. Will be removed in
hbase-3.0.0.
|
default Result |
RegionObserver.preAppend(ObserverContext<RegionCoprocessorEnvironment> c,
Append append,
WALEdit edit)
Called before Append.
|
default void |
RegionObserver.preDelete(ObserverContext<RegionCoprocessorEnvironment> c,
Delete delete,
WALEdit edit)
Called before the client deletes a value.
|
default void |
RegionObserver.preDelete(ObserverContext<RegionCoprocessorEnvironment> c,
Delete delete,
WALEdit edit,
Durability durability)
Deprecated.
since 3.0.0 and will be removed in 4.0.0. Use
RegionObserver.preDelete(ObserverContext, Delete, WALEdit) instead. |
void |
MetaTableMetrics.ExampleRegionObserverMeta.preDelete(ObserverContext<RegionCoprocessorEnvironment> e,
Delete delete,
WALEdit edit,
Durability durability) |
default Result |
RegionObserver.preIncrement(ObserverContext<RegionCoprocessorEnvironment> c,
Increment increment,
WALEdit edit)
Called before Increment.
|
default void |
RegionObserver.prePut(ObserverContext<RegionCoprocessorEnvironment> c,
Put put,
WALEdit edit)
Called before the client stores a value.
|
default void |
RegionObserver.prePut(ObserverContext<RegionCoprocessorEnvironment> c,
Put put,
WALEdit edit,
Durability durability)
Deprecated.
since 3.0.0 and will be removed in 4.0.0. Use
RegionObserver.prePut(ObserverContext, Put, WALEdit) instead. |
void |
MetaTableMetrics.ExampleRegionObserverMeta.prePut(ObserverContext<RegionCoprocessorEnvironment> e,
Put put,
WALEdit edit,
Durability durability) |
default void |
RegionObserver.preWALAppend(ObserverContext<RegionCoprocessorEnvironment> ctx,
WALKey key,
WALEdit edit)
Called just before the WAL Entry is appended to the WAL.
|
default void |
RegionObserver.preWALRestore(ObserverContext<? extends RegionCoprocessorEnvironment> ctx,
RegionInfo info,
WALKey logKey,
WALEdit logEdit)
Called before a
WALEdit replayed for this region. |
default void |
WALObserver.preWALWrite(ObserverContext<? extends WALCoprocessorEnvironment> ctx,
RegionInfo info,
WALKey logKey,
WALEdit logEdit)
Deprecated.
Since hbase-2.0.0. To be replaced with an alternative that does not expose
InterfaceAudience classes such as WALKey and WALEdit. Will be removed in
hbase-3.0.0.
|
Modifier and Type | Method and Description |
---|---|
WALEdit |
WALInputFormat.WALRecordReader.getCurrentValue() |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapreduce.RecordReader<WALKey,WALEdit> |
WALInputFormat.createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context) |
Modifier and Type | Method and Description |
---|---|
void |
WALPlayer.WALKeyValueMapper.map(WALKey key,
WALEdit value,
org.apache.hadoop.mapreduce.Mapper.Context context) |
void |
WALPlayer.WALMapper.map(WALKey key,
WALEdit value,
org.apache.hadoop.mapreduce.Mapper.Context context) |
Modifier and Type | Field and Description |
---|---|
private WALEdit |
MiniBatchOperationInProgress.walEditForReplicateIfExistsSkipWAL
Here is for HBASE-26993,saving the all the
Mutation s if there is
Durability#SKIP_WAL in HRegion.BatchOperation.buildWALEdits(org.apache.hadoop.hbase.regionserver.MiniBatchOperationInProgress<org.apache.hadoop.hbase.client.Mutation>) for
HRegion.doMiniBatchMutate(org.apache.hadoop.hbase.regionserver.HRegion.BatchOperation<?>) to also replicate Mutation which is
Durability#SKIP_WAL to region replica. |
private WALEdit[] |
MiniBatchOperationInProgress.walEditsFromCoprocessors |
protected WALEdit[] |
HRegion.BatchOperation.walEditsFromCoprocessors |
Modifier and Type | Method and Description |
---|---|
protected WALEdit |
HRegion.BatchOperation.createWALEdit(MiniBatchOperationInProgress<Mutation> miniBatchOp) |
private WALEdit |
HRegion.MutationBatchOperation.createWALEditForReplicateSkipWAL(MiniBatchOperationInProgress<Mutation> miniBatchOp,
List<Pair<NonceKey,WALEdit>> nonceKeyAndWALEdits) |
WALEdit |
MiniBatchOperationInProgress.getWalEdit(int index)
Returns Gets the walEdit for the operation(Mutation) at the specified position.
|
WALEdit |
MiniBatchOperationInProgress.getWalEditForReplicateIfExistsSkipWAL() |
Modifier and Type | Method and Description |
---|---|
List<Pair<NonceKey,WALEdit>> |
HRegion.BatchOperation.buildWALEdits(MiniBatchOperationInProgress<Mutation> miniBatchOp)
Builds separate WALEdit per nonce by applying input mutations.
|
List<Pair<NonceKey,WALEdit>> |
HRegion.MutationBatchOperation.buildWALEdits(MiniBatchOperationInProgress<Mutation> miniBatchOp) |
Modifier and Type | Method and Description |
---|---|
protected void |
HRegion.BatchOperation.addNonSkipWALMutationsToWALEdit(MiniBatchOperationInProgress<Mutation> miniBatchOp,
WALEdit walEdit,
List<Cell> cellsFromCP,
Map<byte[],List<Cell>> familyCellMap) |
protected void |
HRegion.MutationBatchOperation.addNonSkipWALMutationsToWALEdit(MiniBatchOperationInProgress<Mutation> miniBatchOp,
WALEdit walEdit,
List<Cell> cellsFromCP,
Map<byte[],List<Cell>> familyCellMap) |
private void |
HRegion.attachRegionReplicationInWALAppend(HRegion.BatchOperation<?> batchOp,
MiniBatchOperationInProgress<Mutation> miniBatchOp,
WALKeyImpl walKey,
WALEdit walEdit,
MultiVersionConcurrencyControl.WriteEntry writeEntry)
Attach
RegionReplicationSink.add(org.apache.hadoop.hbase.wal.WALKeyImpl, org.apache.hadoop.hbase.wal.WALEdit, org.apache.hadoop.hbase.ipc.ServerCall<?>) to the mvcc writeEntry for replicating to region
replica. |
private void |
HRegion.MutationBatchOperation.callPreMutateCPHook(int index,
WALEdit walEdit,
int[] metrics)
Runs prePut/preDelete/preIncrement/preAppend coprocessor hook for input mutation in a batch
|
protected static void |
HRegion.BatchOperation.doAddCellsToWALEdit(WALEdit walEdit,
List<Cell> cellsFromCP,
Map<byte[],List<Cell>> familyCellMap) |
private void |
HRegion.doAttachReplicateRegionReplicaAction(WALKeyImpl walKey,
WALEdit walEdit,
MultiVersionConcurrencyControl.WriteEntry writeEntry)
Attach
RegionReplicationSink.add(org.apache.hadoop.hbase.wal.WALKeyImpl, org.apache.hadoop.hbase.wal.WALEdit, org.apache.hadoop.hbase.ipc.ServerCall<?>) to the mvcc writeEntry for replicating to region
replica. |
void |
HRegion.BatchOperation.doPostOpCleanupForMiniBatch(MiniBatchOperationInProgress<Mutation> miniBatchOp,
WALEdit walEdit,
boolean success) |
void |
HRegion.MutationBatchOperation.doPostOpCleanupForMiniBatch(MiniBatchOperationInProgress<Mutation> miniBatchOp,
WALEdit walEdit,
boolean success) |
private MultiVersionConcurrencyControl.WriteEntry |
HRegion.doWALAppend(WALEdit walEdit,
HRegion.BatchOperation<?> batchOp,
MiniBatchOperationInProgress<Mutation> miniBatchOp,
long now,
NonceKey nonceKey)
Returns writeEntry associated with this append
|
Result |
RegionCoprocessorHost.postAppend(Append append,
Result result,
WALEdit edit) |
void |
RegionCoprocessorHost.postDelete(Delete delete,
WALEdit edit) |
Result |
RegionCoprocessorHost.postIncrement(Increment increment,
Result result,
WALEdit edit) |
void |
RegionCoprocessorHost.postPut(Put put,
WALEdit edit) |
void |
RegionCoprocessorHost.postWALRestore(RegionInfo info,
WALKey logKey,
WALEdit logEdit)
Deprecated.
Since hbase-2.0.0. No replacement. To be removed in hbase-3.0.0 and replaced with
something that doesn't expose IntefaceAudience.Private classes.
|
Result |
RegionCoprocessorHost.preAppend(Append append,
WALEdit edit)
Supports Coprocessor 'bypass'.
|
boolean |
RegionCoprocessorHost.preDelete(Delete delete,
WALEdit edit)
Supports Coprocessor 'bypass'.
|
Result |
RegionCoprocessorHost.preIncrement(Increment increment,
WALEdit edit)
Supports Coprocessor 'bypass'.
|
boolean |
RegionCoprocessorHost.prePut(Put put,
WALEdit edit)
Supports Coprocessor 'bypass'.
|
void |
RegionCoprocessorHost.preWALAppend(WALKey key,
WALEdit edit) |
boolean |
RegionCoprocessorHost.preWALRestore(RegionInfo info,
WALKey logKey,
WALEdit logEdit)
Deprecated.
Since hbase-2.0.0. No replacement. To be removed in hbase-3.0.0 and replaced with
something that doesn't expose IntefaceAudience.Private classes.
|
void |
MiniBatchOperationInProgress.setWalEdit(int index,
WALEdit walEdit)
Sets the walEdit for the operation(Mutation) at the specified position.
|
void |
MiniBatchOperationInProgress.setWalEditForReplicateIfExistsSkipWAL(WALEdit walEditForReplicateSkipWAL) |
Modifier and Type | Method and Description |
---|---|
protected abstract void |
HRegion.BatchOperation.cacheSkipWALMutationForRegionReplication(MiniBatchOperationInProgress<Mutation> miniBatchOp,
List<Pair<NonceKey,WALEdit>> walEdits,
Map<byte[],List<Cell>> familyCellMap) |
protected void |
HRegion.MutationBatchOperation.cacheSkipWALMutationForRegionReplication(MiniBatchOperationInProgress<Mutation> miniBatchOp,
List<Pair<NonceKey,WALEdit>> nonceKeyAndWALEdits,
Map<byte[],List<Cell>> familyCellMap)
Here is for HBASE-26993,in order to make the new framework for region replication could work
for SKIP_WAL, we save the
Mutation which Mutation.getDurability() is
Durability.SKIP_WAL in miniBatchOp. |
protected void |
HRegion.ReplayBatchOperation.cacheSkipWALMutationForRegionReplication(MiniBatchOperationInProgress<Mutation> miniBatchOp,
List<Pair<NonceKey,WALEdit>> walEdits,
Map<byte[],List<Cell>> familyCellMap)
Deprecated.
|
private WALEdit |
HRegion.MutationBatchOperation.createWALEditForReplicateSkipWAL(MiniBatchOperationInProgress<Mutation> miniBatchOp,
List<Pair<NonceKey,WALEdit>> nonceKeyAndWALEdits) |
Constructor and Description |
---|
MiniBatchOperationInProgress(T[] operations,
OperationStatus[] retCodeDetails,
WALEdit[] walEditsFromCoprocessors,
int firstIndex,
int lastIndexExclusive,
int readyToWriteCount) |
Modifier and Type | Field and Description |
---|---|
(package private) WALEdit |
RegionReplicationSink.SinkEntry.edit |
Modifier and Type | Method and Description |
---|---|
void |
RegionReplicationSink.add(WALKeyImpl key,
WALEdit edit,
ServerCall<?> rpcCall)
Add this edit to replication queue.
|
Constructor and Description |
---|
SinkEntry(WALKeyImpl key,
WALEdit edit,
ServerCall<?> rpcCall) |
Modifier and Type | Method and Description |
---|---|
protected long |
AbstractFSWAL.append(RegionInfo hri,
WALKeyImpl key,
WALEdit edits,
boolean inMemstore)
Append a set of edits to the WAL.
|
long |
AbstractFSWAL.appendData(RegionInfo info,
WALKeyImpl key,
WALEdit edits) |
long |
AbstractFSWAL.appendMarker(RegionInfo info,
WALKeyImpl key,
WALEdit edits) |
private static WALKeyImpl |
WALUtil.doFullMarkerAppendTransaction(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
WALEdit edit,
MultiVersionConcurrencyControl mvcc,
Map<String,byte[]> extendedAttributes,
boolean sync,
RegionReplicationSink sink)
A 'full' WAL transaction involves starting an mvcc transaction followed by an append, an
optional sync, and then a call to complete the mvcc transaction.
|
static void |
WALUtil.filterCells(WALEdit edit,
Function<Cell,Cell> mapper) |
void |
MetricsWAL.postAppend(long size,
long time,
WALKey logkey,
WALEdit logEdit) |
default void |
WALActionsListener.postAppend(long entryLen,
long elapsedTimeMillis,
WALKey logKey,
WALEdit logEdit)
For notification post append to the writer.
|
void |
WALCoprocessorHost.postWALWrite(RegionInfo info,
WALKey logKey,
WALEdit logEdit) |
void |
WALCoprocessorHost.preWALWrite(RegionInfo info,
WALKey logKey,
WALEdit logEdit) |
protected long |
AbstractFSWAL.stampSequenceIdAndPublishToRingBuffer(RegionInfo hri,
WALKeyImpl key,
WALEdit edits,
boolean inMemstore,
com.lmax.disruptor.RingBuffer<RingBufferTruck> ringBuffer) |
default void |
WALActionsListener.visitLogEntryBeforeWrite(RegionInfo info,
WALKey logKey,
WALEdit logEdit)
Called before each write.
|
private static WALKeyImpl |
WALUtil.writeMarker(WAL wal,
NavigableMap<byte[],Integer> replicationScope,
RegionInfo hri,
WALEdit edit,
MultiVersionConcurrencyControl mvcc,
Map<String,byte[]> extendedAttributes,
RegionReplicationSink sink) |
Constructor and Description |
---|
FSWALEntry(long txid,
WALKeyImpl key,
WALEdit edit,
RegionInfo regionInfo,
boolean inMemstore,
ServerCall<?> rpcCall) |
Modifier and Type | Method and Description |
---|---|
private void |
ReplicationSourceShipper.cleanUpHFileRefs(WALEdit edit) |
private Pair<Integer,Integer> |
ReplicationSourceWALReader.countDistinctRowKeysAndHFiles(WALEdit edit)
Count the number of different row keys in the given edit because of mini-batching.
|
(package private) static void |
ReplicationSourceWALActionListener.scopeWALEdits(WALKey logKey,
WALEdit logEdit,
org.apache.hadoop.conf.Configuration conf)
Utility method used to set the correct scopes on each log key.
|
private int |
ReplicationSourceWALReader.sizeOfStoreFilesIncludeBulkLoad(WALEdit edit)
Calculate the total size of all the store files
|
void |
ReplicationSourceWALActionListener.visitLogEntryBeforeWrite(RegionInfo info,
WALKey logKey,
WALEdit logEdit) |
Modifier and Type | Method and Description |
---|---|
void |
AccessController.postDelete(ObserverContext<RegionCoprocessorEnvironment> c,
Delete delete,
WALEdit edit,
Durability durability) |
void |
AccessController.postPut(ObserverContext<RegionCoprocessorEnvironment> c,
Put put,
WALEdit edit,
Durability durability) |
void |
AccessController.preDelete(ObserverContext<RegionCoprocessorEnvironment> c,
Delete delete,
WALEdit edit,
Durability durability) |
void |
AccessController.prePut(ObserverContext<RegionCoprocessorEnvironment> c,
Put put,
WALEdit edit,
Durability durability) |
Modifier and Type | Field and Description |
---|---|
private WALEdit |
WAL.Entry.edit |
Modifier and Type | Method and Description |
---|---|
WALEdit |
WALEdit.add(Cell cell) |
WALEdit |
WALEdit.add(Cell cell,
byte[] family) |
WALEdit |
WALEdit.add(List<Cell> cells) |
private WALEdit |
WALEdit.addCell(Cell cell) |
static WALEdit |
WALEdit.createBulkLoadEvent(RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.BulkLoadDescriptor bulkLoadDescriptor)
Create a bulk loader WALEdit
|
static WALEdit |
WALEdit.createCompaction(RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.CompactionDescriptor c)
Returns A Marker WALEdit that has
c serialized as its value |
static WALEdit |
WALEdit.createFlushWALEdit(RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.FlushDescriptor f) |
static WALEdit |
WALEdit.createRegionEventWALEdit(byte[] rowForRegion,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.RegionEventDescriptor regionEventDesc) |
static WALEdit |
WALEdit.createRegionEventWALEdit(RegionInfo hri,
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.RegionEventDescriptor regionEventDesc) |
static WALEdit |
WALEdit.createReplicationMarkerEdit(byte[] rowKey,
long timestamp)
Creates a replication tracker edit with
METAFAMILY family and
REPLICATION_MARKER qualifier and has null value. |
WALEdit |
WAL.Entry.getEdit()
Gets the edit
|
Modifier and Type | Method and Description |
---|---|
private long |
DisabledWALProvider.DisabledWAL.append(RegionInfo info,
WALKeyImpl key,
WALEdit edits,
boolean inMemstore) |
long |
DisabledWALProvider.DisabledWAL.appendData(RegionInfo info,
WALKeyImpl key,
WALEdit edits) |
long |
WAL.appendData(RegionInfo info,
WALKeyImpl key,
WALEdit edits)
Append a set of data edits to the WAL.
|
long |
DisabledWALProvider.DisabledWAL.appendMarker(RegionInfo info,
WALKeyImpl key,
WALEdit edits) |
long |
WAL.appendMarker(RegionInfo info,
WALKeyImpl key,
WALEdit edits)
Append an operational 'meta' event marker edit to the WAL.
|
static boolean |
WALEdit.isReplicationMarkerEdit(WALEdit edit)
Checks whether this edit is a replication marker edit.
|
Modifier and Type | Method and Description |
---|---|
static List<WALSplitUtil.MutationReplay> |
WALSplitUtil.getMutationsFromWALEntry(org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos.WALEntry entry,
CellScanner cells,
Pair<WALKey,WALEdit> logEntry,
Durability durability)
Deprecated.
Since 3.0.0, will be removed in 4.0.0.
|
Constructor and Description |
---|
Entry(WALKeyImpl key,
WALEdit edit)
Constructor for both params
|
WALEdit(WALEdit walEdit)
Create a new WALEdit from a existing
WALEdit . |
Copyright © 2007–2020 The Apache Software Foundation. All rights reserved.