org.apache.hadoop.hbase.procedure2.store.wal

Class ProcedureStoreTracker

java.lang.Object

org.apache.hadoop.hbase.procedure2.store.wal.ProcedureStoreTracker

Deprecated.

Since 2.3.0, will be removed in 4.0.0. Keep here only for rolling upgrading, now we use the new region based procedure store.

@Deprecated
 @InterfaceAudience.Private
class ProcedureStoreTracker
extends Object

Keeps track of live procedures. It can be used by the ProcedureStore to identify which procedures are already deleted/completed to avoid the deserialization step on restart

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ProcedureStoreTracker.DeleteState Deprecated.

Field Summary

Fields

Modifier and Type	Field and Description
private boolean	keepDeletes Deprecated. If true, do not remove bits corresponding to deleted procedures.
private static org.slf4j.Logger	LOG Deprecated.
private TreeMap<Long,BitSetNode>	map Deprecated.
private long	maxModifiedProcId Deprecated.
private long	minModifiedProcId Deprecated.
(package private) boolean	partial Deprecated. If true, it means tracker has incomplete information about the active/deleted procedures.

Constructor Summary

Constructors

Constructor and Description
ProcedureStoreTracker() Deprecated.

Method Summary

Modifier and Type	Method and Description
private BitSetNode	delete(BitSetNode node, long procId) Deprecated.
void	delete(long procId) Deprecated.
void	delete(long[] procIds) Deprecated.
void	dump() Deprecated.
long	getActiveMinProcId() Deprecated.
long[]	getAllActiveProcIds() Deprecated. Will be used when there are too many proc wal files.
long	getModifiedMaxProcId() Deprecated.
long	getModifiedMinProcId() Deprecated.
private BitSetNode	getOrCreateNode(long procId) Deprecated.
private BitSetNode	growNode(BitSetNode node, long procId) Deprecated. Grows node to contain procId and updates the map.
private BitSetNode	insert(BitSetNode node, long procId) Deprecated.
void	insert(long procId) Deprecated.
void	insert(long[] procIds) Deprecated.
void	insert(long procId, long[] subProcIds) Deprecated.
boolean	isAllModified() Deprecated.
ProcedureStoreTracker.DeleteState	isDeleted(long procId) Deprecated. If partial is false, returns state from the bitmap.
boolean	isEmpty() Deprecated. Returns true, if no procedure is active, else false.
boolean	isModified(long procId) Deprecated.
boolean	isPartial() Deprecated.
private BitSetNode	lookupClosestNode(BitSetNode node, long procId) Deprecated. lookup the node containing the specified procId.
private BitSetNode	mergeNodes(BitSetNode leftNode, BitSetNode rightNode) Deprecated. Merges leftNode & rightNode and updates the map.
void	reset() Deprecated.
void	resetModified() Deprecated. Clears the list of updated procedure ids.
void	resetTo(ProcedureStoreTracker tracker) Deprecated. Resets internal state to same as given tracker.
void	resetTo(ProcedureStoreTracker tracker, boolean resetDelete) Deprecated. Resets internal state to same as given tracker, and change the deleted flag according to the modified flag if resetDelete is true.
void	resetToProto(org.apache.hadoop.hbase.shaded.protobuf.generated.ProcedureProtos.ProcedureStoreTracker trackerProtoBuf) Deprecated.
void	setDeleted(long procId, boolean isDeleted) Deprecated. This method is used when restarting where we need to rebuild the ProcedureStoreTracker.
void	setDeletedIfDeletedByThem(ProcedureStoreTracker tracker) Deprecated. For the global tracker, we will use this method to build the holdingCleanupTracker, as the modified flags will be cleared after rolling so we only need to test the deleted flags.
void	setDeletedIfModified(long... procId) Deprecated. Set the given bit for the procId to delete if it was modified before.
void	setDeletedIfModifiedInBoth(ProcedureStoreTracker tracker) Deprecated. Similar with setDeletedIfModified(long...), but here the procId are given by the tracker.
private void	setDeleteIf(ProcedureStoreTracker tracker, BiFunction<BitSetNode,Long,Boolean> func) Deprecated.
void	setKeepDeletes(boolean keepDeletes) Deprecated.
void	setMinMaxModifiedProcIds(long min, long max) Deprecated. Will be called when restarting where we need to rebuild the ProcedureStoreTracker.
void	setPartialFlag(boolean isPartial) Deprecated.
org.apache.hadoop.hbase.shaded.protobuf.generated.ProcedureProtos.ProcedureStoreTracker	toProto() Deprecated. Builds org.apache.hadoop.hbase.protobuf.generated.ProcedureProtos.ProcedureStoreTracker protocol buffer from current state.
private void	trackProcIds(long procId) Deprecated.
private BitSetNode	update(BitSetNode node, long procId) Deprecated.
void	update(long procId) Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

Deprecated.

map

private final TreeMap<Long,BitSetNode> map

Deprecated.

keepDeletes

private boolean keepDeletes

Deprecated.

If true, do not remove bits corresponding to deleted procedures. Note that this can result in huge bitmaps overtime. Currently, it's set to true only when building tracker state from logs during recovery. During recovery, if we are sure that a procedure has been deleted, reading its old update entries can be skipped.

partial

boolean partial

Deprecated.

If true, it means tracker has incomplete information about the active/deleted procedures. It's set to true only when recovering from old logs. See isDeleted(long) docs to understand it's real use.

minModifiedProcId

private long minModifiedProcId

Deprecated.

maxModifiedProcId

private long maxModifiedProcId

Deprecated.

Constructor Detail

ProcedureStoreTracker

ProcedureStoreTracker()

Deprecated.

Method Detail

resetToProto

public void resetToProto(org.apache.hadoop.hbase.shaded.protobuf.generated.ProcedureProtos.ProcedureStoreTracker trackerProtoBuf)

Deprecated.

resetTo

public void resetTo(ProcedureStoreTracker tracker)

Deprecated.

Resets internal state to same as given tracker. Does deep copy of the bitmap.

resetTo

public void resetTo(ProcedureStoreTracker tracker,
                    boolean resetDelete)

Deprecated.

Resets internal state to same as given tracker, and change the deleted flag according to the modified flag if resetDelete is true. Does deep copy of the bitmap.

The resetDelete will be set to true when building cleanup tracker, please see the comments in BitSetNode(BitSetNode, boolean) to learn how we change the deleted flag if resetDelete is true.

insert

public void insert(long procId)

Deprecated.

insert

public void insert(long[] procIds)

Deprecated.

insert

public void insert(long procId,
                   long[] subProcIds)

Deprecated.

insert

private BitSetNode insert(BitSetNode node,
                          long procId)

Deprecated.

update

public void update(long procId)

Deprecated.

update

private BitSetNode update(BitSetNode node,
                          long procId)

Deprecated.

delete

public void delete(long procId)

Deprecated.

delete

public void delete(long[] procIds)

Deprecated.

delete

private BitSetNode delete(BitSetNode node,
                          long procId)

Deprecated.

setMinMaxModifiedProcIds

public void setMinMaxModifiedProcIds(long min,
                                     long max)

Deprecated.

Will be called when restarting where we need to rebuild the ProcedureStoreTracker.

setDeleted

public void setDeleted(long procId,
                       boolean isDeleted)

Deprecated.

This method is used when restarting where we need to rebuild the ProcedureStoreTracker. The delete(long) method above assume that the BitSetNode exists, but when restart this is not true, as we will read the wal files in reverse order so a delete may come first.

setDeletedIfModified

public void setDeletedIfModified(long... procId)

Deprecated.

Set the given bit for the procId to delete if it was modified before.

This method is used to test whether a procedure wal file can be safely deleted, as if all the procedures in the given procedure wal file has been modified in the new procedure wal files, then we can delete it.

setDeleteIf

private void setDeleteIf(ProcedureStoreTracker tracker,
                         BiFunction<BitSetNode,Long,Boolean> func)

Deprecated.

setDeletedIfDeletedByThem

public void setDeletedIfDeletedByThem(ProcedureStoreTracker tracker)

Deprecated.

For the global tracker, we will use this method to build the holdingCleanupTracker, as the modified flags will be cleared after rolling so we only need to test the deleted flags.

See Also:

setDeletedIfModifiedInBoth(ProcedureStoreTracker)

setDeletedIfModifiedInBoth

public void setDeletedIfModifiedInBoth(ProcedureStoreTracker tracker)

Deprecated.

Similar with setDeletedIfModified(long...), but here the procId are given by the tracker. If a procedure is modified by us, and also by the given tracker, then we mark it as deleted.

See Also:

setDeletedIfModified(long...)

lookupClosestNode

private BitSetNode lookupClosestNode(BitSetNode node,
                                     long procId)

Deprecated.

lookup the node containing the specified procId.

Parameters:

node - cached node to check before doing a lookup

procId - the procId to lookup

Returns:

the node that may contains the procId or null

trackProcIds

private void trackProcIds(long procId)

Deprecated.

getModifiedMinProcId

public long getModifiedMinProcId()

Deprecated.

getModifiedMaxProcId

public long getModifiedMaxProcId()

Deprecated.

reset

public void reset()

Deprecated.

isModified

public boolean isModified(long procId)

Deprecated.

isDeleted

public ProcedureStoreTracker.DeleteState isDeleted(long procId)

Deprecated.

If partial is false, returns state from the bitmap. If no state is found for procId, returns YES. If partial is true, tracker doesn't have complete view of system state, so it returns MAYBE if there is no update for the procedure or if it doesn't have a state in bitmap. Otherwise, returns state from the bitmap.

getActiveMinProcId

public long getActiveMinProcId()

Deprecated.

setKeepDeletes

public void setKeepDeletes(boolean keepDeletes)

Deprecated.

isPartial

public boolean isPartial()

Deprecated.

setPartialFlag

public void setPartialFlag(boolean isPartial)

Deprecated.

isEmpty

public boolean isEmpty()

Deprecated.

Returns true, if no procedure is active, else false.

isAllModified

public boolean isAllModified()

Deprecated.

Returns:

true if all procedure was modified or deleted since last call to resetModified().

getAllActiveProcIds

public long[] getAllActiveProcIds()

Deprecated.

Will be used when there are too many proc wal files. We will rewrite the states of the active procedures in the oldest proc wal file so that we can delete it.

Returns:

all the active procedure ids in this tracker.

resetModified

public void resetModified()

Deprecated.

Clears the list of updated procedure ids. This doesn't affect global list of active procedure ids.

getOrCreateNode

private BitSetNode getOrCreateNode(long procId)

Deprecated.

growNode

private BitSetNode growNode(BitSetNode node,
                            long procId)

Deprecated.

Grows node to contain procId and updates the map.

Returns:

BitSetNode instance which contains procId.

mergeNodes

private BitSetNode mergeNodes(BitSetNode leftNode,
                              BitSetNode rightNode)

Deprecated.

Merges leftNode & rightNode and updates the map.

dump

public void dump()

Deprecated.

toProto

public org.apache.hadoop.hbase.shaded.protobuf.generated.ProcedureProtos.ProcedureStoreTracker toProto()
                                                                                                throws IOException

Deprecated.

Builds org.apache.hadoop.hbase.protobuf.generated.ProcedureProtos.ProcedureStoreTracker protocol buffer from current state.

Throws:

IOException