org.apache.hadoop.hbase.wal

Class WALKeyImpl

java.lang.Object

org.apache.hadoop.hbase.wal.WALKeyImpl

All Implemented Interfaces:

Comparable<WALKey>, SequenceId, WALKey

@InterfaceAudience.LimitedPrivate(value="Replication")
public class WALKeyImpl
extends Object
implements WALKey

Default implementation of Key for an Entry in the WAL. For internal use only though Replication needs to have access. The log intermingles edits to many tables and rows, so each log entry identifies the appropriate table and row. Within a table and row, they're also sorted.

Some Transactional edits (START, COMMIT, ABORT) will not have an associated row.

Field Summary

Fields

Modifier and Type	Field and Description
private List<UUID>	clusterIds The first element in the list is the cluster id on which the change has originated
private CompressionContext	compressionContext
static WALKeyImpl	EMPTY_WALKEYIMPL
private byte[]	encodedRegionName
private MultiVersionConcurrencyControl	mvcc
private long	nonce
private long	nonceGroup
private long	origLogSeqNum Used during WAL replay; the sequenceId of the edit when it came into the system.
private NavigableMap<byte[],Integer>	replicationScope
private long	sequenceId SequenceId for this edit.
private TableName	tablename
private MultiVersionConcurrencyControl.WriteEntry	writeEntry Set in a way visible to multiple threads; e.g.
private long	writeTime Time at which this edit was written.

Fields inherited from interface org.apache.hadoop.hbase.wal.WALKey

EMPTY_UUIDS

Fields inherited from interface org.apache.hadoop.hbase.regionserver.SequenceId

NO_SEQUENCE_ID

Constructor Summary

Constructors

Constructor and Description
WALKeyImpl()
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long now)
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long now, List<UUID> clusterIds, long nonceGroup, long nonce, MultiVersionConcurrencyControl mvcc) Create the log key for writing to somewhere.
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long now, List<UUID> clusterIds, long nonceGroup, long nonce, MultiVersionConcurrencyControl mvcc, NavigableMap<byte[],Integer> replicationScope) Create the log key for writing to somewhere.
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long logSeqNum, long now, List<UUID> clusterIds, long nonceGroup, long nonce, MultiVersionConcurrencyControl mvcc) Create the log key for writing to somewhere.
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long logSeqNum, long now, List<UUID> clusterIds, long nonceGroup, long nonce, MultiVersionConcurrencyControl mvcc, NavigableMap<byte[],Integer> replicationScope) Create the log key for writing to somewhere.
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long logSeqNum, long nonceGroup, long nonce, MultiVersionConcurrencyControl mvcc) Create the log key for writing to somewhere.
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long logSeqNum, long now, UUID clusterId)
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long now, MultiVersionConcurrencyControl mvcc)
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long now, MultiVersionConcurrencyControl mvcc, NavigableMap<byte[],Integer> replicationScope)
WALKeyImpl(byte[] encodedRegionName, TableName tablename, long now, NavigableMap<byte[],Integer> replicationScope)
WALKeyImpl(NavigableMap<byte[],Integer> replicationScope)

Method Summary

Modifier and Type	Method and Description
void	addClusterId(UUID clusterId) Marks that the cluster with the given clusterId has consumed the change
int	compareTo(WALKey o)
boolean	equals(Object obj)
long	estimatedSerializedSizeOf()
org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.WALKey.Builder	getBuilder(WALCellCodec.ByteStringCompressor compressor)
List<UUID>	getClusterIds()
byte[]	getEncodedRegionName()
long	getLogSeqNum() Deprecated. Use getSequenceId()
MultiVersionConcurrencyControl	getMvcc()
long	getNonce()
long	getNonceGroup()
UUID	getOriginatingClusterId()
long	getOrigLogSeqNum() Return a positive long if current WALKeyImpl is created from a replay edit; a replay edit is an edit that came in when replaying WALs of a crashed server.
NavigableMap<byte[],Integer>	getReplicationScopes()
long	getSequenceId() SequenceId is only available post WAL-assign.
TableName	getTableName()
MultiVersionConcurrencyControl.WriteEntry	getWriteEntry() Use it to complete mvcc transaction.
long	getWriteTime()
int	hashCode()
protected void	init(byte[] encodedRegionName, TableName tablename, long logSeqNum, long now, List<UUID> clusterIds, long nonceGroup, long nonce, MultiVersionConcurrencyControl mvcc, NavigableMap<byte[],Integer> replicationScope)
(package private) void	internEncodedRegionName(byte[] encodedRegionName) Drop this instance's region name byte array and instead hold a reference to the provided region name.
(package private) void	internTableName(TableName tablename) Drop this instance's tablename byte array and instead hold a reference to the provided tablename.
void	readFieldsFromPb(org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.WALKey walKey, WALCellCodec.ByteStringUncompressor uncompressor)
void	serializeReplicationScope(boolean serialize)
void	setCompressionContext(CompressionContext compressionContext)
void	setOrigLogSeqNum(long sequenceId) Used to set original sequenceId for WALKeyImpl during WAL replay
private void	setReplicationScope(NavigableMap<byte[],Integer> replicationScope)
protected void	setSequenceId(long sequenceId)
void	setWriteEntry(MultiVersionConcurrencyControl.WriteEntry writeEntry)
String	toString()

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.wal.WALKey

toStringMap

Field Detail

EMPTY_WALKEYIMPL

public static final WALKeyImpl EMPTY_WALKEYIMPL

encodedRegionName

private byte[] encodedRegionName

tablename

private TableName tablename

sequenceId

private long sequenceId

SequenceId for this edit. Set post-construction at write-to-WAL time. Until then it is NO_SEQUENCE_ID. Change it so multiple threads can read it -- e.g. access is synchronized.

origLogSeqNum

private long origLogSeqNum

Used during WAL replay; the sequenceId of the edit when it came into the system.

writeTime

private long writeTime

Time at which this edit was written.

clusterIds

private List<UUID> clusterIds

The first element in the list is the cluster id on which the change has originated

replicationScope

private NavigableMap<byte[],Integer> replicationScope

nonceGroup

private long nonceGroup

nonce

private long nonce

mvcc

private MultiVersionConcurrencyControl mvcc

writeEntry

private MultiVersionConcurrencyControl.WriteEntry writeEntry

Set in a way visible to multiple threads; e.g. synchronized getter/setters.

compressionContext

private CompressionContext compressionContext

Constructor Detail

WALKeyImpl

public WALKeyImpl()

WALKeyImpl

public WALKeyImpl(NavigableMap<byte[],Integer> replicationScope)

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long logSeqNum,
                  long now,
                  UUID clusterId)

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long now)

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long now,
                  NavigableMap<byte[],Integer> replicationScope)

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long now,
                  MultiVersionConcurrencyControl mvcc,
                  NavigableMap<byte[],Integer> replicationScope)

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long now,
                  MultiVersionConcurrencyControl mvcc)

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long logSeqNum,
                  long now,
                  List<UUID> clusterIds,
                  long nonceGroup,
                  long nonce,
                  MultiVersionConcurrencyControl mvcc,
                  NavigableMap<byte[],Integer> replicationScope)

Create the log key for writing to somewhere. We maintain the tablename mainly for debugging purposes. A regionName is always a sub-table object.

Used by log splitting and snapshots.

Parameters:

encodedRegionName - Encoded name of the region as returned by HRegionInfo#getEncodedNameAsBytes().

tablename - - name of table

logSeqNum - - log sequence number

now - Time at which this edit was written.

clusterIds - the clusters that have consumed the change(used in Replication)

nonceGroup - the nonceGroup

nonce - the nonce

mvcc - the mvcc associate the WALKeyImpl

replicationScope - the non-default replication scope associated with the region's column families

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long logSeqNum,
                  long now,
                  List<UUID> clusterIds,
                  long nonceGroup,
                  long nonce,
                  MultiVersionConcurrencyControl mvcc)

Create the log key for writing to somewhere. We maintain the tablename mainly for debugging purposes. A regionName is always a sub-table object.

Used by log splitting and snapshots.

Parameters:

encodedRegionName - Encoded name of the region as returned by HRegionInfo#getEncodedNameAsBytes().

tablename - - name of table

logSeqNum - - log sequence number

now - Time at which this edit was written.

clusterIds - the clusters that have consumed the change(used in Replication)

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long now,
                  List<UUID> clusterIds,
                  long nonceGroup,
                  long nonce,
                  MultiVersionConcurrencyControl mvcc)

Create the log key for writing to somewhere. We maintain the tablename mainly for debugging purposes. A regionName is always a sub-table object.

Parameters:

encodedRegionName - Encoded name of the region as returned by HRegionInfo#getEncodedNameAsBytes().

tablename - the tablename

now - Time at which this edit was written.

clusterIds - the clusters that have consumed the change(used in Replication)

nonceGroup -

nonce -

mvcc - mvcc control used to generate sequence numbers and control read/write points

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long now,
                  List<UUID> clusterIds,
                  long nonceGroup,
                  long nonce,
                  MultiVersionConcurrencyControl mvcc,
                  NavigableMap<byte[],Integer> replicationScope)

Create the log key for writing to somewhere. We maintain the tablename mainly for debugging purposes. A regionName is always a sub-table object.

Parameters:

encodedRegionName - Encoded name of the region as returned by HRegionInfo#getEncodedNameAsBytes().

tablename -

now - Time at which this edit was written.

clusterIds - the clusters that have consumed the change(used in Replication)

nonceGroup - the nonceGroup

nonce - the nonce

mvcc - mvcc control used to generate sequence numbers and control read/write points

replicationScope - the non-default replication scope of the column families

WALKeyImpl

public WALKeyImpl(byte[] encodedRegionName,
                  TableName tablename,
                  long logSeqNum,
                  long nonceGroup,
                  long nonce,
                  MultiVersionConcurrencyControl mvcc)

Create the log key for writing to somewhere. We maintain the tablename mainly for debugging purposes. A regionName is always a sub-table object.

Parameters:

encodedRegionName - Encoded name of the region as returned by HRegionInfo#getEncodedNameAsBytes().

tablename -

logSeqNum -

nonceGroup -

nonce -

Method Detail

getMvcc

public MultiVersionConcurrencyControl getMvcc()

getWriteEntry

public MultiVersionConcurrencyControl.WriteEntry getWriteEntry()

Use it to complete mvcc transaction. This WALKeyImpl was part of (the transaction is started when you call append; see the comment on FSHLog#append). To complete call MultiVersionConcurrencyControl.complete(MultiVersionConcurrencyControl.WriteEntry) or MultiVersionConcurrencyControl.complete(MultiVersionConcurrencyControl.WriteEntry)

Returns:

A WriteEntry gotten from local WAL subsystem.

See Also:

setWriteEntry(MultiVersionConcurrencyControl.WriteEntry)

setWriteEntry

public void setWriteEntry(MultiVersionConcurrencyControl.WriteEntry writeEntry)

init

@InterfaceAudience.Private
protected void init(byte[] encodedRegionName,
                                               TableName tablename,
                                               long logSeqNum,
                                               long now,
                                               List<UUID> clusterIds,
                                               long nonceGroup,
                                               long nonce,
                                               MultiVersionConcurrencyControl mvcc,
                                               NavigableMap<byte[],Integer> replicationScope)

setSequenceId

@InterfaceAudience.Private
protected void setSequenceId(long sequenceId)

setCompressionContext

public void setCompressionContext(CompressionContext compressionContext)

Parameters:

compressionContext - Compression context to use

getEncodedRegionName

public byte[] getEncodedRegionName()

Specified by:

getEncodedRegionName in interface WALKey

Returns:

encoded region name

getTableName

public TableName getTableName()

Specified by:

getTableName in interface WALKey

Returns:

table name

getLogSeqNum

@Deprecated
public long getLogSeqNum()

Deprecated. Use getSequenceId()

Returns:

log sequence number

setOrigLogSeqNum

public void setOrigLogSeqNum(long sequenceId)

Used to set original sequenceId for WALKeyImpl during WAL replay

getOrigLogSeqNum

public long getOrigLogSeqNum()

Return a positive long if current WALKeyImpl is created from a replay edit; a replay edit is an edit that came in when replaying WALs of a crashed server.

Specified by:

getOrigLogSeqNum in interface WALKey

Returns:

original sequence number of the WALEdit

getSequenceId

public long getSequenceId()

SequenceId is only available post WAL-assign. Calls before this will get you a SequenceId.NO_SEQUENCE_ID. See the comment on FSHLog#append and #getWriteNumber in this method for more on when this sequenceId comes available.

Specified by:

getSequenceId in interface SequenceId

Returns:

long the new assigned sequence number

getWriteTime

public long getWriteTime()

Specified by:

getWriteTime in interface WALKey

Returns:

the write time

getReplicationScopes

public NavigableMap<byte[],Integer> getReplicationScopes()

getNonceGroup

public long getNonceGroup()

Specified by:

getNonceGroup in interface WALKey

Returns:

The nonce group

getNonce

public long getNonce()

Specified by:

getNonce in interface WALKey

Returns:

The nonce

setReplicationScope

private void setReplicationScope(NavigableMap<byte[],Integer> replicationScope)

serializeReplicationScope

public void serializeReplicationScope(boolean serialize)

addClusterId

public void addClusterId(UUID clusterId)

Marks that the cluster with the given clusterId has consumed the change

getClusterIds

public List<UUID> getClusterIds()

Returns:

the set of cluster Ids that have consumed the change

getOriginatingClusterId

public UUID getOriginatingClusterId()

Specified by:

getOriginatingClusterId in interface WALKey

Returns:

the cluster id on which the change has originated. It there is no such cluster, it returns DEFAULT_CLUSTER_ID (cases where replication is not enabled)

toString

public String toString()

Overrides:

toString in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

hashCode

public int hashCode()

Overrides:

hashCode in class Object

compareTo

public int compareTo(WALKey o)

Specified by:

compareTo in interface Comparable<WALKey>

internTableName

void internTableName(TableName tablename)

Drop this instance's tablename byte array and instead hold a reference to the provided tablename. This is not meant to be a general purpose setter - it's only used to collapse references to conserve memory.

internEncodedRegionName

void internEncodedRegionName(byte[] encodedRegionName)

Drop this instance's region name byte array and instead hold a reference to the provided region name. This is not meant to be a general purpose setter - it's only used to collapse references to conserve memory.

getBuilder

public org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.WALKey.Builder getBuilder(WALCellCodec.ByteStringCompressor compressor)
                                                                                      throws IOException

Throws:

IOException

readFieldsFromPb

public void readFieldsFromPb(org.apache.hadoop.hbase.shaded.protobuf.generated.WALProtos.WALKey walKey,
                             WALCellCodec.ByteStringUncompressor uncompressor)
                      throws IOException

Throws:

IOException

estimatedSerializedSizeOf

public long estimatedSerializedSizeOf()

Specified by:

estimatedSerializedSizeOf in interface WALKey