ReplicationSource.ReplicationSourceWorkerThread (Apache HBase 1.2.12 API)

java.lang.Object
- java.lang.Thread
- - org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.ReplicationSourceWorkerThread

All Implemented Interfaces:: Runnable

Enclosing class:: ReplicationSource

public class ReplicationSource.ReplicationSourceWorkerThread
extends Thread

Nested Class Summary
- Nested classes/interfaces inherited from class java.lang.Thread
  Thread.State, Thread.UncaughtExceptionHandler

Field Summary

Fields
Modifier and Type	Field and Description
`private int`	`currentNbOperations`
`private org.apache.hadoop.fs.Path`	`currentPath`
`private int`	`currentSize`
`private long`	`lastLoggedPosition`
`private PriorityBlockingQueue<org.apache.hadoop.fs.Path>`	`queue`
`private WAL.Reader`	`reader`
`private ReplicationQueueInfo`	`replicationQueueInfo`
`private ReplicationWALReaderManager`	`repLogReader`
`private ReplicationSource`	`source`
`private ReplicationSource.WorkerState`	`state`
`private String`	`walGroupId`

Fields inherited from class java.lang.Thread
MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors
Constructor and Description
`ReplicationSource.ReplicationSourceWorkerThread(String walGroupId, PriorityBlockingQueue<org.apache.hadoop.fs.Path> queue, ReplicationQueueInfo replicationQueueInfo, ReplicationSource source)`

Method Summary

Methods
Modifier and Type	Method and Description
`private int`	`countDistinctRowKeys(WALEdit edit)` Count the number of different row keys in the given edit because of mini-batching.
`org.apache.hadoop.fs.Path`	`getCurrentPath()`
`long`	`getCurrentPosition()`
`protected boolean`	`getNextPath()` Poll for the next path
`ReplicationSource.WorkerState`	`getWorkerState()` Get the current state of this worker.
`private boolean`	`isCurrentLogEmpty()`
`private boolean`	`isWorkerActive()`
`protected boolean`	`openReader(int sleepMultiplier)` Open a reader on the current path
`protected boolean`	`processEndOfFile(boolean dumpOnlyIfZeroLength)` If the queue isn't empty, switch to the next one Else if this is a recovered queue, it means we're done! Else we'll just continue to try reading the log file
`protected boolean`	`readAllEntriesToReplicateOrNextFile(boolean currentWALisBeingWrittenTo, List<WAL.Entry> entries)` Read all the entries from the current log files and retain those that need to be replicated.
`private void`	`recoverLease(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path)`
`void`	`run()`
`void`	`setWorkerState(ReplicationSource.WorkerState state)` Set the worker state
`protected void`	`shipEdits(boolean currentWALisBeingWrittenTo, List<WAL.Entry> entries)` Do the shipping logic
`void`	`startup()`
`private void`	`terminate(String reason, Exception cause)`

Methods inherited from class java.lang.Thread
activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object
equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

source
```
private ReplicationSource source
```

walGroupId
```
private String walGroupId
```

queue

private PriorityBlockingQueue<org.apache.hadoop.fs.Path> queue

replicationQueueInfo

private ReplicationQueueInfo replicationQueueInfo

reader
```
private WAL.Reader reader
```

lastLoggedPosition
```
private long lastLoggedPosition
```

currentPath

private volatile org.apache.hadoop.fs.Path currentPath

repLogReader

private ReplicationWALReaderManager repLogReader

currentNbOperations
```
private int currentNbOperations
```

currentSize
```
private int currentSize
```

state

private ReplicationSource.WorkerState state

Constructor Detail

ReplicationSource.ReplicationSourceWorkerThread

public ReplicationSource.ReplicationSourceWorkerThread(String walGroupId,
                                               PriorityBlockingQueue<org.apache.hadoop.fs.Path> queue,
                                               ReplicationQueueInfo replicationQueueInfo,
                                               ReplicationSource source)

Method Detail
- run
```
public void run()
```
  Specified by:
  
  run in interface Runnable
  
  Overrides:
  
  run in class Thread
- readAllEntriesToReplicateOrNextFile
```
protected boolean readAllEntriesToReplicateOrNextFile(boolean currentWALisBeingWrittenTo,
                                          List<WAL.Entry> entries)
                                               throws IOException
```
  Read all the entries from the current log files and retain those that need to be replicated. Else, process the end of the current file.
  
  Parameters:
  currentWALisBeingWrittenTo - is the current WAL being written to
  entries - resulting entries to be replicated
  
  Returns:
  true if we got nothing and went to the next file, false if we got entries
  
  Throws:
  
  IOException
- getNextPath
```
protected boolean getNextPath()
```
  Poll for the next path
  
  Returns:
  true if a path was obtained, false if not
- openReader
```
protected boolean openReader(int sleepMultiplier)
```
  Open a reader on the current path
  
  Parameters:
  sleepMultiplier - by how many times the default sleeping time is augmented
  
  Returns:
  true if we should continue with that file, false if we are over with it
- recoverLease
```
private void recoverLease(org.apache.hadoop.conf.Configuration conf,
                org.apache.hadoop.fs.Path path)
```
- isCurrentLogEmpty
```
private boolean isCurrentLogEmpty()
```
- countDistinctRowKeys
```
private int countDistinctRowKeys(WALEdit edit)
```
  Count the number of different row keys in the given edit because of mini-batching. We assume that there's at least one Cell in the WALEdit.
  
  Parameters:
  edit - edit to count row keys from
  
  Returns:
  number of different row keys
- shipEdits
```
protected void shipEdits(boolean currentWALisBeingWrittenTo,
             List<WAL.Entry> entries)
```
  Do the shipping logic
  
  Parameters:
  currentWALisBeingWrittenTo - was the current WAL being (seemingly) written to when this method was called
- processEndOfFile
```
protected boolean processEndOfFile(boolean dumpOnlyIfZeroLength)
```
  If the queue isn't empty, switch to the next one Else if this is a recovered queue, it means we're done! Else we'll just continue to try reading the log file
  
  Returns:
  true if we're done with the current file, false if we should continue trying to read from it
- startup
```
public void startup()
```
- getCurrentPath
```
public org.apache.hadoop.fs.Path getCurrentPath()
```
- getCurrentPosition
```
public long getCurrentPosition()
```
- isWorkerActive
```
private boolean isWorkerActive()
```
- terminate
```
private void terminate(String reason,
             Exception cause)
```
- setWorkerState
```
public void setWorkerState(ReplicationSource.WorkerState state)
```
  Set the worker state
  
  Parameters:
  state -
- getWorkerState
```
public ReplicationSource.WorkerState getWorkerState()
```
  Get the current state of this worker.
  
  Returns:
  WorkerState

Class ReplicationSource.ReplicationSourceWorkerThread

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

Field Summary

Fields inherited from class java.lang.Thread

Constructor Summary

Method Summary

Methods inherited from class java.lang.Thread

Methods inherited from class java.lang.Object

Field Detail

source

walGroupId

queue

replicationQueueInfo

reader

lastLoggedPosition

currentPath

repLogReader

currentNbOperations

currentSize

state

Constructor Detail

ReplicationSource.ReplicationSourceWorkerThread

Method Detail

run

readAllEntriesToReplicateOrNextFile

getNextPath

openReader

recoverLease

isCurrentLogEmpty

countDistinctRowKeys

shipEdits

processEndOfFile

startup

getCurrentPath

getCurrentPosition

isWorkerActive

terminate

setWorkerState

getWorkerState