org.apache.hadoop.hbase.master

Class HbckChore

java.lang.Object

org.apache.hadoop.hbase.ScheduledChore

org.apache.hadoop.hbase.master.HbckChore

All Implemented Interfaces:

Runnable

@InterfaceAudience.Private
 @InterfaceStability.Evolving
public class HbckChore
extends ScheduledChore

Used to do the hbck checking job at master side.

Field Summary

Fields

Modifier and Type	Field and Description
private long	checkingEndTimestamp
private long	checkingStartTimestamp
private static int	DEFAULT_HBCK_CHORE_INTERVAL
private boolean	disabled
private Set<String>	disabledTableRegions
private static String	HBCK_CHORE_INTERVAL
private Map<String,Pair<ServerName,List<ServerName>>>	inconsistentRegions The inconsistent regions.
private Map<String,Pair<ServerName,List<ServerName>>>	inconsistentRegionsSnapshot
private static org.slf4j.Logger	LOG
private MasterServices	master
private Map<String,org.apache.hadoop.fs.Path>	orphanRegionsOnFS The regions have directory on FileSystem, but no region info in meta.
private Map<String,org.apache.hadoop.fs.Path>	orphanRegionsOnFSSnapshot
private Map<String,ServerName>	orphanRegionsOnRS The regions only opened on RegionServers, but no region info in meta.
private Map<String,ServerName>	orphanRegionsOnRSSnapshot The "snapshot" is used to save the last round's HBCK checking report.
private Map<String,HbckRegionInfo>	regionInfoMap This map contains the state of all hbck items.
private boolean	running When running, the "snapshot" may be changed when this round's checking finish.
(package private) ReentrantReadWriteLock	rwLock The "snapshot" may be changed after checking.
private Set<String>	splitParentRegions

Constructor Summary

Constructors

Constructor and Description
HbckChore(MasterServices master)

Method Summary

Modifier and Type	Method and Description
protected void	chore() The task to execute on each scheduled execution of the Chore
private void	disableChore()
long	getCheckingEndTimestamp() Used for web ui to show when the HBCK checking report generated.
long	getCheckingStartTimestamp() Used for web ui to show when the HBCK checking started.
Map<String,Pair<ServerName,List<ServerName>>>	getInconsistentRegions() Found the inconsistent regions.
Map<String,org.apache.hadoop.fs.Path>	getOrphanRegionsOnFS()
Map<String,ServerName>	getOrphanRegionsOnRS()
boolean	isDisabled()
boolean	isRunning() When running, the HBCK report may be changed later.
private void	loadRegionsFromFS(HashSet<String> mergedParentRegions)
private void	loadRegionsFromInMemoryState()
private void	loadRegionsFromRSReport()
protected boolean	runChore()
private void	saveCheckResultToSnapshot()
private HashSet<String>	scanForMergedParentRegions() Scan hbase:meta to get set of merged parent regions, this is a very heavy scan.

Methods inherited from class org.apache.hadoop.hbase.ScheduledChore

cancel, cancel, choreForTesting, cleanup, getInitialDelay, getName, getPeriod, getStopper, getTimeUnit, initialChore, isInitialChoreComplete, isScheduled, run, toString, triggerNow

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

HBCK_CHORE_INTERVAL

private static final String HBCK_CHORE_INTERVAL

See Also:

Constant Field Values

DEFAULT_HBCK_CHORE_INTERVAL

private static final int DEFAULT_HBCK_CHORE_INTERVAL

See Also:

Constant Field Values

master

private final MasterServices master

regionInfoMap

private final Map<String,HbckRegionInfo> regionInfoMap

This map contains the state of all hbck items. It maps from encoded region name to HbckRegionInfo structure. The information contained in HbckRegionInfo is used to detect and correct consistency (hdfs/meta/deployment) problems.

disabledTableRegions

private final Set<String> disabledTableRegions

splitParentRegions

private final Set<String> splitParentRegions

orphanRegionsOnRS

private final Map<String,ServerName> orphanRegionsOnRS

The regions only opened on RegionServers, but no region info in meta.

orphanRegionsOnFS

private final Map<String,org.apache.hadoop.fs.Path> orphanRegionsOnFS

The regions have directory on FileSystem, but no region info in meta.

inconsistentRegions

private final Map<String,Pair<ServerName,List<ServerName>>> inconsistentRegions

The inconsistent regions. There are three case: case 1. Master thought this region opened, but no regionserver reported it. case 2. Master thought this region opened on Server1, but regionserver reported Server2 case 3. More than one regionservers reported opened this region

orphanRegionsOnRSSnapshot

private final Map<String,ServerName> orphanRegionsOnRSSnapshot

The "snapshot" is used to save the last round's HBCK checking report.

orphanRegionsOnFSSnapshot

private final Map<String,org.apache.hadoop.fs.Path> orphanRegionsOnFSSnapshot

inconsistentRegionsSnapshot

private final Map<String,Pair<ServerName,List<ServerName>>> inconsistentRegionsSnapshot

rwLock

ReentrantReadWriteLock rwLock

The "snapshot" may be changed after checking. And this checking report "snapshot" may be accessed by web ui. Use this rwLock to synchronize.

running

private volatile boolean running

When running, the "snapshot" may be changed when this round's checking finish.

checkingStartTimestamp

private volatile long checkingStartTimestamp

checkingEndTimestamp

private volatile long checkingEndTimestamp

disabled

private boolean disabled

Constructor Detail

HbckChore

public HbckChore(MasterServices master)

Method Detail

chore

protected void chore()

Description copied from class: ScheduledChore

The task to execute on each scheduled execution of the Chore

Specified by:

chore in class ScheduledChore

runChore

protected boolean runChore()

disableChore

private void disableChore()

isDisabled

public boolean isDisabled()

saveCheckResultToSnapshot

private void saveCheckResultToSnapshot()

scanForMergedParentRegions

private HashSet<String> scanForMergedParentRegions()
                                            throws IOException

Scan hbase:meta to get set of merged parent regions, this is a very heavy scan.

Returns:

Return generated HashSet

Throws:

IOException

loadRegionsFromInMemoryState

private void loadRegionsFromInMemoryState()

loadRegionsFromRSReport

private void loadRegionsFromRSReport()

loadRegionsFromFS

private void loadRegionsFromFS(HashSet<String> mergedParentRegions)
                        throws IOException

Throws:

IOException

isRunning

public boolean isRunning()

When running, the HBCK report may be changed later.

getOrphanRegionsOnRS

public Map<String,ServerName> getOrphanRegionsOnRS()

Returns:

the regions only opened on RegionServers, but no region info in meta.

getOrphanRegionsOnFS

public Map<String,org.apache.hadoop.fs.Path> getOrphanRegionsOnFS()

Returns:

the regions have directory on FileSystem, but no region info in meta.

getInconsistentRegions

public Map<String,Pair<ServerName,List<ServerName>>> getInconsistentRegions()

Found the inconsistent regions. There are three case: case 1. Master thought this region opened, but no regionserver reported it. case 2. Master thought this region opened on Server1, but regionserver reported Server2 case 3. More than one regionservers reported opened this region

Returns:

the map of inconsistent regions. Key is the region name. Value is a pair of location in meta and the regionservers which reported opened this region.

getCheckingStartTimestamp

public long getCheckingStartTimestamp()

Used for web ui to show when the HBCK checking started.

getCheckingEndTimestamp

public long getCheckingEndTimestamp()

Used for web ui to show when the HBCK checking report generated.