HBaseFsck (Apache HBase 2.5.0 API)

java.lang.Object
- org.apache.hadoop.conf.Configured
- - org.apache.hadoop.hbase.util.HBaseFsck

All Implemented Interfaces:

Closeable, AutoCloseable, org.apache.hadoop.conf.Configurable

Deprecated.
For removal in hbase-4.0.0. Use HBCK2 instead.
```
@Deprecated
 @InterfaceAudience.LimitedPrivate(value="Tools")
 @InterfaceStability.Evolving
public class HBaseFsck
extends org.apache.hadoop.conf.Configured
implements Closeable
```
HBaseFsck (hbck) is a tool for checking and repairing region consistency and table integrity problems in a corrupted HBase. This tool was written for hbase-1.x. It does not work with hbase-2.x; it can read state but is not allowed to change state; i.e. effect 'repair'. Even though it can 'read' state, given how so much has changed in how hbase1 and hbase2 operate, it will often misread. See hbck2 (HBASE-19121) for a hbck tool for hbase2. This class is deprecated.
Region consistency checks verify that hbase:meta, region deployment on region servers and the state of data in HDFS (.regioninfo files) all are in accordance.
Table integrity checks verify that all possible row keys resolve to exactly one region of a table. This means there are no individual degenerate or backwards regions; no holes between regions; and that there are no overlapping regions.
The general repair strategy works in two phases:
1. Repair Table Integrity on HDFS. (merge or fabricate regions)
2. Repair Region Consistency with hbase:meta and assignments
For table integrity repairs, the tables' region directories are scanned for .regioninfo files. Each table's integrity is then verified. If there are any orphan regions (regions with no .regioninfo files) or holes, new regions are fabricated. Backwards regions are sidelined as well as empty degenerate (endkey==startkey) regions. If there are any overlapping regions, a new region is created and all data is merged into the new region.
Table integrity repairs deal solely with HDFS and could potentially be done offline -- the hbase region servers or master do not need to be running. This phase can eventually be used to completely reconstruct the hbase:meta table in an offline fashion.
Region consistency requires three conditions -- 1) valid .regioninfo file present in an HDFS region dir, 2) valid row with .regioninfo data in META, and 3) a region is deployed only at the regionserver that was assigned to with proper state in the master.
Region consistency repairs require hbase to be online so that hbck can contact the HBase master and region servers. The hbck#connect() method must first be called successfully. Much of the region consistency information is transient and less risky to repair.
If hbck is run from the command line, there are a handful of arguments that can be used to limit the kinds of repairs hbck will do. See the code in printUsageAndExit() for more details.

Nested Class Summary

Nested Classes
Modifier and Type	Class and Description
`(package private) class`	`HBaseFsck.CheckRegionConsistencyWorkItem` Deprecated.
`private static class`	`HBaseFsck.FileLockCallable` Deprecated.
`(package private) static class`	`HBaseFsck.HBaseFsckTool` Deprecated. This is a Tool wrapper that gathers -Dxxx=yyy configuration settings from the command line.
`(package private) static class`	`HBaseFsck.PrintingErrorReporter` Deprecated.
`private static class`	`HBaseFsck.RegionBoundariesInformation` Deprecated.
`(package private) class`	`HBaseFsck.WorkItemHdfsDir` Deprecated. Contact hdfs and get all information about specified table directory into regioninfo list.
`(package private) static class`	`HBaseFsck.WorkItemHdfsRegionInfo` Deprecated. Contact hdfs and get all information about specified table directory into regioninfo list.
`(package private) static class`	`HBaseFsck.WorkItemOverlapMerge` Deprecated.
`(package private) static class`	`HBaseFsck.WorkItemRegion` Deprecated. Contact a region server and get all information from it

Field Summary

Fields
Modifier and Type	Field and Description
`private Admin`	`admin` Deprecated.
`private boolean`	`checkHdfs` Deprecated.
`private boolean`	`checkMetaOnly` Deprecated.
`private boolean`	`checkRegionBoundaries` Deprecated.
`private boolean`	`cleanReplicationBarrier` Deprecated.
`private TableName`	`cleanReplicationBarrierTable` Deprecated.
`private ClusterConnection`	`connection` Deprecated.
`private RetryCounterFactory`	`createZNodeRetryCounterFactory` Deprecated.
`private static int`	`DEFAULT_CREATE_ZNODE_ATTEMPT_MAX_SLEEP_TIME` Deprecated.
`private static int`	`DEFAULT_CREATE_ZNODE_ATTEMPT_SLEEP_INTERVAL` Deprecated.
`private static int`	`DEFAULT_LOCK_FILE_ATTEMPT_MAX_SLEEP_TIME` Deprecated.
`private static int`	`DEFAULT_LOCK_FILE_ATTEMPT_SLEEP_INTERVAL` Deprecated.
`private static int`	`DEFAULT_MAX_CREATE_ZNODE_ATTEMPTS` Deprecated.
`private static int`	`DEFAULT_MAX_LOCK_FILE_ATTEMPTS` Deprecated.
`private static int`	`DEFAULT_MAX_MERGE` Deprecated.
`private static int`	`DEFAULT_OVERLAPS_TO_SIDELINE` Deprecated.
`static long`	`DEFAULT_SLEEP_BEFORE_RERUN` Deprecated.
`static long`	`DEFAULT_TIME_LAG` Deprecated.
`private static int`	`DEFAULT_WAIT_FOR_LOCK_TIMEOUT` Deprecated.
`private static boolean`	`details` Deprecated. Options
`private Set<Result>`	`emptyRegionInfoQualifiers` Deprecated.
`private HbckErrorReporter`	`errors` Deprecated. State
`protected ExecutorService`	`executor` Deprecated.
`private boolean`	`fixAny` Deprecated.
`private boolean`	`fixAssignments` Deprecated.
`private boolean`	`fixEmptyMetaCells` Deprecated.
`(package private) int`	`fixes` Deprecated.
`private boolean`	`fixHdfsHoles` Deprecated.
`private boolean`	`fixHdfsOrphans` Deprecated.
`private boolean`	`fixHdfsOverlaps` Deprecated.
`private boolean`	`fixHFileLinks` Deprecated.
`private boolean`	`fixMeta` Deprecated.
`private boolean`	`fixReferenceFiles` Deprecated.
`private boolean`	`fixReplication` Deprecated.
`private boolean`	`fixSplitParents` Deprecated.
`private boolean`	`fixTableOrphans` Deprecated.
`private boolean`	`fixVersionFile` Deprecated.
`private static boolean`	`forceExclusive` Deprecated.
`static String`	`HBCK_LOCK_FILE` Deprecated. Here is where hbase-1.x used to default the lock for hbck1.
`private org.apache.hadoop.fs.Path`	`HBCK_LOCK_PATH` Deprecated.
`private String`	`hbckEphemeralNodePath` Deprecated.
`private AtomicBoolean`	`hbckLockCleanup` Deprecated.
`private org.apache.hadoop.fs.FSDataOutputStream`	`hbckOutFd` Deprecated.
`private boolean`	`hbckZodeCreated` Deprecated.
`private HFileCorruptionChecker`	`hfcc` Deprecated.
`private boolean`	`ignorePreCheckPermission` Deprecated.
`private RetryCounterFactory`	`lockFileRetryCounterFactory` Deprecated.
`private static org.slf4j.Logger`	`LOG` Deprecated. Internal resources
`private static int`	`MAX_NUM_THREADS` Deprecated.
`private int`	`maxMerge` Deprecated.
`private int`	`maxOverlapsToSideline` Deprecated.
`private Table`	`meta` Deprecated.
`private List<HbckRegionInfo>`	`orphanHdfsDirs` Deprecated. When initially looking at HDFS, we attempt to find any orphaned data.
`private Map<TableName,Set<String>>`	`orphanTableDirs` Deprecated.
`private TreeMap<String,HbckRegionInfo>`	`regionInfoMap` Deprecated. This map contains the state of all hbck items.
`private boolean`	`removeParents` Deprecated.
`private boolean`	`rerun` Deprecated.
`private int`	`retcode` Deprecated.
`private static boolean`	`rsSupportsOffline` Deprecated.
`private boolean`	`sidelineBigOverlaps` Deprecated.
`private org.apache.hadoop.fs.Path`	`sidelineDir` Deprecated.
`private Map<TableName,Set<String>>`	`skippedRegions` Deprecated.
`private long`	`startMillis` Deprecated.
`private ClusterMetrics`	`status` Deprecated.
`private static boolean`	`summary` Deprecated.
`private Set<TableName>`	`tablesIncluded` Deprecated.
`private SortedMap<TableName,HbckTableInfo>`	`tablesInfo` Deprecated. This map from Tablename -> TableInfo contains the structures necessary to detect table consistency problems (holes, dupes, overlaps).
`private Map<TableName,TableState>`	`tableStates` Deprecated.
`private long`	`timelag` Deprecated.
`private static Set<String>`	`unsupportedOptionsInV2` Deprecated.
`private ZKWatcher`	`zkw` Deprecated.

Constructor Summary

Constructors
Constructor and Description
`HBaseFsck(org.apache.hadoop.conf.Configuration conf)` Deprecated. Constructor
`HBaseFsck(org.apache.hadoop.conf.Configuration conf, ExecutorService exec)` Deprecated. Constructor n * Configuration object n * if the master is not running n * if unable to connect to ZooKeeper

Method Summary

All Methods Static Methods Instance Methods Concrete Methods Deprecated Methods
Modifier and Type	Method and Description
`private void`	`addSkippedRegion(HbckRegionInfo hbi)` Deprecated.
`private void`	`adoptHdfsOrphan(HbckRegionInfo hi)` Deprecated. Orphaned regions are regions without a .regioninfo file in them.
`private void`	`adoptHdfsOrphans(Collection<HbckRegionInfo> orphanHdfsDirs)` Deprecated. Iterates through the list of all orphan/invalid regiondirs.
`private void`	`assignMetaReplica(int replicaId)` Deprecated.
`private void`	`checkAndFixConsistency()` Deprecated. Check consistency of all regions that have been found in previous phases.
`private void`	`checkAndFixReplication()` Deprecated.
`private void`	`checkAndFixTableStates()` Deprecated. Check and fix table states, assumes full info available: - tableInfos - empty tables loaded
`static Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.FSDataOutputStream>`	`checkAndMarkRunningHbck(org.apache.hadoop.conf.Configuration conf, RetryCounter retryCounter)` Deprecated. This method maintains a lock using a file.
`private SortedMap<TableName,HbckTableInfo>`	`checkHdfsIntegrity(boolean fixHoles, boolean fixOverlaps)` Deprecated.
`(package private) SortedMap<TableName,HbckTableInfo>`	`checkIntegrity()` Deprecated. Checks tables integrity.
`(package private) boolean`	`checkMetaRegion()` Deprecated. Check values in regionInfo for hbase:meta Check if zero or more than one regions with hbase:meta are found.
`void`	`checkRegionBoundaries()` Deprecated.
`private void`	`checkRegionConsistency(String key, HbckRegionInfo hbi)` Deprecated. Check a single region for consistency and correct deployment.
`private void`	`checkRegionConsistencyConcurrently(List<HBaseFsck.CheckRegionConsistencyWorkItem> workItems)` Deprecated. Check consistency of all regions using multiple threads concurrently.
`void`	`cleanReplicationBarrier()` Deprecated.
`private void`	`cleanupHbckZnode()` Deprecated.
`private void`	`clearState()` Deprecated. Clear the current state of hbck.
`void`	`close()` Deprecated.
`(package private) void`	`closeRegion(HbckRegionInfo hi)` Deprecated. Attempts to undeploy a region from a region server based in information in META.
`void`	`connect()` Deprecated. To repair region consistency, one must call connect() in order to repair online state.
`protected HFileCorruptionChecker`	`createHFileCorruptionChecker(boolean sidelineCorruptHFiles)` Deprecated.
`static RetryCounterFactory`	`createLockRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)` Deprecated. Returns A retry counter factory configured for retrying lock file creation.
`private static ExecutorService`	`createThreadPool(org.apache.hadoop.conf.Configuration conf)` Deprecated.
`private static RetryCounterFactory`	`createZnodeRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)` Deprecated. Returns A retry counter factory configured for retrying znode creation.
`private ZKWatcher`	`createZooKeeperWatcher()` Deprecated.
`static void`	`debugLsr(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path p)` Deprecated. ls -r for debugging purposes
`static void`	`debugLsr(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path p, HbckErrorReporter errors)` Deprecated. ls -r for debugging purposes
`(package private) void`	`debugLsr(org.apache.hadoop.fs.Path p)` Deprecated. ls -r for debugging purposes
`private void`	`deleteMetaRegion(byte[] metaKey)` Deprecated. Deletes region from meta table
`private void`	`deleteMetaRegion(HbckRegionInfo hi)` Deprecated. Deletes region from meta table
`HBaseFsck`	`exec(ExecutorService exec, String[] args)` Deprecated.
`private boolean`	`fabricateTableInfo(FSTableDescriptors fstd, TableName tableName, Set<String> columns)` Deprecated. To fabricate a .tableinfo file with following contents 1.
`void`	`fixEmptyMetaCells()` Deprecated. To fix the empty REGIONINFO_QUALIFIER rows from hbase:meta n
`void`	`fixOrphanTables()` Deprecated. To fix orphan table by creating a .tableinfo file under tableDir 1.
`private Set<String>`	`getColumnFamilyList(Set<String> columns, HbckRegionInfo hbi)` Deprecated. To get the column family list according to the column family dirs nn * @return a set of column families n
`(package private) static HbckErrorReporter`	`getErrorReporter(org.apache.hadoop.conf.Configuration conf)` Deprecated.
`HbckErrorReporter`	`getErrors()` Deprecated.
`HFileCorruptionChecker`	`getHFilecorruptionChecker()` Deprecated.
`(package private) Set<TableName>`	`getIncludedTables()` Deprecated.
`int`	`getMaxMerge()` Deprecated.
`int`	`getMaxOverlapsToSideline()` Deprecated.
`private HbckRegionInfo`	`getOrCreateInfo(String name)` Deprecated. Gets the entry in regionInfo corresponding to the the given encoded region name.
`int`	`getRetCode()` Deprecated.
`(package private) org.apache.hadoop.fs.Path`	`getSidelineDir()` Deprecated.
`(package private) TableDescriptor[]`	`getTableDescriptors(List<TableName> tableNames)` Deprecated.
`(package private) TableDescriptor[]`	`getTables(AtomicInteger numSkipped)` Deprecated. Return a list of user-space table names whose metadata have not been modified in the last few milliseconds specified by timelag if any of the REGIONINFO_QUALIFIER, SERVER_QUALIFIER, STARTCODE_QUALIFIER, SPLITA_QUALIFIER, SPLITB_QUALIFIER have not changed in the last milliseconds specified by timelag, then the table is a candidate to be returned.
`static org.apache.hadoop.fs.Path`	`getTmpDir(org.apache.hadoop.conf.Configuration conf)` Deprecated. Returns Return the tmp dir this tool writes too.
`void`	`includeTable(TableName table)` Deprecated.
`boolean`	`isExclusive()` Deprecated. Only one instance of hbck can modify HBase at a time.
`private boolean`	`isOptionsSupported(String[] args)` Deprecated.
`(package private) boolean`	`isTableDisabled(TableName tableName)` Deprecated. Check if the specified region's table is disabled.
`(package private) boolean`	`isTableIncluded(TableName table)` Deprecated. Only check/fix tables specified by the list, Empty list means all tables are included.
`static byte[]`	`keyOnly(byte[] b)` Deprecated.
`private void`	`loadDeployedRegions()` Deprecated. Get deployed regions according to the region servers.
`void`	`loadHdfsRegionDirs()` Deprecated. Scan HDFS for all regions, recording their information into regionInfoMap
`private SortedMap<TableName,HbckTableInfo>`	`loadHdfsRegionInfos()` Deprecated. Populate hbi's from regionInfos loaded from file system.
`(package private) boolean`	`loadMetaEntries()` Deprecated. Scan hbase:meta, adding all regions found to the regionInfo map.
`private void`	`loadTableInfosForTablesWithNoRegion()` Deprecated. Loads table info's for tables that may not have been included, since there are no regions reported for the table, but table dir is there in hdfs
`private void`	`loadTableStates()` Deprecated. Load the list of disabled tables in ZK into local set.
`private void`	`logParallelMerge()` Deprecated. Log an appropriate message about whether or not overlapping merges are computed in parallel.
`static void`	`main(String[] args)` Deprecated. Main program nn
`int`	`mergeRegionDirs(org.apache.hadoop.fs.Path targetRegionDir, HbckRegionInfo contained)` Deprecated. Merge hdfs data by moving from contained HbckRegionInfo into targetRegionDir.
`(package private) void`	`offline(byte[] regionName)` Deprecated. This backwards-compatibility wrapper for permanently offlining a region that should not be alive.
`void`	`offlineHdfsIntegrityRepair()` Deprecated. This repair method analyzes hbase data in hdfs and repairs it to satisfy the table integrity rules.
`private void`	`offlineHLinkFileRepair()` Deprecated. Scan all the store file names to find any lingering HFileLink files, which refer to some none-exiting files.
`private void`	`offlineReferenceFileRepair()` Deprecated. Scan all the store file names to find any lingering reference files, which refer to some none-exiting files.
`int`	`onlineConsistencyRepair()` Deprecated. This repair method requires the cluster to be online since it contacts region servers and the masters.
`int`	`onlineHbck()` Deprecated. Contacts the master and prints out cluster-wide information
`private void`	`preCheckPermission()` Deprecated.
`private void`	`printTableSummary(SortedMap<TableName,HbckTableInfo> tablesInfo)` Deprecated. Prints summary of all tables found on the system.
`protected HBaseFsck`	`printUsageAndExit()` Deprecated.
`(package private) void`	`processRegionServers(Collection<ServerName> regionServerList)` Deprecated. Contacts each regionserver and fetches metadata about regions.
`private boolean`	`recordMetaRegion()` Deprecated. Record the location of the hbase:meta region as found in ZooKeeper.
`private void`	`reportEmptyMetaCells()` Deprecated. TODO -- need to add tests for this.
`private void`	`reportTablesInFlux()` Deprecated. TODO -- need to add tests for this.
`private void`	`resetSplitParent(HbckRegionInfo hi)` Deprecated. Reset the split parent region info in meta table
`private int`	`restoreHdfsIntegrity()` Deprecated. This method determines if there are table integrity errors in HDFS.
`void`	`setCheckHdfs(boolean checking)` Deprecated.
`(package private) void`	`setCheckMetaOnly()` Deprecated. Set hbase:meta check mode.
`void`	`setCleanReplicationBarrier(boolean shouldClean)` Deprecated.
`void`	`setCleanReplicationBarrierTable(String cleanReplicationBarrierTable)` Deprecated.
`static void`	`setDisplayFullReport()` Deprecated. Display the full report from fsck.
`void`	`setFixAssignments(boolean shouldFix)` Deprecated. Fix inconsistencies found by fsck.
`void`	`setFixEmptyMetaCells(boolean shouldFix)` Deprecated.
`void`	`setFixHdfsHoles(boolean shouldFix)` Deprecated.
`void`	`setFixHdfsOrphans(boolean shouldFix)` Deprecated.
`void`	`setFixHdfsOverlaps(boolean shouldFix)` Deprecated.
`void`	`setFixHFileLinks(boolean shouldFix)` Deprecated.
`void`	`setFixMeta(boolean shouldFix)` Deprecated.
`void`	`setFixReferenceFiles(boolean shouldFix)` Deprecated.
`void`	`setFixReplication(boolean shouldFix)` Deprecated. Set replication fix mode.
`void`	`setFixSplitParents(boolean shouldFix)` Deprecated.
`void`	`setFixTableOrphans(boolean shouldFix)` Deprecated.
`void`	`setFixVersionFile(boolean shouldFix)` Deprecated.
`static void`	`setForceExclusive()` Deprecated. Set exclusive mode.
`void`	`setHFileCorruptionChecker(HFileCorruptionChecker hfcc)` Deprecated.
`void`	`setIgnorePreCheckPermission(boolean ignorePreCheckPermission)` Deprecated.
`private boolean`	`setMasterInMaintenanceMode()` Deprecated. This method maintains an ephemeral znode.
`void`	`setMaxMerge(int mm)` Deprecated.
`void`	`setMaxOverlapsToSideline(int mo)` Deprecated.
`(package private) void`	`setRegionBoundariesCheck()` Deprecated. Set region boundaries check mode.
`void`	`setRemoveParents(boolean shouldFix)` Deprecated.
`void`	`setRetCode(int code)` Deprecated.
`(package private) void`	`setShouldRerun()` Deprecated. Check if we should rerun fsck again.
`void`	`setSidelineBigOverlaps(boolean sbo)` Deprecated.
`void`	`setSidelineDir(String sidelineDir)` Deprecated.
`(package private) static void`	`setSummary()` Deprecated. Set summary mode.
`void`	`setTimeLag(long seconds)` Deprecated. We are interested in only those tables that have not changed their state in hbase:meta during the last few seconds specified by hbase.admin.fsck.timelag
`(package private) boolean`	`shouldCheckHdfs()` Deprecated.
`static boolean`	`shouldDisplayFullReport()` Deprecated.
`(package private) boolean`	`shouldFixAssignments()` Deprecated.
`(package private) boolean`	`shouldFixEmptyMetaCells()` Deprecated.
`(package private) boolean`	`shouldFixHdfsHoles()` Deprecated.
`(package private) boolean`	`shouldFixHdfsOrphans()` Deprecated.
`(package private) boolean`	`shouldFixHdfsOverlaps()` Deprecated.
`(package private) boolean`	`shouldFixHFileLinks()` Deprecated.
`(package private) boolean`	`shouldFixMeta()` Deprecated.
`(package private) boolean`	`shouldFixReferenceFiles()` Deprecated.
`(package private) boolean`	`shouldFixSplitParents()` Deprecated.
`(package private) boolean`	`shouldFixTableOrphans()` Deprecated.
`boolean`	`shouldFixVersionFile()` Deprecated.
`boolean`	`shouldIgnorePreCheckPermission()` Deprecated.
`(package private) boolean`	`shouldRemoveParents()` Deprecated.
`boolean`	`shouldRerun()` Deprecated.
`boolean`	`shouldSidelineBigOverlaps()` Deprecated.
`private boolean`	`sidelineFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path hbaseRoot, org.apache.hadoop.fs.Path path)` Deprecated.
`(package private) org.apache.hadoop.fs.Path`	`sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs, HbckRegionInfo hi)` Deprecated. Sideline a region dir (instead of deleting it)
`(package private) org.apache.hadoop.fs.Path`	`sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs, String parentDir, HbckRegionInfo hi)` Deprecated. Sideline a region dir (instead of deleting it)
`private void`	`tryAssignmentRepair(HbckRegionInfo hbi, String msg)` Deprecated.
`private void`	`unassignMetaReplica(HbckRegionInfo hi)` Deprecated.
`private void`	`undeployRegions(HbckRegionInfo hi)` Deprecated.
`private void`	`undeployRegionsForHbi(HbckRegionInfo hi)` Deprecated.
`private void`	`unlockHbck()` Deprecated.

Methods inherited from class org.apache.hadoop.conf.Configured
getConf, setConf

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Field Detail
  - DEFAULT_TIME_LAG
```
public static final long DEFAULT_TIME_LAG
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_SLEEP_BEFORE_RERUN
```
public static final long DEFAULT_SLEEP_BEFORE_RERUN
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - MAX_NUM_THREADS
```
private static final int MAX_NUM_THREADS
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - rsSupportsOffline
```
private static boolean rsSupportsOffline
```
    Deprecated.
  - DEFAULT_OVERLAPS_TO_SIDELINE
```
private static final int DEFAULT_OVERLAPS_TO_SIDELINE
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_MAX_MERGE
```
private static final int DEFAULT_MAX_MERGE
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - HBCK_LOCK_FILE
```
@InterfaceAudience.Private
public static final String HBCK_LOCK_FILE
```
    Deprecated.
    
    Here is where hbase-1.x used to default the lock for hbck1. It puts in place a lock when it goes to write/make changes.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_MAX_LOCK_FILE_ATTEMPTS
```
private static final int DEFAULT_MAX_LOCK_FILE_ATTEMPTS
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_LOCK_FILE_ATTEMPT_SLEEP_INTERVAL
```
private static final int DEFAULT_LOCK_FILE_ATTEMPT_SLEEP_INTERVAL
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_LOCK_FILE_ATTEMPT_MAX_SLEEP_TIME
```
private static final int DEFAULT_LOCK_FILE_ATTEMPT_MAX_SLEEP_TIME
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_WAIT_FOR_LOCK_TIMEOUT
```
private static final int DEFAULT_WAIT_FOR_LOCK_TIMEOUT
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_MAX_CREATE_ZNODE_ATTEMPTS
```
private static final int DEFAULT_MAX_CREATE_ZNODE_ATTEMPTS
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_CREATE_ZNODE_ATTEMPT_SLEEP_INTERVAL
```
private static final int DEFAULT_CREATE_ZNODE_ATTEMPT_SLEEP_INTERVAL
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - DEFAULT_CREATE_ZNODE_ATTEMPT_MAX_SLEEP_TIME
```
private static final int DEFAULT_CREATE_ZNODE_ATTEMPT_MAX_SLEEP_TIME
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - LOG
```
private static final org.slf4j.Logger LOG
```
    Deprecated.
    
    Internal resources
  - status
```
private ClusterMetrics status
```
    Deprecated.
  - connection
```
private ClusterConnection connection
```
    Deprecated.
  - admin
```
private Admin admin
```
    Deprecated.
  - meta
```
private Table meta
```
    Deprecated.
  - executor
```
protected ExecutorService executor
```
    Deprecated.
  - startMillis
```
private long startMillis
```
    Deprecated.
  - hfcc
```
private HFileCorruptionChecker hfcc
```
    Deprecated.
  - retcode
```
private int retcode
```
    Deprecated.
  - HBCK_LOCK_PATH
```
private org.apache.hadoop.fs.Path HBCK_LOCK_PATH
```
    Deprecated.
  - hbckOutFd
```
private org.apache.hadoop.fs.FSDataOutputStream hbckOutFd
```
    Deprecated.
  - hbckLockCleanup
```
private final AtomicBoolean hbckLockCleanup
```
    Deprecated.
  - unsupportedOptionsInV2
```
private static final Set<String> unsupportedOptionsInV2
```
    Deprecated.
  - details
```
private static boolean details
```
    Deprecated.
    
    Options
  - timelag
```
private long timelag
```
    Deprecated.
  - forceExclusive
```
private static boolean forceExclusive
```
    Deprecated.
  - fixAssignments
```
private boolean fixAssignments
```
    Deprecated.
  - fixMeta
```
private boolean fixMeta
```
    Deprecated.
  - checkHdfs
```
private boolean checkHdfs
```
    Deprecated.
  - fixHdfsHoles
```
private boolean fixHdfsHoles
```
    Deprecated.
  - fixHdfsOverlaps
```
private boolean fixHdfsOverlaps
```
    Deprecated.
  - fixHdfsOrphans
```
private boolean fixHdfsOrphans
```
    Deprecated.
  - fixTableOrphans
```
private boolean fixTableOrphans
```
    Deprecated.
  - fixVersionFile
```
private boolean fixVersionFile
```
    Deprecated.
  - fixSplitParents
```
private boolean fixSplitParents
```
    Deprecated.
  - removeParents
```
private boolean removeParents
```
    Deprecated.
  - fixReferenceFiles
```
private boolean fixReferenceFiles
```
    Deprecated.
  - fixHFileLinks
```
private boolean fixHFileLinks
```
    Deprecated.
  - fixEmptyMetaCells
```
private boolean fixEmptyMetaCells
```
    Deprecated.
  - fixReplication
```
private boolean fixReplication
```
    Deprecated.
  - cleanReplicationBarrier
```
private boolean cleanReplicationBarrier
```
    Deprecated.
  - fixAny
```
private boolean fixAny
```
    Deprecated.
  - tablesIncluded
```
private Set<TableName> tablesIncluded
```
    Deprecated.
  - cleanReplicationBarrierTable
```
private TableName cleanReplicationBarrierTable
```
    Deprecated.
  - maxMerge
```
private int maxMerge
```
    Deprecated.
  - maxOverlapsToSideline
```
private int maxOverlapsToSideline
```
    Deprecated.
  - sidelineBigOverlaps
```
private boolean sidelineBigOverlaps
```
    Deprecated.
  - sidelineDir
```
private org.apache.hadoop.fs.Path sidelineDir
```
    Deprecated.
  - rerun
```
private boolean rerun
```
    Deprecated.
  - summary
```
private static boolean summary
```
    Deprecated.
  - checkMetaOnly
```
private boolean checkMetaOnly
```
    Deprecated.
  - checkRegionBoundaries
```
private boolean checkRegionBoundaries
```
    Deprecated.
  - ignorePreCheckPermission
```
private boolean ignorePreCheckPermission
```
    Deprecated.
  - errors
```
private final HbckErrorReporter errors
```
    Deprecated.
    
    State
  - fixes
```
int fixes
```
    Deprecated.
  - regionInfoMap
```
private TreeMap<String,HbckRegionInfo> regionInfoMap
```
    Deprecated.
    
    This map contains the state of all hbck items. It maps from encoded region name to HbckRegionInfo structure. The information contained in HbckRegionInfo is used to detect and correct consistency (hdfs/meta/deployment) problems.
  - emptyRegionInfoQualifiers
```
private Set<Result> emptyRegionInfoQualifiers
```
    Deprecated.
  - tablesInfo
```
private SortedMap<TableName,HbckTableInfo> tablesInfo
```
    Deprecated.
    
    This map from Tablename -> TableInfo contains the structures necessary to detect table consistency problems (holes, dupes, overlaps). It is sorted to prevent dupes. If tablesIncluded is empty, this map contains all tables. Otherwise, it contains only meta tables and tables in tablesIncluded, unless checkMetaOnly is specified, in which case, it contains only the meta table
  - orphanHdfsDirs
```
private List<HbckRegionInfo> orphanHdfsDirs
```
    Deprecated.
    
    When initially looking at HDFS, we attempt to find any orphaned data.
  - orphanTableDirs
```
private Map<TableName,Set<String>> orphanTableDirs
```
    Deprecated.
  - tableStates
```
private Map<TableName,TableState> tableStates
```
    Deprecated.
  - lockFileRetryCounterFactory
```
private final RetryCounterFactory lockFileRetryCounterFactory
```
    Deprecated.
  - createZNodeRetryCounterFactory
```
private final RetryCounterFactory createZNodeRetryCounterFactory
```
    Deprecated.
  - skippedRegions
```
private Map<TableName,Set<String>> skippedRegions
```
    Deprecated.
  - zkw
```
private ZKWatcher zkw
```
    Deprecated.
  - hbckEphemeralNodePath
```
private String hbckEphemeralNodePath
```
    Deprecated.
  - hbckZodeCreated
```
private boolean hbckZodeCreated
```
    Deprecated.
- Constructor Detail
  - HBaseFsck
```
public HBaseFsck(org.apache.hadoop.conf.Configuration conf)
          throws IOException,
                 ClassNotFoundException
```
    Deprecated.
    
    Constructor
    
    Parameters:
    
    conf - Configuration object
    
    Throws:
    
    MasterNotRunningException - if the master is not running
    
    ZooKeeperConnectionException - if unable to connect to ZooKeeper
    
    IOException
    
    ClassNotFoundException
  - HBaseFsck
```
public HBaseFsck(org.apache.hadoop.conf.Configuration conf,
                 ExecutorService exec)
          throws MasterNotRunningException,
                 ZooKeeperConnectionException,
                 IOException,
                 ClassNotFoundException
```
    Deprecated.
    
    Constructor n * Configuration object n * if the master is not running n * if unable to connect to ZooKeeper
    
    Throws:
    
    MasterNotRunningException
    
    ZooKeeperConnectionException
    
    IOException
    
    ClassNotFoundException
- Method Detail
  - createThreadPool
```
private static ExecutorService createThreadPool(org.apache.hadoop.conf.Configuration conf)
```
    Deprecated.
  - createLockRetryCounterFactory
```
public static RetryCounterFactory createLockRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)
```
    Deprecated.
    
    Returns A retry counter factory configured for retrying lock file creation.
  - createZnodeRetryCounterFactory
```
private static RetryCounterFactory createZnodeRetryCounterFactory(org.apache.hadoop.conf.Configuration conf)
```
    Deprecated.
    
    Returns A retry counter factory configured for retrying znode creation.
  - getTmpDir
```
@InterfaceAudience.Private
public static org.apache.hadoop.fs.Path getTmpDir(org.apache.hadoop.conf.Configuration conf)
                                                                      throws IOException
```
    Deprecated.
    
    Returns Return the tmp dir this tool writes too.
    
    Throws:
    
    IOException
  - checkAndMarkRunningHbck
```
public static Pair<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.FSDataOutputStream> checkAndMarkRunningHbck(org.apache.hadoop.conf.Configuration conf,
                                                                                                              RetryCounter retryCounter)
                                                                                                       throws IOException
```
    Deprecated.
    
    This method maintains a lock using a file. If the creation fails we return null
    
    Returns:
    
    FSDataOutputStream object corresponding to the newly opened lock file
    
    Throws:
    
    IOException - if IO failure occurs
  - unlockHbck
```
private void unlockHbck()
```
    Deprecated.
  - connect
```
public void connect()
             throws IOException
```
    Deprecated.
    
    To repair region consistency, one must call connect() in order to repair online state.
    
    Throws:
    
    IOException
  - loadDeployedRegions
```
private void loadDeployedRegions()
                          throws IOException,
                                 InterruptedException
```
    Deprecated.
    
    Get deployed regions according to the region servers.
    
    Throws:
    
    IOException
    
    InterruptedException
  - clearState
```
private void clearState()
```
    Deprecated.
    
    Clear the current state of hbck.
  - offlineHdfsIntegrityRepair
```
public void offlineHdfsIntegrityRepair()
                                throws IOException,
                                       InterruptedException
```
    Deprecated.
    
    This repair method analyzes hbase data in hdfs and repairs it to satisfy the table integrity rules. HBase doesn't need to be online for this operation to work.
    
    Throws:
    
    IOException
    
    InterruptedException
  - onlineConsistencyRepair
```
public int onlineConsistencyRepair()
                            throws IOException,
                                   org.apache.zookeeper.KeeperException,
                                   InterruptedException
```
    Deprecated.
    
    This repair method requires the cluster to be online since it contacts region servers and the masters. It makes each region's state in HDFS, in hbase:meta, and deployments consistent.
    
    Returns:
    
    If > 0 , number of errors detected, if < 0 there was an unrecoverable error. If 0, we have a clean hbase.
    
    Throws:
    
    IOException
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
  - setMasterInMaintenanceMode
```
private boolean setMasterInMaintenanceMode()
                                    throws IOException
```
    Deprecated.
    
    This method maintains an ephemeral znode. If the creation fails we return false or throw exception
    
    Returns:
    
    true if creating znode succeeds; false otherwise
    
    Throws:
    
    IOException - if IO failure occurs
  - cleanupHbckZnode
```
private void cleanupHbckZnode()
```
    Deprecated.
  - onlineHbck
```
public int onlineHbck()
               throws IOException,
                      org.apache.zookeeper.KeeperException,
                      InterruptedException,
                      ReplicationException
```
    Deprecated.
    
    Contacts the master and prints out cluster-wide information
    
    Returns:
    
    0 on success, non-zero on failure
    
    Throws:
    
    IOException
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
    
    ReplicationException
  - keyOnly
```
public static byte[] keyOnly(byte[] b)
```
    Deprecated.
  - close
```
public void close()
           throws IOException
```
    Deprecated.
    
    Specified by:
    
    close in interface Closeable
    
    Specified by:
    
    close in interface AutoCloseable
    
    Throws:
    
    IOException
  - checkRegionBoundaries
```
public void checkRegionBoundaries()
```
    Deprecated.
  - adoptHdfsOrphans
```
private void adoptHdfsOrphans(Collection<HbckRegionInfo> orphanHdfsDirs)
                       throws IOException
```
    Deprecated.
    
    Iterates through the list of all orphan/invalid regiondirs.
    
    Throws:
    
    IOException
  - adoptHdfsOrphan
```
private void adoptHdfsOrphan(HbckRegionInfo hi)
                      throws IOException
```
    Deprecated.
    
    Orphaned regions are regions without a .regioninfo file in them. We "adopt" these orphans by creating a new region, and moving the column families, recovered edits, WALs, into the new region dir. We determine the region startkey and endkeys by looking at all of the hfiles inside the column families to identify the min and max keys. The resulting region will likely violate table integrity but will be dealt with by merging overlapping regions.
    
    Throws:
    
    IOException
  - restoreHdfsIntegrity
```
private int restoreHdfsIntegrity()
                          throws IOException,
                                 InterruptedException
```
    Deprecated.
    
    This method determines if there are table integrity errors in HDFS. If there are errors and the appropriate "fix" options are enabled, the method will first correct orphan regions making them into legit regiondirs, and then reload to merge potentially overlapping regions.
    
    Returns:
    
    number of table integrity errors found
    
    Throws:
    
    IOException
    
    InterruptedException
  - offlineReferenceFileRepair
```
private void offlineReferenceFileRepair()
                                 throws IOException,
                                        InterruptedException
```
    Deprecated.
    
    Scan all the store file names to find any lingering reference files, which refer to some none-exiting files. If "fix" option is enabled, any lingering reference file will be sidelined if found.
    Lingering reference file prevents a region from opening. It has to be fixed before a cluster can start properly.
    
    Throws:
    
    IOException
    
    InterruptedException
  - offlineHLinkFileRepair
```
private void offlineHLinkFileRepair()
                             throws IOException,
                                    InterruptedException
```
    Deprecated.
    
    Scan all the store file names to find any lingering HFileLink files, which refer to some none-exiting files. If "fix" option is enabled, any lingering HFileLink file will be sidelined if found.
    
    Throws:
    
    IOException
    
    InterruptedException
  - sidelineFile
```
private boolean sidelineFile(org.apache.hadoop.fs.FileSystem fs,
                             org.apache.hadoop.fs.Path hbaseRoot,
                             org.apache.hadoop.fs.Path path)
                      throws IOException
```
    Deprecated.
    
    Throws:
    
    IOException
  - reportEmptyMetaCells
```
private void reportEmptyMetaCells()
```
    Deprecated.
    
    TODO -- need to add tests for this.
  - reportTablesInFlux
```
private void reportTablesInFlux()
```
    Deprecated.
    
    TODO -- need to add tests for this.
  - getErrors
```
public HbckErrorReporter getErrors()
```
    Deprecated.
  - loadHdfsRegionInfos
```
private SortedMap<TableName,HbckTableInfo> loadHdfsRegionInfos()
                                                        throws IOException,
                                                               InterruptedException
```
    Deprecated.
    
    Populate hbi's from regionInfos loaded from file system.
    
    Throws:
    
    IOException
    
    InterruptedException
  - getColumnFamilyList
```
private Set<String> getColumnFamilyList(Set<String> columns,
                                        HbckRegionInfo hbi)
                                 throws IOException
```
    Deprecated.
    
    To get the column family list according to the column family dirs nn * @return a set of column families n
    
    Throws:
    
    IOException
  - fabricateTableInfo
```
private boolean fabricateTableInfo(FSTableDescriptors fstd,
                                   TableName tableName,
                                   Set<String> columns)
                            throws IOException
```
    Deprecated.
    
    To fabricate a .tableinfo file with following contents
    1. the correct tablename
    2. the correct colfamily list
    3. the default properties for both TableDescriptor and ColumnFamilyDescriptor
    n
    
    Throws:
    
    IOException
  - fixEmptyMetaCells
```
public void fixEmptyMetaCells()
                       throws IOException
```
    Deprecated.
    
    To fix the empty REGIONINFO_QUALIFIER rows from hbase:meta
    n
    
    Throws:
    
    IOException
  - fixOrphanTables
```
public void fixOrphanTables()
                     throws IOException
```
    Deprecated.
    
    To fix orphan table by creating a .tableinfo file under tableDir
    1. if TableInfo is cached, to recover the .tableinfo accordingly
    2. else create a default .tableinfo file with following items
    2.1 the correct tablename
    2.2 the correct colfamily list
    2.3 the default properties for both TableDescriptor and ColumnFamilyDescriptor
    n
    
    Throws:
    
    IOException
  - logParallelMerge
```
private void logParallelMerge()
```
    Deprecated.
    
    Log an appropriate message about whether or not overlapping merges are computed in parallel.
  - checkHdfsIntegrity
```
private SortedMap<TableName,HbckTableInfo> checkHdfsIntegrity(boolean fixHoles,
                                                              boolean fixOverlaps)
                                                       throws IOException
```
    Deprecated.
    
    Throws:
    
    IOException
  - getSidelineDir
```
org.apache.hadoop.fs.Path getSidelineDir()
                                  throws IOException
```
    Deprecated.
    
    Throws:
    
    IOException
  - sidelineRegionDir
```
org.apache.hadoop.fs.Path sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs,
                                            HbckRegionInfo hi)
                                     throws IOException
```
    Deprecated.
    
    Sideline a region dir (instead of deleting it)
    
    Throws:
    
    IOException
  - sidelineRegionDir
```
org.apache.hadoop.fs.Path sidelineRegionDir(org.apache.hadoop.fs.FileSystem fs,
                                            String parentDir,
                                            HbckRegionInfo hi)
                                     throws IOException
```
    Deprecated.
    
    Sideline a region dir (instead of deleting it)
    
    Parameters:
    
    parentDir - if specified, the region will be sidelined to folder like .../parentDir/<table name>/<region name>. The purpose is to group together similar regions sidelined, for example, those regions should be bulk loaded back later on. If NULL, it is ignored.
    
    Throws:
    
    IOException
  - loadTableStates
```
private void loadTableStates()
                      throws IOException
```
    Deprecated.
    
    Load the list of disabled tables in ZK into local set. nn
    
    Throws:
    
    IOException
  - isTableDisabled
```
boolean isTableDisabled(TableName tableName)
```
    Deprecated.
    
    Check if the specified region's table is disabled.
    
    Parameters:
    
    tableName - table to check status of
  - loadHdfsRegionDirs
```
public void loadHdfsRegionDirs()
                        throws IOException,
                               InterruptedException
```
    Deprecated.
    
    Scan HDFS for all regions, recording their information into regionInfoMap
    
    Throws:
    
    IOException
    
    InterruptedException
  - recordMetaRegion
```
private boolean recordMetaRegion()
                          throws IOException
```
    Deprecated.
    
    Record the location of the hbase:meta region as found in ZooKeeper.
    
    Throws:
    
    IOException
  - createZooKeeperWatcher
```
private ZKWatcher createZooKeeperWatcher()
                                  throws IOException
```
    Deprecated.
    
    Throws:
    
    IOException
  - processRegionServers
```
void processRegionServers(Collection<ServerName> regionServerList)
                   throws IOException,
                          InterruptedException
```
    Deprecated.
    
    Contacts each regionserver and fetches metadata about regions.
    
    Parameters:
    
    regionServerList - - the list of region servers to connect to
    
    Throws:
    
    IOException - if a remote or network exception occurs
    
    InterruptedException
  - checkAndFixConsistency
```
private void checkAndFixConsistency()
                             throws IOException,
                                    org.apache.zookeeper.KeeperException,
                                    InterruptedException
```
    Deprecated.
    
    Check consistency of all regions that have been found in previous phases.
    
    Throws:
    
    IOException
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
  - checkRegionConsistencyConcurrently
```
private void checkRegionConsistencyConcurrently(List<HBaseFsck.CheckRegionConsistencyWorkItem> workItems)
                                         throws IOException,
                                                org.apache.zookeeper.KeeperException,
                                                InterruptedException
```
    Deprecated.
    
    Check consistency of all regions using multiple threads concurrently.
    
    Throws:
    
    IOException
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
  - addSkippedRegion
```
private void addSkippedRegion(HbckRegionInfo hbi)
```
    Deprecated.
  - checkAndFixTableStates
```
private void checkAndFixTableStates()
                             throws IOException
```
    Deprecated.
    
    Check and fix table states, assumes full info available: - tableInfos - empty tables loaded
    
    Throws:
    
    IOException
  - preCheckPermission
```
private void preCheckPermission()
                         throws IOException
```
    Deprecated.
    
    Throws:
    
    IOException
  - deleteMetaRegion
```
private void deleteMetaRegion(HbckRegionInfo hi)
                       throws IOException
```
    Deprecated.
    
    Deletes region from meta table
    
    Throws:
    
    IOException
  - deleteMetaRegion
```
private void deleteMetaRegion(byte[] metaKey)
                       throws IOException
```
    Deprecated.
    
    Deletes region from meta table
    
    Throws:
    
    IOException
  - resetSplitParent
```
private void resetSplitParent(HbckRegionInfo hi)
                       throws IOException
```
    Deprecated.
    
    Reset the split parent region info in meta table
    
    Throws:
    
    IOException
  - offline
```
void offline(byte[] regionName)
      throws IOException
```
    Deprecated.
    
    This backwards-compatibility wrapper for permanently offlining a region that should not be alive. If the region server does not support the "offline" method, it will use the closest unassign method instead. This will basically work until one attempts to disable or delete the affected table. The problem has to do with in-memory only master state, so restarting the HMaster or failing over to another should fix this.
    
    Throws:
    
    IOException
  - closeRegion
```
void closeRegion(HbckRegionInfo hi)
          throws IOException,
                 InterruptedException
```
    Deprecated.
    
    Attempts to undeploy a region from a region server based in information in META. Any operations that modify the file system should make sure that its corresponding region is not deployed to prevent data races. A separate call is required to update the master in-memory region state kept in the AssignementManager. Because disable uses this state instead of that found in META, we can't seem to cleanly disable/delete tables that have been hbck fixed. When used on a version of HBase that does not have the offline ipc call exposed on the master (<0.90.5, <0.92.0) a master restart or failover may be required.
    
    Throws:
    
    IOException
    
    InterruptedException
  - undeployRegions
```
private void undeployRegions(HbckRegionInfo hi)
                      throws IOException,
                             InterruptedException
```
    Deprecated.
    
    Throws:
    
    IOException
    
    InterruptedException
  - undeployRegionsForHbi
```
private void undeployRegionsForHbi(HbckRegionInfo hi)
                            throws IOException,
                                   InterruptedException
```
    Deprecated.
    
    Throws:
    
    IOException
    
    InterruptedException
  - tryAssignmentRepair
```
private void tryAssignmentRepair(HbckRegionInfo hbi,
                                 String msg)
                          throws IOException,
                                 org.apache.zookeeper.KeeperException,
                                 InterruptedException
```
    Deprecated.
    
    Throws:
    
    IOException
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
  - checkRegionConsistency
```
private void checkRegionConsistency(String key,
                                    HbckRegionInfo hbi)
                             throws IOException,
                                    org.apache.zookeeper.KeeperException,
                                    InterruptedException
```
    Deprecated.
    
    Check a single region for consistency and correct deployment.
    
    Throws:
    
    IOException
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
  - checkIntegrity
```
SortedMap<TableName,HbckTableInfo> checkIntegrity()
                                           throws IOException
```
    Deprecated.
    
    Checks tables integrity. Goes over all regions and scans the tables. Collects all the pieces for each table and checks if there are missing, repeated or overlapping ones. n
    
    Throws:
    
    IOException
  - loadTableInfosForTablesWithNoRegion
```
private void loadTableInfosForTablesWithNoRegion()
                                          throws IOException
```
    Deprecated.
    
    Loads table info's for tables that may not have been included, since there are no regions reported for the table, but table dir is there in hdfs
    
    Throws:
    
    IOException
  - mergeRegionDirs
```
public int mergeRegionDirs(org.apache.hadoop.fs.Path targetRegionDir,
                           HbckRegionInfo contained)
                    throws IOException
```
    Deprecated.
    
    Merge hdfs data by moving from contained HbckRegionInfo into targetRegionDir.
    
    Returns:
    
    number of file move fixes done to merge regions.
    
    Throws:
    
    IOException
  - getTables
```
TableDescriptor[] getTables(AtomicInteger numSkipped)
```
    Deprecated.
    
    Return a list of user-space table names whose metadata have not been modified in the last few milliseconds specified by timelag if any of the REGIONINFO_QUALIFIER, SERVER_QUALIFIER, STARTCODE_QUALIFIER, SPLITA_QUALIFIER, SPLITB_QUALIFIER have not changed in the last milliseconds specified by timelag, then the table is a candidate to be returned.
    
    Returns:
    
    tables that have not been modified recently
    
    Throws:
    
    IOException - if an error is encountered
  - getTableDescriptors
```
TableDescriptor[] getTableDescriptors(List<TableName> tableNames)
```
    Deprecated.
  - getOrCreateInfo
```
private HbckRegionInfo getOrCreateInfo(String name)
```
    Deprecated.
    
    Gets the entry in regionInfo corresponding to the the given encoded region name. If the region has not been seen yet, a new entry is added and returned.
  - checkAndFixReplication
```
private void checkAndFixReplication()
                             throws ReplicationException
```
    Deprecated.
    
    Throws:
    
    ReplicationException
  - checkMetaRegion
```
boolean checkMetaRegion()
                 throws IOException,
                        org.apache.zookeeper.KeeperException,
                        InterruptedException
```
    Deprecated.
    
    Check values in regionInfo for hbase:meta Check if zero or more than one regions with hbase:meta are found. If there are inconsistencies (i.e. zero or more than one regions pretend to be holding the hbase:meta) try to fix that and report an error.
    
    Throws:
    
    IOException - from HBaseFsckRepair functions nn
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
  - unassignMetaReplica
```
private void unassignMetaReplica(HbckRegionInfo hi)
                          throws IOException,
                                 InterruptedException,
                                 org.apache.zookeeper.KeeperException
```
    Deprecated.
    
    Throws:
    
    IOException
    
    InterruptedException
    
    org.apache.zookeeper.KeeperException
  - assignMetaReplica
```
private void assignMetaReplica(int replicaId)
                        throws IOException,
                               org.apache.zookeeper.KeeperException,
                               InterruptedException
```
    Deprecated.
    
    Throws:
    
    IOException
    
    org.apache.zookeeper.KeeperException
    
    InterruptedException
  - loadMetaEntries
```
boolean loadMetaEntries()
                 throws IOException
```
    Deprecated.
    
    Scan hbase:meta, adding all regions found to the regionInfo map.
    
    Throws:
    
    IOException - if an error is encountered
  - printTableSummary
```
private void printTableSummary(SortedMap<TableName,HbckTableInfo> tablesInfo)
```
    Deprecated.
    
    Prints summary of all tables found on the system.
  - getErrorReporter
```
static HbckErrorReporter getErrorReporter(org.apache.hadoop.conf.Configuration conf)
                                   throws ClassNotFoundException
```
    Deprecated.
    
    Throws:
    
    ClassNotFoundException
  - setDisplayFullReport
```
public static void setDisplayFullReport()
```
    Deprecated.
    
    Display the full report from fsck. This displays all live and dead region servers, and all known regions.
  - shouldDisplayFullReport
```
public static boolean shouldDisplayFullReport()
```
    Deprecated.
  - setForceExclusive
```
public static void setForceExclusive()
```
    Deprecated.
    
    Set exclusive mode.
  - isExclusive
```
public boolean isExclusive()
```
    Deprecated.
    
    Only one instance of hbck can modify HBase at a time.
  - setSummary
```
static void setSummary()
```
    Deprecated.
    
    Set summary mode. Print only summary of the tables and status (OK or INCONSISTENT)
  - setCheckMetaOnly
```
void setCheckMetaOnly()
```
    Deprecated.
    
    Set hbase:meta check mode. Print only info about hbase:meta table deployment/state
  - setRegionBoundariesCheck
```
void setRegionBoundariesCheck()
```
    Deprecated.
    
    Set region boundaries check mode.
  - setFixReplication
```
public void setFixReplication(boolean shouldFix)
```
    Deprecated.
    
    Set replication fix mode.
  - setCleanReplicationBarrier
```
public void setCleanReplicationBarrier(boolean shouldClean)
```
    Deprecated.
  - setShouldRerun
```
void setShouldRerun()
```
    Deprecated.
    
    Check if we should rerun fsck again. This checks if we've tried to fix something and we should rerun fsck tool again. Display the full report from fsck. This displays all live and dead region servers, and all known regions.
  - shouldRerun
```
public boolean shouldRerun()
```
    Deprecated.
  - setFixAssignments
```
public void setFixAssignments(boolean shouldFix)
```
    Deprecated.
    
    Fix inconsistencies found by fsck. This should try to fix errors (if any) found by fsck utility.
  - shouldFixAssignments
```
boolean shouldFixAssignments()
```
    Deprecated.
  - setFixMeta
```
public void setFixMeta(boolean shouldFix)
```
    Deprecated.
  - shouldFixMeta
```
boolean shouldFixMeta()
```
    Deprecated.
  - setFixEmptyMetaCells
```
public void setFixEmptyMetaCells(boolean shouldFix)
```
    Deprecated.
  - shouldFixEmptyMetaCells
```
boolean shouldFixEmptyMetaCells()
```
    Deprecated.
  - setCheckHdfs
```
public void setCheckHdfs(boolean checking)
```
    Deprecated.
  - shouldCheckHdfs
```
boolean shouldCheckHdfs()
```
    Deprecated.
  - setFixHdfsHoles
```
public void setFixHdfsHoles(boolean shouldFix)
```
    Deprecated.
  - shouldFixHdfsHoles
```
boolean shouldFixHdfsHoles()
```
    Deprecated.
  - setFixTableOrphans
```
public void setFixTableOrphans(boolean shouldFix)
```
    Deprecated.
  - shouldFixTableOrphans
```
boolean shouldFixTableOrphans()
```
    Deprecated.
  - setFixHdfsOverlaps
```
public void setFixHdfsOverlaps(boolean shouldFix)
```
    Deprecated.
  - shouldFixHdfsOverlaps
```
boolean shouldFixHdfsOverlaps()
```
    Deprecated.
  - setFixHdfsOrphans
```
public void setFixHdfsOrphans(boolean shouldFix)
```
    Deprecated.
  - shouldFixHdfsOrphans
```
boolean shouldFixHdfsOrphans()
```
    Deprecated.
  - setFixVersionFile
```
public void setFixVersionFile(boolean shouldFix)
```
    Deprecated.
  - shouldFixVersionFile
```
public boolean shouldFixVersionFile()
```
    Deprecated.
  - setSidelineBigOverlaps
```
public void setSidelineBigOverlaps(boolean sbo)
```
    Deprecated.
  - shouldSidelineBigOverlaps
```
public boolean shouldSidelineBigOverlaps()
```
    Deprecated.
  - setFixSplitParents
```
public void setFixSplitParents(boolean shouldFix)
```
    Deprecated.
  - setRemoveParents
```
public void setRemoveParents(boolean shouldFix)
```
    Deprecated.
  - shouldFixSplitParents
```
boolean shouldFixSplitParents()
```
    Deprecated.
  - shouldRemoveParents
```
boolean shouldRemoveParents()
```
    Deprecated.
  - setFixReferenceFiles
```
public void setFixReferenceFiles(boolean shouldFix)
```
    Deprecated.
  - shouldFixReferenceFiles
```
boolean shouldFixReferenceFiles()
```
    Deprecated.
  - setFixHFileLinks
```
public void setFixHFileLinks(boolean shouldFix)
```
    Deprecated.
  - shouldFixHFileLinks
```
boolean shouldFixHFileLinks()
```
    Deprecated.
  - shouldIgnorePreCheckPermission
```
public boolean shouldIgnorePreCheckPermission()
```
    Deprecated.
  - setIgnorePreCheckPermission
```
public void setIgnorePreCheckPermission(boolean ignorePreCheckPermission)
```
    Deprecated.
  - setMaxMerge
```
public void setMaxMerge(int mm)
```
    Deprecated.
    
    Parameters:
    
    mm - maximum number of regions to merge into a single region.
  - getMaxMerge
```
public int getMaxMerge()
```
    Deprecated.
  - setMaxOverlapsToSideline
```
public void setMaxOverlapsToSideline(int mo)
```
    Deprecated.
  - getMaxOverlapsToSideline
```
public int getMaxOverlapsToSideline()
```
    Deprecated.
  - isTableIncluded
```
boolean isTableIncluded(TableName table)
```
    Deprecated.
    
    Only check/fix tables specified by the list, Empty list means all tables are included.
  - includeTable
```
public void includeTable(TableName table)
```
    Deprecated.
  - getIncludedTables
```
Set<TableName> getIncludedTables()
```
    Deprecated.
  - setTimeLag
```
public void setTimeLag(long seconds)
```
    Deprecated.
    
    We are interested in only those tables that have not changed their state in hbase:meta during the last few seconds specified by hbase.admin.fsck.timelag
    
    Parameters:
    
    seconds - - the time in seconds
  - setSidelineDir
```
public void setSidelineDir(String sidelineDir)
```
    Deprecated.
    
    Parameters:
    
    sidelineDir - - HDFS path to sideline data
  - createHFileCorruptionChecker
```
protected HFileCorruptionChecker createHFileCorruptionChecker(boolean sidelineCorruptHFiles)
                                                       throws IOException
```
    Deprecated.
    
    Throws:
    
    IOException
  - getHFilecorruptionChecker
```
public HFileCorruptionChecker getHFilecorruptionChecker()
```
    Deprecated.
  - setHFileCorruptionChecker
```
public void setHFileCorruptionChecker(HFileCorruptionChecker hfcc)
```
    Deprecated.
  - setRetCode
```
public void setRetCode(int code)
```
    Deprecated.
  - getRetCode
```
public int getRetCode()
```
    Deprecated.
  - printUsageAndExit
```
protected HBaseFsck printUsageAndExit()
```
    Deprecated.
  - main
```
public static void main(String[] args)
                 throws Exception
```
    Deprecated.
    
    Main program nn
    
    Throws:
    
    Exception
  - exec
```
public HBaseFsck exec(ExecutorService exec,
                      String[] args)
               throws org.apache.zookeeper.KeeperException,
                      IOException,
                      InterruptedException,
                      ReplicationException
```
    Deprecated.
    
    Throws:
    
    org.apache.zookeeper.KeeperException
    
    IOException
    
    InterruptedException
    
    ReplicationException
  - isOptionsSupported
```
private boolean isOptionsSupported(String[] args)
```
    Deprecated.
  - setCleanReplicationBarrierTable
```
public void setCleanReplicationBarrierTable(String cleanReplicationBarrierTable)
```
    Deprecated.
  - cleanReplicationBarrier
```
public void cleanReplicationBarrier()
                             throws IOException
```
    Deprecated.
    
    Throws:
    
    IOException
  - debugLsr
```
void debugLsr(org.apache.hadoop.fs.Path p)
       throws IOException
```
    Deprecated.
    
    ls -r for debugging purposes
    
    Throws:
    
    IOException
  - debugLsr
```
public static void debugLsr(org.apache.hadoop.conf.Configuration conf,
                            org.apache.hadoop.fs.Path p)
                     throws IOException
```
    Deprecated.
    
    ls -r for debugging purposes
    
    Throws:
    
    IOException
  - debugLsr
```
public static void debugLsr(org.apache.hadoop.conf.Configuration conf,
                            org.apache.hadoop.fs.Path p,
                            HbckErrorReporter errors)
                     throws IOException
```
    Deprecated.
    
    ls -r for debugging purposes
    
    Throws:
    
    IOException

Class HBaseFsck

Nested Class Summary

Field Summary

Constructor Summary

Method Summary

Methods inherited from class org.apache.hadoop.conf.Configured

Methods inherited from class java.lang.Object

Field Detail

DEFAULT_TIME_LAG

DEFAULT_SLEEP_BEFORE_RERUN

MAX_NUM_THREADS

rsSupportsOffline

DEFAULT_OVERLAPS_TO_SIDELINE

DEFAULT_MAX_MERGE

HBCK_LOCK_FILE

DEFAULT_MAX_LOCK_FILE_ATTEMPTS

DEFAULT_LOCK_FILE_ATTEMPT_SLEEP_INTERVAL

DEFAULT_LOCK_FILE_ATTEMPT_MAX_SLEEP_TIME

DEFAULT_WAIT_FOR_LOCK_TIMEOUT

DEFAULT_MAX_CREATE_ZNODE_ATTEMPTS

DEFAULT_CREATE_ZNODE_ATTEMPT_SLEEP_INTERVAL

DEFAULT_CREATE_ZNODE_ATTEMPT_MAX_SLEEP_TIME

LOG

status

connection

admin

meta

executor

startMillis

hfcc

retcode

HBCK_LOCK_PATH

hbckOutFd

hbckLockCleanup

unsupportedOptionsInV2

details

timelag

forceExclusive

fixAssignments

fixMeta

checkHdfs

fixHdfsHoles

fixHdfsOverlaps

fixHdfsOrphans

fixTableOrphans

fixVersionFile

fixSplitParents

removeParents

fixReferenceFiles

fixHFileLinks

fixEmptyMetaCells

fixReplication

cleanReplicationBarrier

fixAny

tablesIncluded

cleanReplicationBarrierTable

maxMerge

maxOverlapsToSideline

sidelineBigOverlaps

sidelineDir

rerun

summary

checkMetaOnly

checkRegionBoundaries

ignorePreCheckPermission

errors

fixes

regionInfoMap

emptyRegionInfoQualifiers

tablesInfo

orphanHdfsDirs

orphanTableDirs

tableStates

lockFileRetryCounterFactory

createZNodeRetryCounterFactory

skippedRegions

zkw

hbckEphemeralNodePath

hbckZodeCreated

Constructor Detail