org.apache.hadoop.hbase.snapshot

Class SnapshotInfo.SnapshotStats

java.lang.Object

org.apache.hadoop.hbase.snapshot.SnapshotInfo.SnapshotStats

Enclosing class:

SnapshotInfo

public static class SnapshotInfo.SnapshotStats
extends Object

Statistics about the snapshot

1. How many store files and logs are in the archive
2. How many store files and logs are shared with the table
3. Total store files and logs size and shared amount

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
(package private) static class	SnapshotInfo.SnapshotStats.FileInfo Information about the file referenced by the snapshot

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.hadoop.conf.Configuration	conf
private org.apache.hadoop.fs.FileSystem	fs
private AtomicInteger	hfilesArchiveCount
private AtomicLong	hfilesArchiveSize
private AtomicInteger	hfilesCorrupted
private AtomicInteger	hfilesCount
private AtomicInteger	hfilesMissing
private AtomicInteger	hfilesMobCount
private AtomicLong	hfilesMobSize
private AtomicLong	hfilesSize
private AtomicInteger	logsCount
private AtomicLong	logSize
private AtomicInteger	logsMissing
private AtomicLong	nonSharedHfilesArchiveSize
private org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription	snapshot
private TableName	snapshotTable

Constructor Summary

Constructors

Constructor and Description
SnapshotStats(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, SnapshotDescription snapshot)
SnapshotStats(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription snapshot)

Method Summary

Modifier and Type	Method and Description
(package private) SnapshotInfo.SnapshotStats.FileInfo	addLogFile(String server, String logfile) Add the specified log file to the stats
(package private) SnapshotInfo.SnapshotStats.FileInfo	addStoreFile(RegionInfo region, String family, org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotRegionManifest.StoreFile storeFile, Map<org.apache.hadoop.fs.Path,Integer> filesMap) Add the specified store file to the stats
int	getArchivedStoreFilesCount()
long	getArchivedStoreFileSize()
int	getCorruptedStoreFilesCount()
int	getLogsCount()
long	getLogsSize()
int	getMissingLogsCount()
int	getMissingStoreFilesCount()
float	getMobStoreFilePercentage()
int	getMobStoreFilesCount()
long	getMobStoreFilesSize()
long	getNonSharedArchivedStoreFilesSize()
float	getSharedStoreFilePercentage()
long	getSharedStoreFilesSize()
SnapshotDescription	getSnapshotDescription()
int	getStoreFilesCount()
long	getStoreFilesSize()
private boolean	isArchivedFileStillReferenced(org.apache.hadoop.fs.Path filePath, Map<org.apache.hadoop.fs.Path,Integer> snapshotFilesMap) Check if for a give file in archive, if there are other snapshots/tables still reference it.
boolean	isSnapshotCorrupted()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

hfilesArchiveCount

private AtomicInteger hfilesArchiveCount

hfilesCorrupted

private AtomicInteger hfilesCorrupted

hfilesMissing

private AtomicInteger hfilesMissing

hfilesCount

private AtomicInteger hfilesCount

hfilesMobCount

private AtomicInteger hfilesMobCount

logsMissing

private AtomicInteger logsMissing

logsCount

private AtomicInteger logsCount

hfilesArchiveSize

private AtomicLong hfilesArchiveSize

hfilesSize

private AtomicLong hfilesSize

hfilesMobSize

private AtomicLong hfilesMobSize

nonSharedHfilesArchiveSize

private AtomicLong nonSharedHfilesArchiveSize

logSize

private AtomicLong logSize

snapshot

private final org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription snapshot

snapshotTable

private final TableName snapshotTable

conf

private final org.apache.hadoop.conf.Configuration conf

fs

private final org.apache.hadoop.fs.FileSystem fs

Constructor Detail

SnapshotStats

SnapshotStats(org.apache.hadoop.conf.Configuration conf,
              org.apache.hadoop.fs.FileSystem fs,
              SnapshotDescription snapshot)

SnapshotStats

SnapshotStats(org.apache.hadoop.conf.Configuration conf,
              org.apache.hadoop.fs.FileSystem fs,
              org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotDescription snapshot)

Method Detail

getSnapshotDescription

public SnapshotDescription getSnapshotDescription()

Returns:

the snapshot descriptor

isSnapshotCorrupted

public boolean isSnapshotCorrupted()

Returns:

true if the snapshot is corrupted

getStoreFilesCount

public int getStoreFilesCount()

Returns:

the number of available store files

getArchivedStoreFilesCount

public int getArchivedStoreFilesCount()

Returns:

the number of available store files in the archive

getMobStoreFilesCount

public int getMobStoreFilesCount()

Returns:

the number of available store files in the mob dir

getLogsCount

public int getLogsCount()

Returns:

the number of available log files

getMissingStoreFilesCount

public int getMissingStoreFilesCount()

Returns:

the number of missing store files

getCorruptedStoreFilesCount

public int getCorruptedStoreFilesCount()

Returns:

the number of corrupted store files

getMissingLogsCount

public int getMissingLogsCount()

Returns:

the number of missing log files

getStoreFilesSize

public long getStoreFilesSize()

Returns:

the total size of the store files referenced by the snapshot

getSharedStoreFilesSize

public long getSharedStoreFilesSize()

Returns:

the total size of the store files shared

getArchivedStoreFileSize

public long getArchivedStoreFileSize()

Returns:

the total size of the store files in the archive

getMobStoreFilesSize

public long getMobStoreFilesSize()

Returns:

the total size of the store files in the mob store

getNonSharedArchivedStoreFilesSize

public long getNonSharedArchivedStoreFilesSize()

Returns:

the total size of the store files in the archive which is not shared with other snapshots and tables This is only calculated when SnapshotInfo.getSnapshotStats(Configuration, SnapshotProtos.SnapshotDescription, Map) is called with a non-null Map

getSharedStoreFilePercentage

public float getSharedStoreFilePercentage()

Returns:

the percentage of the shared store files

getMobStoreFilePercentage

public float getMobStoreFilePercentage()

Returns:

the percentage of the mob store files

getLogsSize

public long getLogsSize()

Returns:

the total log size

isArchivedFileStillReferenced

private boolean isArchivedFileStillReferenced(org.apache.hadoop.fs.Path filePath,
                                              Map<org.apache.hadoop.fs.Path,Integer> snapshotFilesMap)

Check if for a give file in archive, if there are other snapshots/tables still reference it.

Parameters:

filePath - file path in archive

snapshotFilesMap - a map for store files in snapshots about how many snapshots refer to it.

Returns:

true or false

addStoreFile

SnapshotInfo.SnapshotStats.FileInfo addStoreFile(RegionInfo region,
                                                 String family,
                                                 org.apache.hadoop.hbase.shaded.protobuf.generated.SnapshotProtos.SnapshotRegionManifest.StoreFile storeFile,
                                                 Map<org.apache.hadoop.fs.Path,Integer> filesMap)
                                          throws IOException

Add the specified store file to the stats

Parameters:

region - region encoded Name

family - family name

storeFile - store file name

filesMap - store files map for all snapshots, it may be null

Returns:

the store file information

Throws:

IOException

addLogFile

SnapshotInfo.SnapshotStats.FileInfo addLogFile(String server,
                                               String logfile)
                                        throws IOException

Add the specified log file to the stats

Parameters:

server - server name

logfile - log file name

Returns:

the log information

Throws:

IOException