org.apache.hadoop.hbase.mob

Class MobStressToolRunner

java.lang.Object

org.apache.hadoop.hbase.mob.MobStressToolRunner

public class MobStressToolRunner
extends Object

Reproduction for MOB data loss 1. Settings: Region Size 200 MB, Flush threshold 800 KB. 2. Insert 10 Million records 3. MOB Compaction and Archiver a) Trigger MOB Compaction (every 2 minutes) b) Trigger major compaction (every 2 minutes) c) Trigger archive cleaner (every 3 minutes) 4. Validate MOB data after complete data load. This class is used by MobStressTool only. This is not a unit test

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
(package private) class	MobStressToolRunner.CleanMobAndArchive
(package private) class	MobStressToolRunner.MajorCompaction
(package private) class	MobStressToolRunner.WriteData

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.hadoop.hbase.client.Admin	admin
private org.apache.hadoop.hbase.mob.MobFileCleanerChore	chore
private org.apache.hadoop.conf.Configuration	conf
private long	count
private double	failureProb
private static byte[]	fam
private static String	famStr
private org.apache.hadoop.hbase.HColumnDescriptor	hcd
private org.apache.hadoop.hbase.HTableDescriptor	hdt
private HBaseTestingUtility	HTU
private static org.slf4j.Logger	LOG
private static long	mobLen
private static byte[]	mobVal
private static byte[]	qualifier
private static boolean	run
private org.apache.hadoop.hbase.client.Table	table

Constructor Summary

Constructors

Constructor and Description
MobStressToolRunner()

Method Summary

Modifier and Type	Method and Description
private long	getNumberOfMobFiles(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hbase.TableName tableName, String family)
void	init(org.apache.hadoop.conf.Configuration conf, long numRows)
private void	initConf()
private void	printConf()
void	printStats(long loaded)
void	runStressTest()
private void	scanTable()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

HTU

private HBaseTestingUtility HTU

famStr

private static final String famStr

See Also:

Constant Field Values

fam

private static final byte[] fam

qualifier

private static final byte[] qualifier

mobLen

private static final long mobLen

See Also:

Constant Field Values

mobVal

private static final byte[] mobVal

conf

private org.apache.hadoop.conf.Configuration conf

hdt

private org.apache.hadoop.hbase.HTableDescriptor hdt

hcd

private org.apache.hadoop.hbase.HColumnDescriptor hcd

admin

private org.apache.hadoop.hbase.client.Admin admin

count

private long count

failureProb

private double failureProb

table

private org.apache.hadoop.hbase.client.Table table

chore

private org.apache.hadoop.hbase.mob.MobFileCleanerChore chore

run

private static volatile boolean run

Constructor Detail

MobStressToolRunner

public MobStressToolRunner()

Method Detail

init

public void init(org.apache.hadoop.conf.Configuration conf,
                 long numRows)
          throws IOException

Throws:

IOException

printConf

private void printConf()

initConf

private void initConf()

runStressTest

public void runStressTest()
                   throws InterruptedException,
                          IOException

Throws:

InterruptedException

IOException

getNumberOfMobFiles

private long getNumberOfMobFiles(org.apache.hadoop.conf.Configuration conf,
                                 org.apache.hadoop.hbase.TableName tableName,
                                 String family)
                          throws IOException

Throws:

IOException

printStats

public void printStats(long loaded)

scanTable

private void scanTable()