org.apache.hadoop.hbase.replication.regionserver

Class TestMetaRegionReplicaReplicationEndpoint

java.lang.Object

org.apache.hadoop.hbase.replication.regionserver.TestMetaRegionReplicaReplicationEndpoint

public class TestMetaRegionReplicaReplicationEndpoint
extends Object

Tests RegionReplicaReplicationEndpoint class for hbase:meta by setting up region replicas and verifying async wal replication replays the edits to the secondary region in various scenarios.

See Also:

TestRegionReplicaReplicationEndpoint

Field Summary

Fields

Modifier and Type	Field and Description
static HBaseClassTestRule	CLASS_RULE
private HBaseTestingUtility	HTU
private static org.slf4j.Logger	LOG
org.junit.rules.TestName	name
private static int	NB_SERVERS
private int	numOfMetaReplica
private static byte[]	VALUE

Constructor Summary

Constructors

Constructor and Description
TestMetaRegionReplicaReplicationEndpoint()

Method Summary

Modifier and Type	Method and Description
void	after()
void	before()
(package private) static boolean	contains(List<org.apache.hadoop.hbase.client.Result> contains, List<org.apache.hadoop.hbase.Cell> cells) Presumes sorted Cells.
private boolean	doesNotContain(List<org.apache.hadoop.hbase.Cell> cells, org.apache.hadoop.hbase.TableName tableName) Cells are from hbase:meta replica so will start w/ 'tableName,'; i.e.
private void	doNGets(org.apache.hadoop.hbase.client.Table table, byte[][] keys)
private org.apache.hadoop.hbase.regionserver.Region[]	getAllRegions(org.apache.hadoop.hbase.TableName tableName, int replication) Returns All Regions for tableName including Replicas.
private List<org.apache.hadoop.hbase.client.Result>	getMetaCells(org.apache.hadoop.hbase.TableName tableName) Scan hbase:meta for tableName content.
private void	getMetaReplicaReadRequests(org.apache.hadoop.hbase.regionserver.Region[] metaRegions, long[] counters)
private org.apache.hadoop.hbase.regionserver.Region	getOneRegion(org.apache.hadoop.hbase.TableName tableName)
private boolean	isMetaRegionReplicaReplicationSource(org.apache.hadoop.hbase.regionserver.HRegionServer hrs) Returns Whether the special meta region replica peer is enabled on hrs
private void	primaryIncreaseReplicaIncrease(long[] before, long[] after)
private void	primaryIncreaseReplicaNoChange(long[] before, long[] after)
private void	primaryMayIncreaseReplicaNoChange(long[] before, long[] after)
private void	primaryNoChangeReplicaIncrease(long[] before, long[] after)
void	testCatalogReplicaReplicationWithFlushAndCompaction()
void	testCatalogReplicaReplicationWithReplicaMoved()
void	testHBaseMetaReplicaGets()
void	testHBaseMetaReplicates() Test meta region replica replication.
private void	testHBaseMetaReplicatesOneRow(int i) Test meta region replica replication.
void	testHBaseMetaReplicationSourceCreatedOnOpen() Assert that the ReplicationSource for hbase:meta gets created when hbase:meta is opened.
private void	verifyDeletedReplication(org.apache.hadoop.hbase.TableName tableName, int regionReplication, org.apache.hadoop.hbase.TableName deletedTableName) Verify when a Table is deleted from primary, then there are no references in replicas (because they get the delete of the table rows too).
protected void	verifyReplication(org.apache.hadoop.hbase.TableName tableName, int regionReplication, int startRow, int endRow, byte[] family)
private void	verifyReplication(org.apache.hadoop.hbase.TableName tableName, int regionReplication, int startRow, int endRow, byte[] family, boolean present)
private void	verifyReplication(org.apache.hadoop.hbase.TableName tableName, int regionReplication, List<org.apache.hadoop.hbase.client.Result> contains) Verify Replicas have results (exactly).
private void	waitForMetaReplicasToOnline() Replicas come online after primary.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CLASS_RULE

public static final HBaseClassTestRule CLASS_RULE

LOG

private static final org.slf4j.Logger LOG

NB_SERVERS

private static final int NB_SERVERS

See Also:

Constant Field Values

HTU

private final HBaseTestingUtility HTU

numOfMetaReplica

private int numOfMetaReplica

VALUE

private static byte[] VALUE

name

public org.junit.rules.TestName name

Constructor Detail

TestMetaRegionReplicaReplicationEndpoint

public TestMetaRegionReplicaReplicationEndpoint()

Method Detail

before

public void before()
            throws Exception

Throws:

Exception

after

public void after()
           throws Exception

Throws:

Exception

testHBaseMetaReplicationSourceCreatedOnOpen

public void testHBaseMetaReplicationSourceCreatedOnOpen()
                                                 throws Exception

Assert that the ReplicationSource for hbase:meta gets created when hbase:meta is opened.

Throws:

Exception

testHBaseMetaReplicatesOneRow

private void testHBaseMetaReplicatesOneRow(int i)
                                    throws Exception

Test meta region replica replication. Create some tables and see if replicas pick up the additions.

Throws:

Exception

isMetaRegionReplicaReplicationSource

private boolean isMetaRegionReplicaReplicationSource(org.apache.hadoop.hbase.regionserver.HRegionServer hrs)

Returns Whether the special meta region replica peer is enabled on hrs

testHBaseMetaReplicates

public void testHBaseMetaReplicates()
                             throws Exception

Test meta region replica replication. Create some tables and see if replicas pick up the additions.

Throws:

Exception

testCatalogReplicaReplicationWithFlushAndCompaction

public void testCatalogReplicaReplicationWithFlushAndCompaction()
                                                         throws Exception

Throws:

Exception

testCatalogReplicaReplicationWithReplicaMoved

public void testCatalogReplicaReplicationWithReplicaMoved()
                                                   throws Exception

Throws:

Exception

verifyReplication

protected void verifyReplication(org.apache.hadoop.hbase.TableName tableName,
                                 int regionReplication,
                                 int startRow,
                                 int endRow,
                                 byte[] family)
                          throws Exception

Throws:

Exception

verifyReplication

private void verifyReplication(org.apache.hadoop.hbase.TableName tableName,
                               int regionReplication,
                               int startRow,
                               int endRow,
                               byte[] family,
                               boolean present)
                        throws Exception

Throws:

Exception

waitForMetaReplicasToOnline

private void waitForMetaReplicasToOnline()
                                  throws IOException

Replicas come online after primary.

Throws:

IOException

getMetaCells

private List<org.apache.hadoop.hbase.client.Result> getMetaCells(org.apache.hadoop.hbase.TableName tableName)
                                                          throws IOException

Scan hbase:meta for tableName content.

Throws:

IOException

getAllRegions

private org.apache.hadoop.hbase.regionserver.Region[] getAllRegions(org.apache.hadoop.hbase.TableName tableName,
                                                                    int replication)

Returns All Regions for tableName including Replicas.

getOneRegion

private org.apache.hadoop.hbase.regionserver.Region getOneRegion(org.apache.hadoop.hbase.TableName tableName)

verifyDeletedReplication

private void verifyDeletedReplication(org.apache.hadoop.hbase.TableName tableName,
                                      int regionReplication,
                                      org.apache.hadoop.hbase.TableName deletedTableName)

Verify when a Table is deleted from primary, then there are no references in replicas (because they get the delete of the table rows too).

doesNotContain

private boolean doesNotContain(List<org.apache.hadoop.hbase.Cell> cells,
                               org.apache.hadoop.hbase.TableName tableName)

Cells are from hbase:meta replica so will start w/ 'tableName,'; i.e. the tablename followed by HConstants.DELIMITER. Make sure the deleted table is no longer present in passed cells.

verifyReplication

private void verifyReplication(org.apache.hadoop.hbase.TableName tableName,
                               int regionReplication,
                               List<org.apache.hadoop.hbase.client.Result> contains)

Verify Replicas have results (exactly).

contains

static boolean contains(List<org.apache.hadoop.hbase.client.Result> contains,
                        List<org.apache.hadoop.hbase.Cell> cells)
                 throws IOException

Presumes sorted Cells. Verify that cells has contains at least.

Throws:

IOException

doNGets

private void doNGets(org.apache.hadoop.hbase.client.Table table,
                     byte[][] keys)
              throws Exception

Throws:

Exception

primaryNoChangeReplicaIncrease

private void primaryNoChangeReplicaIncrease(long[] before,
                                            long[] after)

primaryIncreaseReplicaNoChange

private void primaryIncreaseReplicaNoChange(long[] before,
                                            long[] after)

primaryMayIncreaseReplicaNoChange

private void primaryMayIncreaseReplicaNoChange(long[] before,
                                               long[] after)

primaryIncreaseReplicaIncrease

private void primaryIncreaseReplicaIncrease(long[] before,
                                            long[] after)

getMetaReplicaReadRequests

private void getMetaReplicaReadRequests(org.apache.hadoop.hbase.regionserver.Region[] metaRegions,
                                        long[] counters)

testHBaseMetaReplicaGets

public void testHBaseMetaReplicaGets()
                              throws Exception

Throws:

Exception