Package org.apache.hadoop.hbase

Class LocalHBaseCluster

java.lang.Object

org.apache.hadoop.hbase.LocalHBaseCluster

@Private
public class LocalHBaseCluster
extends Object

This class creates a single process HBase cluster. One thread is created for a master and one per region server. Call startup() to start the cluster running and shutdown() to close it all down. join() the cluster is you want to wait on shutdown completion.

Runs master on port 16000 by default. Because we can't just kill the process -- not till HADOOP-1700 gets fixed and even then.... -- we need to be able to find the master with a remote client to run shutdown. To use a port other than 16000, set the hbase.master to a value of 'local:PORT': that is 'local', not 'localhost', and the port number the master should use instead of 16000.

Field Summary

Fields

Modifier and Type	Field	Description
static final String	ASSIGN_RANDOM_PORTS
private final org.apache.hadoop.conf.Configuration	conf
private static final int	DEFAULT_NO
static final String	LOCAL	local mode
static final String	LOCAL_COLON	'local:'
private static final org.slf4j.Logger	LOG
private final Class<? extends HMaster>	masterClass
private final List<JVMClusterUtil.MasterThread>	masterThreads
private final Class<? extends HRegionServer>	regionServerClass
private final List<JVMClusterUtil.RegionServerThread>	regionThreads

Constructor Summary

Constructors

Constructor	Description
LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf)	Constructor.
LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf, int noRegionServers)	Constructor.
LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf, int noMasters, int noRegionServers)	Constructor.
LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf, int noMasters, int noAlwaysStandByMasters, int noRegionServers, Class<? extends HMaster> masterClass, Class<? extends HRegionServer> regionServerClass)	Constructor.
LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf, int noMasters, int noRegionServers, Class<? extends HMaster> masterClass, Class<? extends HRegionServer> regionServerClass)

Method Summary

Modifier and Type	Method	Description
JVMClusterUtil.MasterThread	addMaster()
JVMClusterUtil.MasterThread	addMaster(org.apache.hadoop.conf.Configuration c, int index)
JVMClusterUtil.MasterThread	addMaster(org.apache.hadoop.conf.Configuration c, int index, User user)
JVMClusterUtil.RegionServerThread	addRegionServer()
JVMClusterUtil.RegionServerThread	addRegionServer(org.apache.hadoop.conf.Configuration config, int index)
JVMClusterUtil.RegionServerThread	addRegionServer(org.apache.hadoop.conf.Configuration config, int index, User user)
HMaster	getActiveMaster()	Gets the current active master, if available.
org.apache.hadoop.conf.Configuration	getConfiguration()	Returns the Configuration used by this LocalHBaseCluster
List<JVMClusterUtil.MasterThread>	getLiveMasters()
List<JVMClusterUtil.RegionServerThread>	getLiveRegionServers()
HMaster	getMaster(int serverNumber)	Returns the HMaster thread
private static Class<? extends HMaster>	getMasterImplementation(org.apache.hadoop.conf.Configuration conf)
List<JVMClusterUtil.MasterThread>	getMasters()	Returns Read-only list of master threads.
HRegionServer	getRegionServer(int serverNumber)	Returns region server
private static Class<? extends HRegionServer>	getRegionServerImplementation(org.apache.hadoop.conf.Configuration conf)
List<JVMClusterUtil.RegionServerThread>	getRegionServers()	Returns Read-only list of region server threads.
static boolean	isLocal(org.apache.hadoop.conf.Configuration c)
void	join()	Wait for Mini HBase Cluster to shut down.
static void	main(String[] args)	Test things basically work.
void	shutdown()	Shut down the mini HBase cluster
void	startup()	Start the cluster.
String	waitOnMaster(int serverNumber)	Wait for the specified master to stop.
String	waitOnMaster(JVMClusterUtil.MasterThread masterThread)	Wait for the specified master to stop.
String	waitOnRegionServer(int serverNumber)	Wait for the specified region server to stop.
String	waitOnRegionServer(JVMClusterUtil.RegionServerThread rst)	Wait for the specified region server to stop.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

masterThreads

private final List<JVMClusterUtil.MasterThread> masterThreads

regionThreads

private final List<JVMClusterUtil.RegionServerThread> regionThreads

DEFAULT_NO

private static final int DEFAULT_NO

See Also:

• Constant Field Values

LOCAL

public static final String LOCAL

local mode

See Also:

• Constant Field Values

LOCAL_COLON

public static final String LOCAL_COLON

'local:'

See Also:

• Constant Field Values

ASSIGN_RANDOM_PORTS

public static final String ASSIGN_RANDOM_PORTS

See Also:

• Constant Field Values

conf

private final org.apache.hadoop.conf.Configuration conf

masterClass

private final Class<? extends HMaster> masterClass

regionServerClass

private final Class<? extends HRegionServer> regionServerClass

Constructor Details

LocalHBaseCluster

public LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf)
                  throws IOException

Constructor.

Throws:

IOException

LocalHBaseCluster

public LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf,
 int noRegionServers)
                  throws IOException

Constructor.

Parameters:

conf - Configuration to use. Post construction has the master's address.

noRegionServers - Count of regionservers to start.

Throws:

IOException

LocalHBaseCluster

public LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf,
 int noMasters,
 int noRegionServers)
                  throws IOException

Constructor.

Parameters:

conf - Configuration to use. Post construction has the active master address.

noMasters - Count of masters to start.

noRegionServers - Count of regionservers to start.

Throws:

IOException

LocalHBaseCluster

public LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf,
 int noMasters,
 int noRegionServers,
 Class<? extends HMaster> masterClass,
 Class<? extends HRegionServer> regionServerClass)
                  throws IOException

Throws:

IOException

LocalHBaseCluster

public LocalHBaseCluster(org.apache.hadoop.conf.Configuration conf,
 int noMasters,
 int noAlwaysStandByMasters,
 int noRegionServers,
 Class<? extends HMaster> masterClass,
 Class<? extends HRegionServer> regionServerClass)
                  throws IOException

Constructor.

Parameters:

conf - Configuration to use. Post construction has the master's address.

noMasters - Count of masters to start.

noRegionServers - Count of regionservers to start.

Throws:

IOException

Method Details

getRegionServerImplementation

private static Class<? extends HRegionServer> getRegionServerImplementation(org.apache.hadoop.conf.Configuration conf)

getMasterImplementation

private static Class<? extends HMaster> getMasterImplementation(org.apache.hadoop.conf.Configuration conf)

addRegionServer

public JVMClusterUtil.RegionServerThread addRegionServer()
                                                  throws IOException

Throws:

IOException

addRegionServer

public JVMClusterUtil.RegionServerThread addRegionServer(org.apache.hadoop.conf.Configuration config,
 int index)
                                                  throws IOException

Throws:

IOException

addRegionServer

public JVMClusterUtil.RegionServerThread addRegionServer(org.apache.hadoop.conf.Configuration config,
 int index,
 User user)
                                                  throws IOException,
InterruptedException

Throws:

IOException

InterruptedException

addMaster

public JVMClusterUtil.MasterThread addMaster()
                                      throws IOException

Throws:

IOException

addMaster

public JVMClusterUtil.MasterThread addMaster(org.apache.hadoop.conf.Configuration c,
 int index)
                                      throws IOException

Throws:

IOException

addMaster

public JVMClusterUtil.MasterThread addMaster(org.apache.hadoop.conf.Configuration c,
 int index,
 User user)
                                      throws IOException,
InterruptedException

Throws:

IOException

InterruptedException

getRegionServer

public HRegionServer getRegionServer(int serverNumber)

Returns region server

getRegionServers

public List<JVMClusterUtil.RegionServerThread> getRegionServers()

Returns Read-only list of region server threads.

getLiveRegionServers

public List<JVMClusterUtil.RegionServerThread> getLiveRegionServers()

Returns:

List of running servers (Some servers may have been killed or aborted during lifetime of cluster; these servers are not included in this list).

getConfiguration

public org.apache.hadoop.conf.Configuration getConfiguration()

Returns the Configuration used by this LocalHBaseCluster

waitOnRegionServer

public String waitOnRegionServer(int serverNumber)

Wait for the specified region server to stop. Removes this thread from list of running threads.

Returns:

Name of region server that just went down.

waitOnRegionServer

public String waitOnRegionServer(JVMClusterUtil.RegionServerThread rst)

Wait for the specified region server to stop. Removes this thread from list of running threads.

Returns:

Name of region server that just went down.

getMaster

public HMaster getMaster(int serverNumber)

Returns the HMaster thread

getActiveMaster

public HMaster getActiveMaster()

Gets the current active master, if available. If no active master, returns null.

Returns:

the HMaster for the active master

getMasters

public List<JVMClusterUtil.MasterThread> getMasters()

Returns Read-only list of master threads.

getLiveMasters

public List<JVMClusterUtil.MasterThread> getLiveMasters()

Returns:

List of running master servers (Some servers may have been killed or aborted during lifetime of cluster; these servers are not included in this list).

waitOnMaster

public String waitOnMaster(int serverNumber)

Wait for the specified master to stop. Removes this thread from list of running threads.

Returns:

Name of master that just went down.

waitOnMaster

public String waitOnMaster(JVMClusterUtil.MasterThread masterThread)

Wait for the specified master to stop. Removes this thread from list of running threads.

Returns:

Name of master that just went down.

join

public void join()

Wait for Mini HBase Cluster to shut down. Presumes you've already called shutdown().

startup

public void startup()
             throws IOException

Start the cluster.

Throws:

IOException

shutdown

public void shutdown()

Shut down the mini HBase cluster

isLocal

public static boolean isLocal(org.apache.hadoop.conf.Configuration c)

Parameters:

c - Configuration to check.

Returns:

True if a 'local' address in hbase.master value.

main

public static void main(String[] args)
                 throws IOException

Test things basically work.

Throws:

IOException