org.apache.hadoop.hbase

Class HBaseClusterManager

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.hadoop.hbase.HBaseClusterManager

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, ClusterManager

@InterfaceAudience.Private
public class HBaseClusterManager
extends org.apache.hadoop.conf.Configured
implements ClusterManager

A default cluster manager for HBase. Uses SSH, and hbase shell scripts to manage the cluster. Assumes Unix-like commands are available like 'ps', 'kill', etc. Also assumes the user running the test has enough "power" to start & stop servers on the remote machines (for example, the test user could be the same user as the user the daemon is running as)

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
(package private) static class	HBaseClusterManager.CommandProvider Provides command strings for services to be executed by Shell.
(package private) static class	HBaseClusterManager.HadoopShellCommandProvider CommandProvider to manage the service using sbin/hadoop-* scripts.
(package private) static class	HBaseClusterManager.HBaseShellCommandProvider CommandProvider to manage the service using bin/hbase-* scripts
protected class	HBaseClusterManager.RemoteShell Executes commands over SSH
(package private) static class	HBaseClusterManager.ZookeeperShellCommandProvider CommandProvider to manage the service using bin/zk* scripts.

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.ClusterManager

ClusterManager.ServiceType

Field Summary

Fields

Modifier and Type	Field and Description
private static int	DEFAULT_RETRY_ATTEMPTS
private static int	DEFAULT_RETRY_SLEEP_INTERVAL
private static String	DEFAULT_TUNNEL_CMD The command format that is used to execute the remote command.
protected static org.slf4j.Logger	LOG
private static String	RETRY_ATTEMPTS_KEY
private static String	RETRY_SLEEP_INTERVAL_KEY
protected org.apache.hadoop.hbase.util.RetryCounterFactory	retryCounterFactory
private static String	SIGCONT
private static String	SIGKILL
private static String	SIGSTOP
private String	sshOptions
private String	sshUserName
private String	tunnelCmd

Constructor Summary

Constructors

Constructor and Description
HBaseClusterManager()

Method Summary

Modifier and Type	Method and Description
private void	exec(String hostname, ClusterManager.ServiceType service, HBaseClusterManager.CommandProvider.Operation op)
private org.apache.hadoop.hbase.util.Pair<Integer,String>	exec(String hostname, ClusterManager.ServiceType service, String... cmd) Execute the given command on the host using SSH
private org.apache.hadoop.hbase.util.Pair<Integer,String>	execWithRetries(String hostname, ClusterManager.ServiceType service, String... cmd)
protected HBaseClusterManager.CommandProvider	getCommandProvider(ClusterManager.ServiceType service)
private String	getServiceUser(ClusterManager.ServiceType service)
boolean	isRunning(ClusterManager.ServiceType service, String hostname, int port) Returns whether the service is running on the remote host.
void	kill(ClusterManager.ServiceType service, String hostname, int port) Kills the service running on the given host
void	restart(ClusterManager.ServiceType service, String hostname, int port) Restart the service on the given host
void	resume(ClusterManager.ServiceType service, String hostname, int port) Resumes the services running on the given host
private <E extends Exception> void	retryOrThrow(org.apache.hadoop.hbase.util.RetryCounter retryCounter, E ex, String hostname, String[] cmd)
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	signal(ClusterManager.ServiceType service, String signal, String hostname)
void	start(ClusterManager.ServiceType service, String hostname, int port) Start the service on the given host
void	stop(ClusterManager.ServiceType service, String hostname, int port) Stop the service on the given host
void	suspend(ClusterManager.ServiceType service, String hostname, int port) Suspends the service running on the given host

Methods inherited from class org.apache.hadoop.conf.Configured

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf

Field Detail

SIGKILL

private static final String SIGKILL

See Also:

Constant Field Values

SIGSTOP

private static final String SIGSTOP

See Also:

Constant Field Values

SIGCONT

private static final String SIGCONT

See Also:

Constant Field Values

LOG

protected static final org.slf4j.Logger LOG

sshUserName

private String sshUserName

sshOptions

private String sshOptions

DEFAULT_TUNNEL_CMD

private static final String DEFAULT_TUNNEL_CMD

The command format that is used to execute the remote command. Arguments: 1 SSH options, 2 user name , 3 "@" if username is set, 4 host, 5 original command, 6 service user.

See Also:

Constant Field Values

tunnelCmd

private String tunnelCmd

RETRY_ATTEMPTS_KEY

private static final String RETRY_ATTEMPTS_KEY

See Also:

Constant Field Values

DEFAULT_RETRY_ATTEMPTS

private static final int DEFAULT_RETRY_ATTEMPTS

See Also:

Constant Field Values

RETRY_SLEEP_INTERVAL_KEY

private static final String RETRY_SLEEP_INTERVAL_KEY

See Also:

Constant Field Values

DEFAULT_RETRY_SLEEP_INTERVAL

private static final int DEFAULT_RETRY_SLEEP_INTERVAL

See Also:

Constant Field Values

retryCounterFactory

protected org.apache.hadoop.hbase.util.RetryCounterFactory retryCounterFactory

Constructor Detail

HBaseClusterManager

public HBaseClusterManager()

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

getServiceUser

private String getServiceUser(ClusterManager.ServiceType service)

getCommandProvider

protected HBaseClusterManager.CommandProvider getCommandProvider(ClusterManager.ServiceType service)
                                                          throws IOException

Throws:

IOException

exec

private org.apache.hadoop.hbase.util.Pair<Integer,String> exec(String hostname,
                                                               ClusterManager.ServiceType service,
                                                               String... cmd)
                                                        throws IOException

Execute the given command on the host using SSH

Returns:

pair of exit code and command output

Throws:

IOException - if something goes wrong.

execWithRetries

private org.apache.hadoop.hbase.util.Pair<Integer,String> execWithRetries(String hostname,
                                                                          ClusterManager.ServiceType service,
                                                                          String... cmd)
                                                                   throws IOException

Throws:

IOException

retryOrThrow

private <E extends Exception> void retryOrThrow(org.apache.hadoop.hbase.util.RetryCounter retryCounter,
                                                E ex,
                                                String hostname,
                                                String[] cmd)
                                         throws E extends Exception

Throws:

E extends Exception

exec

private void exec(String hostname,
                  ClusterManager.ServiceType service,
                  HBaseClusterManager.CommandProvider.Operation op)
           throws IOException

Throws:

IOException

start

public void start(ClusterManager.ServiceType service,
                  String hostname,
                  int port)
           throws IOException

Description copied from interface: ClusterManager

Start the service on the given host

Specified by:

start in interface ClusterManager

Throws:

IOException

stop

public void stop(ClusterManager.ServiceType service,
                 String hostname,
                 int port)
          throws IOException

Description copied from interface: ClusterManager

Stop the service on the given host

Specified by:

stop in interface ClusterManager

Throws:

IOException

restart

public void restart(ClusterManager.ServiceType service,
                    String hostname,
                    int port)
             throws IOException

Description copied from interface: ClusterManager

Restart the service on the given host

Specified by:

restart in interface ClusterManager

Throws:

IOException

signal

public void signal(ClusterManager.ServiceType service,
                   String signal,
                   String hostname)
            throws IOException

Throws:

IOException

isRunning

public boolean isRunning(ClusterManager.ServiceType service,
                         String hostname,
                         int port)
                  throws IOException

Description copied from interface: ClusterManager

Returns whether the service is running on the remote host. This only checks whether the service still has a pid.

Specified by:

isRunning in interface ClusterManager

Throws:

IOException

kill

public void kill(ClusterManager.ServiceType service,
                 String hostname,
                 int port)
          throws IOException

Description copied from interface: ClusterManager

Kills the service running on the given host

Specified by:

kill in interface ClusterManager

Throws:

IOException

suspend

public void suspend(ClusterManager.ServiceType service,
                    String hostname,
                    int port)
             throws IOException

Description copied from interface: ClusterManager

Suspends the service running on the given host

Specified by:

suspend in interface ClusterManager

Throws:

IOException

resume

public void resume(ClusterManager.ServiceType service,
                   String hostname,
                   int port)
            throws IOException

Description copied from interface: ClusterManager

Resumes the services running on the given host

Specified by:

resume in interface ClusterManager

Throws:

IOException