org.apache.hadoop.hbase.coprocessor

Class Export

java.lang.Object

org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService

org.apache.hadoop.hbase.coprocessor.Export

All Implemented Interfaces:

com.google.protobuf.Service, Coprocessor, RegionCoprocessor

@InterfaceAudience.LimitedPrivate(value="Coprocesssor")
 @InterfaceStability.Evolving
public class Export
extends org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService
implements RegionCoprocessor

Export an HBase table. Writes content to sequence files up in HDFS. Use Import to read it back in again. It is implemented by the endpoint technique.

See Also:

Export

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private static class	Export.PrivilegedWriter
private static class	Export.RegionOp
static class	Export.Response
private static class	Export.ScanCoprocessor
private static class	Export.SecureWriter

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService

org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService.BlockingInterface, org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService.Interface, org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService.Stub

Nested classes/interfaces inherited from interface org.apache.hadoop.hbase.Coprocessor

Coprocessor.State

Field Summary

Fields

Modifier and Type	Field and Description
private static Class<? extends org.apache.hadoop.io.compress.CompressionCodec>	DEFAULT_CODEC
private static org.apache.hadoop.io.SequenceFile.CompressionType	DEFAULT_TYPE
private RegionCoprocessorEnvironment	env
private static org.slf4j.Logger	LOG
private UserProvider	userProvider

Fields inherited from interface org.apache.hadoop.hbase.Coprocessor

PRIORITY_HIGHEST, PRIORITY_LOWEST, PRIORITY_SYSTEM, PRIORITY_USER, VERSION

Constructor Summary

Constructors

Constructor and Description
Export()

Method Summary

Modifier and Type	Method and Description
private static void	checkDir(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path dir)
void	export(com.google.protobuf.RpcController controller, org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request, com.google.protobuf.RpcCallback<org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportResponse> done) rpc export(.hbase.pb.ExportRequest) returns (.hbase.pb.ExportResponse);
private static boolean	getCompression(org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
private static org.apache.hadoop.io.compress.CompressionCodec	getCompressionCodec(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
private static org.apache.hadoop.io.SequenceFile.CompressionType	getCompressionType(org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
private static org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest	getConfiguredRequest(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path dir, Scan scan, org.apache.hadoop.security.token.Token<?> userToken)
private static org.apache.hadoop.io.SequenceFile.Writer.Option	getOutputPath(org.apache.hadoop.conf.Configuration conf, RegionInfo info, org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
Iterable<com.google.protobuf.Service>	getServices() Coprocessor endpoints providing protobuf services should override this method.
private static List<org.apache.hadoop.io.SequenceFile.Writer.Option>	getWriterOptions(org.apache.hadoop.conf.Configuration conf, RegionInfo info, org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
static void	main(String[] args)
private static org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportResponse	processData(Region region, org.apache.hadoop.conf.Configuration conf, UserProvider userProvider, Scan scan, org.apache.hadoop.security.token.Token userToken, List<org.apache.hadoop.io.SequenceFile.Writer.Option> opts)
(package private) static Map<byte[],Export.Response>	run(org.apache.hadoop.conf.Configuration conf, String[] args)
static Map<byte[],Export.Response>	run(org.apache.hadoop.conf.Configuration conf, TableName tableName, Scan scan, org.apache.hadoop.fs.Path dir)
void	start(CoprocessorEnvironment environment) Called by the CoprocessorEnvironment during it's own startup to initialize the coprocessor.
void	stop(CoprocessorEnvironment env) Called by the CoprocessorEnvironment during it's own shutdown to stop the coprocessor.
private Scan	validateKey(RegionInfo region, org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)

Methods inherited from class org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService

callMethod, getDescriptor, getDescriptorForType, getRequestPrototype, getResponsePrototype, newBlockingStub, newReflectiveBlockingService, newReflectiveService, newStub

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hbase.coprocessor.RegionCoprocessor

getBulkLoadObserver, getEndpointObserver, getRegionObserver

Field Detail

LOG

private static final org.slf4j.Logger LOG

DEFAULT_CODEC

private static final Class<? extends org.apache.hadoop.io.compress.CompressionCodec> DEFAULT_CODEC

DEFAULT_TYPE

private static final org.apache.hadoop.io.SequenceFile.CompressionType DEFAULT_TYPE

env

private RegionCoprocessorEnvironment env

userProvider

private UserProvider userProvider

Constructor Detail

Export

public Export()

Method Detail

main

public static void main(String[] args)
                 throws Throwable

Throws:

Throwable

run

static Map<byte[],Export.Response> run(org.apache.hadoop.conf.Configuration conf,
                                       String[] args)
                                throws Throwable

Throws:

Throwable

run

public static Map<byte[],Export.Response> run(org.apache.hadoop.conf.Configuration conf,
                                              TableName tableName,
                                              Scan scan,
                                              org.apache.hadoop.fs.Path dir)
                                       throws Throwable

Throws:

Throwable

getCompression

private static boolean getCompression(org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)

getCompressionType

private static org.apache.hadoop.io.SequenceFile.CompressionType getCompressionType(org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)

getCompressionCodec

private static org.apache.hadoop.io.compress.CompressionCodec getCompressionCodec(org.apache.hadoop.conf.Configuration conf,
                                                                                  org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)

getOutputPath

private static org.apache.hadoop.io.SequenceFile.Writer.Option getOutputPath(org.apache.hadoop.conf.Configuration conf,
                                                                             RegionInfo info,
                                                                             org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
                                                                      throws IOException

Throws:

IOException

getWriterOptions

private static List<org.apache.hadoop.io.SequenceFile.Writer.Option> getWriterOptions(org.apache.hadoop.conf.Configuration conf,
                                                                                      RegionInfo info,
                                                                                      org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
                                                                               throws IOException

Throws:

IOException

processData

private static org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportResponse processData(Region region,
                                                                                                  org.apache.hadoop.conf.Configuration conf,
                                                                                                  UserProvider userProvider,
                                                                                                  Scan scan,
                                                                                                  org.apache.hadoop.security.token.Token userToken,
                                                                                                  List<org.apache.hadoop.io.SequenceFile.Writer.Option> opts)
                                                                                           throws IOException

Throws:

IOException

checkDir

private static void checkDir(org.apache.hadoop.fs.FileSystem fs,
                             org.apache.hadoop.fs.Path dir)
                      throws IOException

Throws:

IOException

getConfiguredRequest

private static org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest getConfiguredRequest(org.apache.hadoop.conf.Configuration conf,
                                                                                                          org.apache.hadoop.fs.Path dir,
                                                                                                          Scan scan,
                                                                                                          org.apache.hadoop.security.token.Token<?> userToken)
                                                                                                   throws IOException

Throws:

IOException

start

public void start(CoprocessorEnvironment environment)
           throws IOException

Description copied from interface: Coprocessor

Called by the CoprocessorEnvironment during it's own startup to initialize the coprocessor.

Specified by:

start in interface Coprocessor

Throws:

IOException

stop

public void stop(CoprocessorEnvironment env)
          throws IOException

Description copied from interface: Coprocessor

Called by the CoprocessorEnvironment during it's own shutdown to stop the coprocessor.

Specified by:

stop in interface Coprocessor

Throws:

IOException

getServices

public Iterable<com.google.protobuf.Service> getServices()

Description copied from interface: Coprocessor

Coprocessor endpoints providing protobuf services should override this method.

Specified by:

getServices in interface Coprocessor

Returns:

Iterable of Services or empty collection. Implementations should never return null.

export

public void export(com.google.protobuf.RpcController controller,
                   org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request,
                   com.google.protobuf.RpcCallback<org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportResponse> done)

Description copied from class: org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService

rpc export(.hbase.pb.ExportRequest) returns (.hbase.pb.ExportResponse);

Specified by:

export in class org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportService

validateKey

private Scan validateKey(RegionInfo region,
                         org.apache.hadoop.hbase.protobuf.generated.ExportProtos.ExportRequest request)
                  throws IOException

Throws:

IOException