org.apache.hadoop.hbase.mapreduce

Class SimpleTotalOrderPartitioner<VALUE>

java.lang.Object

org.apache.hadoop.mapreduce.Partitioner<ImmutableBytesWritable,VALUE>

org.apache.hadoop.hbase.mapreduce.SimpleTotalOrderPartitioner<VALUE>

Type Parameters:

VALUE -

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

@InterfaceAudience.Public
public class SimpleTotalOrderPartitioner<VALUE>
extends org.apache.hadoop.mapreduce.Partitioner<ImmutableBytesWritable,VALUE>
implements org.apache.hadoop.conf.Configurable

A partitioner that takes start and end keys and uses bigdecimal to figure which reduce a key belongs to. Pass the start and end keys in the Configuration using hbase.simpletotalorder.start and hbase.simpletotalorder.end. The end key needs to be exclusive; i.e. one larger than the biggest key in your key space. You may be surprised at how this class partitions the space; it may not align with preconceptions; e.g. a start key of zero and an end key of 100 divided in ten will not make regions whose range is 0-10, 10-20, and so on. Make your own partitioner if you need the region spacing to come out a particular way.

See Also:

START, END

Field Summary

Fields

Modifier and Type	Field and Description
private org.apache.hadoop.conf.Configuration	c
static String	END Deprecated. since 0.90.0
(package private) static String	END_BASE64
private byte[]	endkey
private int	lastReduces
private static org.slf4j.Logger	LOG
private byte[][]	splits
static String	START Deprecated. since 0.90.0
(package private) static String	START_BASE64
private byte[]	startkey

Constructor Summary

Constructors

Constructor and Description
SimpleTotalOrderPartitioner()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
(package private) static byte[]	getEndKey(org.apache.hadoop.conf.Configuration conf)
private static byte[]	getKeyFromConf(org.apache.hadoop.conf.Configuration conf, String base64Key, String deprecatedKey)
int	getPartition(ImmutableBytesWritable key, VALUE value, int reduces)
(package private) static byte[]	getStartKey(org.apache.hadoop.conf.Configuration conf)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setEndKey(org.apache.hadoop.conf.Configuration conf, byte[] endKey)
static void	setStartKey(org.apache.hadoop.conf.Configuration conf, byte[] startKey)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

private static final org.slf4j.Logger LOG

START

@Deprecated
public static final String START

Deprecated. since 0.90.0

See Also:

HBASE-1923, Constant Field Values

END

@Deprecated
public static final String END

Deprecated. since 0.90.0

See Also:

HBASE-1923, Constant Field Values

START_BASE64

static final String START_BASE64

See Also:

Constant Field Values

END_BASE64

static final String END_BASE64

See Also:

Constant Field Values

c

private org.apache.hadoop.conf.Configuration c

startkey

private byte[] startkey

endkey

private byte[] endkey

splits

private byte[][] splits

lastReduces

private int lastReduces

Constructor Detail

SimpleTotalOrderPartitioner

public SimpleTotalOrderPartitioner()

Method Detail

setStartKey

public static void setStartKey(org.apache.hadoop.conf.Configuration conf,
                               byte[] startKey)

setEndKey

public static void setEndKey(org.apache.hadoop.conf.Configuration conf,
                             byte[] endKey)

getStartKey

static byte[] getStartKey(org.apache.hadoop.conf.Configuration conf)

getEndKey

static byte[] getEndKey(org.apache.hadoop.conf.Configuration conf)

getKeyFromConf

private static byte[] getKeyFromConf(org.apache.hadoop.conf.Configuration conf,
                                     String base64Key,
                                     String deprecatedKey)

getPartition

public int getPartition(ImmutableBytesWritable key,
                        VALUE value,
                        int reduces)

Specified by:

getPartition in class org.apache.hadoop.mapreduce.Partitioner<ImmutableBytesWritable,VALUE>

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable