Package org.apache.hadoop.hbase.mapreduce

Class SimpleTotalOrderPartitioner<VALUE>

java.lang.Object

org.apache.hadoop.mapreduce.Partitioner<ImmutableBytesWritable,VALUE>

org.apache.hadoop.hbase.mapreduce.SimpleTotalOrderPartitioner<VALUE>

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

@Public
public class SimpleTotalOrderPartitioner<VALUE>
extends org.apache.hadoop.mapreduce.Partitioner<ImmutableBytesWritable,VALUE>
implements org.apache.hadoop.conf.Configurable

A partitioner that takes start and end keys and uses bigdecimal to figure which reduce a key belongs to. Pass the start and end keys in the Configuration using "hbase.simpletotalorder.start.base64" and "hbase.simpletotalorder.end.base64". The end key needs to be exclusive; i.e. one larger than the biggest key in your key space. You may be surprised at how this class partitions the space; it may not align with preconceptions; e.g. a start key of zero and an end key of 100 divided in ten will not make regions whose range is 0-10, 10-20, and so on. Make your own partitioner if you need the region spacing to come out a particular way.

See Also:

• START_BASE64
• END_BASE64

Field Summary

Fields

Modifier and Type	Field	Description
private org.apache.hadoop.conf.Configuration	c
(package private) static final String	END_BASE64
private byte[]	endkey
private int	lastReduces
private static final org.slf4j.Logger	LOG
private byte[][]	splits
(package private) static final String	START_BASE64
private byte[]	startkey

Constructor Summary

Constructors

Constructor	Description
SimpleTotalOrderPartitioner()

Method Summary

Modifier and Type	Method	Description
private static byte[]	getBase64KeyFromConf(org.apache.hadoop.conf.Configuration conf, String base64Key)
org.apache.hadoop.conf.Configuration	getConf()
(package private) static byte[]	getEndKey(org.apache.hadoop.conf.Configuration conf)
int	getPartition(ImmutableBytesWritable key, VALUE value, int reduces)
(package private) static byte[]	getStartKey(org.apache.hadoop.conf.Configuration conf)
void	setConf(org.apache.hadoop.conf.Configuration conf)
static void	setEndKey(org.apache.hadoop.conf.Configuration conf, byte[] endKey)
static void	setStartKey(org.apache.hadoop.conf.Configuration conf, byte[] startKey)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

LOG

private static final org.slf4j.Logger LOG

START_BASE64

static final String START_BASE64

See Also:

• Constant Field Values

END_BASE64

static final String END_BASE64

See Also:

• Constant Field Values

c

private org.apache.hadoop.conf.Configuration c

startkey

private byte[] startkey

endkey

private byte[] endkey

splits

private byte[][] splits

lastReduces

private int lastReduces

Constructor Details

SimpleTotalOrderPartitioner

public SimpleTotalOrderPartitioner()

Method Details

setStartKey

public static void setStartKey(org.apache.hadoop.conf.Configuration conf,
 byte[] startKey)

setEndKey

public static void setEndKey(org.apache.hadoop.conf.Configuration conf,
 byte[] endKey)

getStartKey

static byte[] getStartKey(org.apache.hadoop.conf.Configuration conf)

getEndKey

static byte[] getEndKey(org.apache.hadoop.conf.Configuration conf)

getBase64KeyFromConf

private static byte[] getBase64KeyFromConf(org.apache.hadoop.conf.Configuration conf,
 String base64Key)

getPartition

public int getPartition(ImmutableBytesWritable key,
 VALUE value,
 int reduces)

Specified by:

getPartition in class org.apache.hadoop.mapreduce.Partitioner<ImmutableBytesWritable,VALUE>

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable