Class HashTable.TableHash
java.lang.Object
org.apache.hadoop.hbase.mapreduce.HashTable.TableHash
- Enclosing class:
- HashTable
-
Nested Class Summary
Nested Classes -
Field Summary
FieldsModifier and TypeFieldDescription(package private) long(package private) long(package private) String(package private) org.apache.hadoop.fs.Path(package private) boolean(package private) int(package private) List<ImmutableBytesWritable>(package private) boolean(package private) int(package private) byte[](package private) long(package private) byte[](package private) String(package private) int -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescription(package private) static StringgetDataFileName(int hashFileIndex) (package private) ScaninitScan()newReader(org.apache.hadoop.conf.Configuration conf, ImmutableBytesWritable startKey) Open a TableHash.Reader starting at the first hash at or after the given key.static HashTable.TableHashread(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path hashDir) private voidreadPartitionFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) (package private) voidreadPropertiesFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) (package private) voidselectPartitions(Pair<byte[][], byte[][]> regionStartEndKeys) Choose partitions between row ranges to hash to a single output file Selects region boundaries that fall within the scan range, and groups them into the desired number of partitions.toString()(package private) voidwritePartitionFile(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) (package private) voidwritePropertiesFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path)
-
Field Details
-
hashDir
org.apache.hadoop.fs.Path hashDir -
tableName
-
families
-
batchSize
long batchSize -
numHashFiles
int numHashFiles -
startRow
byte[] startRow -
stopRow
byte[] stopRow -
scanBatch
int scanBatch -
versions
int versions -
startTime
long startTime -
endTime
long endTime -
ignoreTimestamps
boolean ignoreTimestamps -
rawScan
boolean rawScan -
partitions
-
-
Constructor Details
-
TableHash
public TableHash()
-
-
Method Details
-
read
public static HashTable.TableHash read(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path hashDir) throws IOException - Throws:
IOException
-
writePropertiesFile
void writePropertiesFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
readPropertiesFile
void readPropertiesFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
initScan
- Throws:
IOException
-
selectPartitions
Choose partitions between row ranges to hash to a single output file Selects region boundaries that fall within the scan range, and groups them into the desired number of partitions. -
writePartitionFile
void writePartitionFile(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
readPartitionFile
private void readPartitionFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
toString
-
getDataFileName
-
newReader
public HashTable.TableHash.Reader newReader(org.apache.hadoop.conf.Configuration conf, ImmutableBytesWritable startKey) throws IOException Open a TableHash.Reader starting at the first hash at or after the given key.- Throws:
IOException
-