Class HashTable.TableHash
java.lang.Object
org.apache.hadoop.hbase.mapreduce.HashTable.TableHash
- Enclosing class:
- HashTable
-
Nested Class Summary
-
Field Summary
Modifier and TypeFieldDescription(package private) long
(package private) long
(package private) String
(package private) org.apache.hadoop.fs.Path
(package private) boolean
(package private) int
(package private) List<ImmutableBytesWritable>
(package private) boolean
(package private) int
(package private) byte[]
(package private) long
(package private) byte[]
(package private) String
(package private) int
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescription(package private) static String
getDataFileName
(int hashFileIndex) (package private) Scan
initScan()
newReader
(org.apache.hadoop.conf.Configuration conf, ImmutableBytesWritable startKey) Open a TableHash.Reader starting at the first hash at or after the given key.static HashTable.TableHash
read
(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path hashDir) private void
readPartitionFile
(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) (package private) void
readPropertiesFile
(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) (package private) void
selectPartitions
(Pair<byte[][], byte[][]> regionStartEndKeys) Choose partitions between row ranges to hash to a single output file Selects region boundaries that fall within the scan range, and groups them into the desired number of partitions.toString()
(package private) void
writePartitionFile
(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) (package private) void
writePropertiesFile
(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path)
-
Field Details
-
hashDir
org.apache.hadoop.fs.Path hashDir -
tableName
-
families
-
batchSize
long batchSize -
numHashFiles
int numHashFiles -
startRow
byte[] startRow -
stopRow
byte[] stopRow -
scanBatch
int scanBatch -
versions
int versions -
startTime
long startTime -
endTime
long endTime -
ignoreTimestamps
boolean ignoreTimestamps -
rawScan
boolean rawScan -
partitions
-
-
Constructor Details
-
TableHash
public TableHash()
-
-
Method Details
-
read
public static HashTable.TableHash read(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path hashDir) throws IOException - Throws:
IOException
-
writePropertiesFile
void writePropertiesFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
readPropertiesFile
void readPropertiesFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
initScan
- Throws:
IOException
-
selectPartitions
Choose partitions between row ranges to hash to a single output file Selects region boundaries that fall within the scan range, and groups them into the desired number of partitions. -
writePartitionFile
void writePartitionFile(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
readPartitionFile
private void readPartitionFile(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path path) throws IOException - Throws:
IOException
-
toString
-
getDataFileName
-
newReader
public HashTable.TableHash.Reader newReader(org.apache.hadoop.conf.Configuration conf, ImmutableBytesWritable startKey) throws IOException Open a TableHash.Reader starting at the first hash at or after the given key.- Throws:
IOException
-