Field Detail

• generalBloomFilterWriter

  private final BloomFilterWriter generalBloomFilterWriter

• deleteFamilyBloomFilterWriter

  private final BloomFilterWriter deleteFamilyBloomFilterWriter

• bloomType

  private final BloomType bloomType

• lastBloomKey

  private byte[] lastBloomKey

• lastBloomKeyOffset

  private int lastBloomKeyOffset

• lastBloomKeyLen

  private int lastBloomKeyLen

• kvComparator

  private KeyValue.KVComparator kvComparator

• lastCell

  private Cell lastCell

• earliestPutTs

  private long earliestPutTs

• lastDeleteFamilyCell

  private Cell lastDeleteFamilyCell

• deleteFamilyCnt

  private long deleteFamilyCnt

• timeRangeTracker

  TimeRangeTracker timeRangeTracker

• isTimeRangeTrackerSet

  boolean isTimeRangeTrackerSet

• writer

  protected HFile.Writer writer

Constructor Detail

• StoreFile.Writer

  private StoreFile.Writer(org.apache.hadoop.fs.FileSystem fs,
                  org.apache.hadoop.fs.Path path,
                  org.apache.hadoop.conf.Configuration conf,
                  CacheConfig cacheConf,
                  KeyValue.KVComparator comparator,
                  BloomType bloomType,
                  long maxKeys,
                  InetSocketAddress[] favoredNodes,
                  HFileContext fileContext,
                  boolean shouldDropCacheBehind)
                    throws IOException

  Creates an HFile.Writer that also write helpful meta data.

  Parameters:

  fs - file system to write to

  path - file name to create

  conf - user configuration

  comparator - key comparator

  bloomType - bloom filter setting

  maxKeys - the expected maximum number of keys to be added. Was used for Bloom filter size in HFile format version 1.

  favoredNodes -

  fileContext - - The HFile context

  shouldDropCacheBehind - Drop pages written to page cache after writing the store file.

  Throws:

  IOException - problem writing to FS

Method Detail

• appendMetadata

  public void appendMetadata(long maxSequenceId,
                    boolean majorCompaction)
                      throws IOException

  Writes meta data. Call before close() since its written as meta data to this file.

  Parameters:

  maxSequenceId - Maximum sequence id.

  majorCompaction - True if this file is product of a major compaction

  Throws:

  IOException - problem writing to FS

• appendTrackedTimestampsToMetadata

  public void appendTrackedTimestampsToMetadata()
                                         throws IOException

  Add TimestampRange and earliest put timestamp to Metadata

  Throws:

  IOException

• setTimeRangeTracker

  public void setTimeRangeTracker(TimeRangeTracker trt)

  Set TimeRangeTracker

  Parameters:

  trt -

• trackTimestamps

  public void trackTimestamps(Cell cell)

  Record the earlest Put timestamp. If the timeRangeTracker is not set, update TimeRangeTracker to include the timestamp of this key

  Parameters:

  cell -

• appendGeneralBloomfilter

  private void appendGeneralBloomfilter(Cell cell)
                                 throws IOException

  Throws:

  IOException

• appendDeleteFamilyBloomFilter

  private void appendDeleteFamilyBloomFilter(Cell cell)
                                      throws IOException

  Throws:

  IOException

• append

  public void append(Cell cell)
              throws IOException

  Specified by:

  append in interface Compactor.CellSink

  Throws:

  IOException

• getPath

  public org.apache.hadoop.fs.Path getPath()

• hasGeneralBloom

  boolean hasGeneralBloom()

• getGeneralBloomWriter

  BloomFilterWriter getGeneralBloomWriter()

  For unit testing only.

  Returns:

  the Bloom filter used by this writer.

• closeBloomFilter

  private boolean closeBloomFilter(BloomFilterWriter bfw)
                            throws IOException

  Throws:

  IOException

• closeGeneralBloomFilter

  private boolean closeGeneralBloomFilter()
                                   throws IOException

  Throws:

  IOException

• closeDeleteFamilyBloomFilter

  private boolean closeDeleteFamilyBloomFilter()
                                        throws IOException

  Throws:

  IOException

• close

  public void close()
             throws IOException

  Throws:

  IOException

• appendFileInfo

  public void appendFileInfo(byte[] key,
                    byte[] value)
                      throws IOException

  Throws:

  IOException

• getHFileWriter

  HFile.Writer getHFileWriter()

  For use in testing, e.g. CreateRandomStoreFile