Package org.apache.hadoop.hbase.test

Class IntegrationTestBigLinkedList.Verify

java.lang.Object
org.apache.hadoop.conf.Configured
org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList.Verify
All Implemented Interfaces:
org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool
Direct Known Subclasses:
IntegrationTestBigLinkedListWithVisibility.VisibilityVerify
Enclosing class:
IntegrationTestBigLinkedList
static class IntegrationTestBigLinkedList.Verify extends org.apache.hadoop.conf.Configured implements org.apache.hadoop.util.Tool
A Map Reduce job that verifies that the linked lists generated by IntegrationTestBigLinkedList.Generator do not have any holes.

  • Nested Class Summary

    Nested Classes
    Modifier and Type
    Class
    Description
    static enum 
    IntegrationTestBigLinkedList.Verify.VerifyCounts
    Don't change the order of these enums.
    static class 
    IntegrationTestBigLinkedList.Verify.VerifyMapper
     
    static class 
    IntegrationTestBigLinkedList.Verify.VerifyReducer
    Per reducer, we output problem rows as byte arrays so can be used as input for subsequent investigative mapreduce jobs.

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    protected static final org.apache.hadoop.io.BytesWritable
    DEF
     
    protected static final org.apache.hadoop.io.BytesWritable
    DEF_LOST_FAMILIES
     
    protected org.apache.hadoop.mapreduce.Job
    job
     
    private static final org.slf4j.Logger
    LOG
     

  • Constructor Summary

    Constructors
    Constructor
    Description
    Verify()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    protected void
    handleFailure(org.apache.hadoop.mapreduce.Counters counters)
     
    int
    run(String[] args)
     
    int
    run(String outputDir, int numReducers)
     
    int
    run(org.apache.hadoop.fs.Path outputDir, int numReducers)
     
    boolean
    verify(long expectedReferenced)
     
    protected boolean
    verifyExpectedValues(long expectedReferenced, org.apache.hadoop.mapreduce.Counters counters)
    Verify the values in the Counters against the expected number of entries written.
    protected boolean
    verifyUnexpectedValues(org.apache.hadoop.mapreduce.Counters counters)
    Verify that the Counters don't contain values which indicate an outright failure from the Reducers.

    Methods inherited from class org.apache.hadoop.conf.Configured

    getConf, setConf

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface org.apache.hadoop.conf.Configurable

    getConf, setConf

  • Field Details

    • LOG

      private static final org.slf4j.Logger LOG

    • DEF

      protected static final org.apache.hadoop.io.BytesWritable DEF

    • DEF_LOST_FAMILIES

      protected static final org.apache.hadoop.io.BytesWritable DEF_LOST_FAMILIES

    • job

      protected org.apache.hadoop.mapreduce.Job job

  • Constructor Details

  • Method Details

    • run

      public int run(String[] args) throws Exception
      Specified by:
      run in interface org.apache.hadoop.util.Tool
      Throws:
      Exception

    • run

      public int run(String outputDir, int numReducers) throws Exception
      Throws:
      Exception

    • run

      public int run(org.apache.hadoop.fs.Path outputDir, int numReducers) throws Exception
      Throws:
      Exception

    • verify

      public boolean verify(long expectedReferenced) throws Exception
      Throws:
      Exception

    • verifyExpectedValues

      protected boolean verifyExpectedValues(long expectedReferenced, org.apache.hadoop.mapreduce.Counters counters)
      Verify the values in the Counters against the expected number of entries written. Expected number of referenced entrires The Job's Counters object
      Returns:
      True if the values match what's expected, false otherwise

    • verifyUnexpectedValues

      protected boolean verifyUnexpectedValues(org.apache.hadoop.mapreduce.Counters counters)
      Verify that the Counters don't contain values which indicate an outright failure from the Reducers. The Job's counters
      Returns:
      True if the "bad" counter objects are 0, false otherwise

    • handleFailure

      protected void handleFailure(org.apache.hadoop.mapreduce.Counters counters) throws IOException
      Throws:
      IOException