org.apache.hadoop.hbase.spark.HBaseDStreamFunctions

GenericHBaseDStreamFunctions

implicit class GenericHBaseDStreamFunctions[T] extends AnyRef

These are implicit methods for a DStream that contains any type of data.

T

Type T

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. GenericHBaseDStreamFunctions
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new GenericHBaseDStreamFunctions(dStream: DStream[T])

    dStream

    This is for dStreams of any type

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. val dStream: DStream[T]

    This is for dStreams of any type

  9. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  11. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  12. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  13. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  14. def hbaseBulkDelete(hc: HBaseContext, tableName: TableName, f: (T) ⇒ Delete, batchSize: Int): Unit

    Implicit method that gives easy access to HBaseContext's bulk Delete.

    Implicit method that gives easy access to HBaseContext's bulk Delete. This will not return a new DStream.

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the deletes will be sent to

    f

    The function that will convert the DStream value into a HBase Delete Object

    batchSize

    The number of Deletes to be sent in a single batch

  15. def hbaseBulkGet(hc: HBaseContext, tableName: TableName, batchSize: Int, f: (T) ⇒ Get): DStream[(ImmutableBytesWritable, Result)]

    Implicit method that gives easy access to HBaseContext's bulk get.

    Implicit method that gives easy access to HBaseContext's bulk get. This will return a new DStream. Think about it as a DStream map function. In that every DStream value will get a new value out of HBase. That new value will populate the newly generated DStream.

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the put will be sent to

    batchSize

    How many gets to execute in a single batch

    f

    The function that will turn the RDD values in HBase Get objects

    returns

    A resulting DStream with type R objects

  16. def hbaseBulkGet[R](hc: HBaseContext, tableName: TableName, batchSize: Int, f: (T) ⇒ Get, convertResult: (Result) ⇒ R)(implicit arg0: ClassTag[R]): DStream[R]

    Implicit method that gives easy access to HBaseContext's bulk get.

    Implicit method that gives easy access to HBaseContext's bulk get. This will return a new DStream. Think about it as a DStream map function. In that every DStream value will get a new value out of HBase. That new value will populate the newly generated DStream.

    R

    The type of Object that will be coming out of the resulting DStream

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the put will be sent to

    batchSize

    How many gets to execute in a single batch

    f

    The function that will turn the RDD values in HBase Get objects

    convertResult

    The function that will convert a HBase Result object into a value that will go into the resulting DStream

    returns

    A resulting DStream with type R objects

  17. def hbaseBulkPut(hc: HBaseContext, tableName: TableName, f: (T) ⇒ Put): Unit

    Implicit method that gives easy access to HBaseContext's bulk put.

    Implicit method that gives easy access to HBaseContext's bulk put. This will not return a new Stream. Think of it like a foreach

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    tableName

    The tableName that the put will be sent to

    f

    The function that will turn the DStream values into HBase Put objects.

  18. def hbaseForeachPartition(hc: HBaseContext, f: (Iterator[T], Connection) ⇒ Unit): Unit

    Implicit method that gives easy access to HBaseContext's foreachPartition method.

    Implicit method that gives easy access to HBaseContext's foreachPartition method. This will ack very much like a normal DStream foreach method but for the fact that you will now have a HBase connection while iterating through the values.

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    f

    This function will get an iterator for a Partition of an DStream along with a connection object to HBase

  19. def hbaseMapPartitions[R](hc: HBaseContext, f: (Iterator[T], Connection) ⇒ Iterator[R])(implicit arg0: ClassTag[R]): DStream[R]

    Implicit method that gives easy access to HBaseContext's mapPartitions method.

    Implicit method that gives easy access to HBaseContext's mapPartitions method. This will ask very much like a normal DStream map partitions method but for the fact that you will now have a HBase connection while iterating through the values

    R

    This is the type of objects that will go into the resulting DStream

    hc

    The hbaseContext object to identify which HBase cluster connection to use

    f

    This function will get an iterator for a Partition of an DStream along with a connection object to HBase

    returns

    A resulting DStream of type R

  20. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  21. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  22. final def notify(): Unit

    Definition Classes
    AnyRef
  23. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  24. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  25. def toString(): String

    Definition Classes
    AnyRef → Any
  26. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  27. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped