Packages

class HTTPSource extends Source with Logging

A source that reads text lines through a TCP socket, designed only for tutorials and debugging. This source will *not* work in production applications due to multiple reasons, including no support for fault recovery and keeping all of the text read in memory forever.

Linear Supertypes
Logging, Source, SparkDataStream, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. HTTPSource
  2. Logging
  3. Source
  4. SparkDataStream
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HTTPSource(name: String, host: String, port: Int, sqlContext: SQLContext)

Type Members

  1. class QueueHandler extends HttpHandler

Value Members

  1. def commit(end: Offset): Unit
    Definition Classes
    HTTPSource → Source
  2. def commit(end: connector.read.streaming.Offset): Unit
    Definition Classes
    Source → SparkDataStream
  3. def deserializeOffset(json: String): connector.read.streaming.Offset
    Definition Classes
    Source → SparkDataStream
  4. def getBatch(start: Option[Offset], end: Offset): DataFrame

    Returns the data that is between the offsets (start, end].

    Returns the data that is between the offsets (start, end].

    Definition Classes
    HTTPSource → Source
  5. def getOffset: Option[Offset]
    Definition Classes
    HTTPSource → Source
  6. def initialOffset(): connector.read.streaming.Offset
    Definition Classes
    Source → SparkDataStream
  7. def reply(id: String, reply: HTTPResponseData): Unit
  8. def schema: StructType

    Returns the schema of the data from this source

    Returns the schema of the data from this source

    Definition Classes
    HTTPSource → Source
  9. def stop(): Unit

    Stop this source.

    Stop this source.

    Definition Classes
    HTTPSource → SparkDataStream
  10. def toString(): String
    Definition Classes
    HTTPSource → AnyRef → Any