Packages

class ModelDownloader extends Client

Class for downloading models from a server to Local or HDFS

Linear Supertypes
Client, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ModelDownloader
  2. Client
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ModelDownloader(spark: SparkSession, localPath: String, serverURL: String)
  2. new ModelDownloader(spark: SparkSession, localPath: URI, serverURL: URL = ModelDownloader.DefaultURL)

    spark

    Spark session so that the downloader can save to HDFS

    localPath

    path to a directory that will store the models (local or HDFS)

    serverURL

    URL of the server which supplies models ( The default URL is subject to change)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. def downloadByName(name: String): ModelSchema
  7. def downloadModel(model: ModelSchema): ModelSchema

    Method to download a single model

    Method to download a single model

    model

    the remote model schema

    returns

    the new local model schema with a URI that points to the model's location (on HDFS or local)

  8. def downloadModels(models: ArrayList[ModelSchema]): List[ModelSchema]

    models

    A java iterator of remote model schemas for in the java api (for python wrapper)

    returns

    A java List of local model schema whose URI's points to the model's location (on HDFS or local)

  9. def downloadModels(models: Iterable[ModelSchema] = remoteModels.asScala.toIterable): List[ModelSchema]

    models

    An iterable of remote model schemas

    returns

    An list of local model schema whose URI's points to the model's location (on HDFS or local)

  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  14. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  16. def localModels: Iterator[ModelSchema]

    Function for querying the local repository for its registered models

    Function for querying the local repository for its registered models

    returns

    the model schemas found in the downloader's local path

  17. val localPath: URI
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. var quiet: Boolean
    Definition Classes
    Client
  22. def remoteModels: Iterator[ModelSchema]

    Function for querying the remote server for its registered models

    Function for querying the remote server for its registered models

    returns

    the model schemas found in remote repository accessed through the serverURL

  23. def repoTransfer[T <: Schema](schema: T, targetLocation: URI, source: Repository[T], target: Repository[T], overwrite: Boolean = false, closeStream: Boolean = true): T
    Definition Classes
    Client
  24. val serverURL: URL
  25. val spark: SparkSession
  26. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  27. def toString(): String
    Definition Classes
    AnyRef → Any
  28. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from Client

Inherited from AnyRef

Inherited from Any

Ungrouped