Packages

class ModelDownloader extends Client

Class for downloading models from a server to Local or HDFS

Linear Supertypes
Client, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ModelDownloader
  2. Client
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ModelDownloader(spark: SparkSession, localPath: String, serverURL: String)
  2. new ModelDownloader(spark: SparkSession, localPath: URI, serverURL: URL = ModelDownloader.DefaultURL)

    spark

    Spark session so that the downloader can save to HDFS

    localPath

    path to a directory that will store the models (local or HDFS)

    serverURL

    URL of the server which supplies models ( The default URL is subject to change)

Value Members

  1. def downloadByName(name: String): ModelSchema
  2. def downloadModel(model: ModelSchema): ModelSchema

    Method to download a single model

    Method to download a single model

    model

    the remote model schema

    returns

    the new local model schema with a URI that points to the model's location (on HDFS or local)

  3. def downloadModels(models: ArrayList[ModelSchema]): List[ModelSchema]

    models

    A java iterator of remote model schemas for in the java api (for python wrapper)

    returns

    A java List of local model schema whose URI's points to the model's location (on HDFS or local)

  4. def downloadModels(models: Iterable[ModelSchema] = remoteModels.asScala.toIterable): List[ModelSchema]

    models

    An iterable of remote model schemas

    returns

    An list of local model schema whose URI's points to the model's location (on HDFS or local)

  5. def localModels: Iterator[ModelSchema]

    Function for querying the local repository for its registered models

    Function for querying the local repository for its registered models

    returns

    the model schemas found in the downloader's local path

  6. val localPath: URI
  7. var quiet: Boolean
    Definition Classes
    Client
  8. def remoteModels: Iterator[ModelSchema]

    Function for querying the remote server for its registered models

    Function for querying the remote server for its registered models

    returns

    the model schemas found in remote repository accessed through the serverURL

  9. def repoTransfer[T <: Schema](schema: T, targetLocation: URI, source: Repository[T], target: Repository[T], overwrite: Boolean = false, closeStream: Boolean = true): T
    Definition Classes
    Client
  10. val serverURL: URL
  11. val spark: SparkSession