Class

com.microsoft.ml.spark.downloader

ModelDownloader

Related Doc: package downloader

Permalink

class ModelDownloader extends Client

Class for downloading models from a server to Local or HDFS

Linear Supertypes
Client, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ModelDownloader
  2. Client
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ModelDownloader(spark: SparkSession, localPath: String, serverURL: String)

    Permalink
  2. new ModelDownloader(spark: SparkSession, localPath: URI, serverURL: URL = ModelDownloader.DefaultURL)

    Permalink

    spark

    Spark session so that the downloader can save to HDFS

    localPath

    path to a directory that will store the models (local or HDFS)

    serverURL

    URL of the server which supplies models ( The default URL is subject to change)

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. def downloadByName(name: String): ModelSchema

    Permalink
  7. def downloadModel(model: ModelSchema): ModelSchema

    Permalink

    Method to download a single model

    Method to download a single model

    model

    the remote model schema

    returns

    the new local model schema with a URI that points to the model's location (on HDFS or local)

  8. def downloadModels(models: ArrayList[ModelSchema]): List[ModelSchema]

    Permalink

    models

    A java iterator of remote model schemas for in the java api (for python wrapper)

    returns

    A java List of local model schema whose URI's points to the model's location (on HDFS or local)

  9. def downloadModels(models: Iterable[ModelSchema] = remoteModels.toIterable): List[ModelSchema]

    Permalink

    models

    An iterable of remote model schemas

    returns

    An list of local model schema whose URI's points to the model's location (on HDFS or local)

  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  14. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  16. def localModels: Iterator[ModelSchema]

    Permalink

    Function for querying the local repository for its registered models

    Function for querying the local repository for its registered models

    returns

    the model schemas found in the downloader's local path

  17. val localPath: URI

    Permalink

    path to a directory that will store the models (local or HDFS)

  18. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  19. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  20. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  21. var quiet: Boolean

    Permalink
    Definition Classes
    Client
  22. def remoteModels: Iterator[ModelSchema]

    Permalink

    Function for querying the remote server for its registered models

    Function for querying the remote server for its registered models

    returns

    the model schemas found in remote repository accessed through the serverURL

  23. def repoTransfer[T <: Schema](schema: T, targetLocation: URI, source: Repository[T], target: Repository[T], overwrite: Boolean = false, closeStream: Boolean = true): T

    Permalink
    Definition Classes
    Client
  24. val serverURL: URL

    Permalink

    URL of the server which supplies models ( The default URL is subject to change)

  25. val spark: SparkSession

    Permalink

    Spark session so that the downloader can save to HDFS

  26. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  27. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  28. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  29. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Client

Inherited from AnyRef

Inherited from Any

Ungrouped