object Serializer
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- Serializer
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- All
Value Members
- val ContextClassLoader: ClassLoader
- val Mirror: Mirror
- def getPath(baseDir: Path, i: Int): Path
- def makeQualifiedPath(sc: SparkContext, path: String): Path
- def read[A](is: InputStream)(implicit ttag: scala.reflect.api.JavaUniverse.TypeTag[A]): A
-
def
readFromHDFS[O](sc: SparkContext, path: Path)(implicit ttag: scala.reflect.api.JavaUniverse.TypeTag[O]): O
Loads the object from the given path.
Loads the object from the given path.
- path
The main path for model to load the object from.
- returns
The loaded object.
- def typeToSerializer[T](tpe: scala.reflect.api.JavaUniverse.Type, sparkSession: SparkSession): Serializer[T]
- def typeToTypeTag[T](tpe: scala.reflect.api.JavaUniverse.Type): scala.reflect.api.JavaUniverse.TypeTag[T]
- def write[A](o: A, outputStream: OutputStream)(implicit ttag: scala.reflect.api.JavaUniverse.TypeTag[A]): Unit
- def writeMLWritable(stage: MLWritable, outputPath: Path, overwrite: Boolean): Unit
-
def
writeToHDFS[O](sc: SparkContext, obj: O, outputPath: Path, overwrite: Boolean)(implicit ttag: scala.reflect.api.JavaUniverse.TypeTag[O]): Unit
Writes the object to the given path.
Writes the object to the given path.
- obj
The object to write.
- outputPath
Where to write the object