Packages

class Session extends AnyRef

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Session
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new Session(sparkSession: SparkSession)

Value Members

  1. def readBinaryFiles(path: String, recursive: Boolean, sampleRatio: Double = 1, inspectZip: Boolean = true, seed: Long = 0L): DataFrame

    path

    Path to the files directory

    recursive

    Recursive path search flag

    sampleRatio

    Fraction of the files loaded

    inspectZip

    Whether zip files are treated as directories

    returns

    Dataframe with a single column "value" of binary files, see BinaryFileSchema for details