Packages

object DatasetExtensions

Contains methods for manipulating spark dataframes and datasets.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DatasetExtensions
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. implicit final class MMLDataFrame extends AnyVal

Value Members

  1. def findUnusedColumnName(prefix: String, df: Dataset[_]): String
  2. def findUnusedColumnName(prefix: String, schema: StructType): String
  3. def findUnusedColumnName(prefix: String)(columnNames: Set[String]): String

    Finds an unused column name given initial column name and a list of existing column names.

    Finds an unused column name given initial column name and a list of existing column names. The unused column name will be given prefix with a number appended to it, eg "testColumn_5". There will be an underline between the column name and the number appended.

    returns

    The unused column name.