object DatasetExtensions
Contains methods for manipulating spark dataframes and datasets.
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- DatasetExtensions
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- All
Type Members
- implicit final class MMLDataFrame extends AnyVal
Value Members
- def findUnusedColumnName(prefix: String, df: Dataset[_]): String
- def findUnusedColumnName(prefix: String, schema: StructType): String
-
def
findUnusedColumnName(prefix: String)(columnNames: Set[String]): String
Finds an unused column name given initial column name and a list of existing column names.
Finds an unused column name given initial column name and a list of existing column names. The unused column name will be given prefix with a number appended to it, eg "testColumn_5". There will be an underline between the column name and the number appended.
- returns
The unused column name.