Packages

object DatasetUtils

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DatasetUtils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. case class CardinalityTriplet[T](groupCounts: List[Int], currentValue: T, currentCount: Int) extends Product with Serializable

Value Members

  1. def countCardinality[T](input: Seq[T]): Array[Int]
  2. def getInitScores(rows: Array[Row], initScoreColumn: Option[String], schema: StructType): Option[Array[Double]]
  3. def getRowAsDoubleArray(row: Row, columnParams: ColumnParams): Array[Double]
  4. def releaseArrays(labelsChunkedArray: floatChunkedArray, weightChunkedArrayOpt: Option[floatChunkedArray], initScoreChunkedArrayOpt: Option[doubleChunkedArray]): Unit
  5. def sampleRowsForArrayType(rowsIter: Iterator[Row], columnParams: ColumnParams): (Iterator[Row], Boolean)

    Sample the first several rows to determine whether to construct sparse or dense matrix in lightgbm native code.

    Sample the first several rows to determine whether to construct sparse or dense matrix in lightgbm native code.

    rowsIter

    Iterator of rows.

    columnParams

    The column parameters.

    returns

    A reconstructed iterator with the same original rows and whether the matrix should be sparse or dense.

  6. def validateGroupColumn(col: String, schema: StructType): Unit