object LightGBMUtils

Helper utilities for LightGBM learners

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LightGBMUtils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. def getExecutorId: String

    Returns the executor ID for the spark Dataset.

    Returns the executor ID for the spark Dataset.

    returns

    Returns the executor id.

  2. def getFeaturizer(dataset: Dataset[_], labelColumn: String, featuresColumn: String, weightColumn: Option[String] = None, groupColumn: Option[String] = None, oneHotEncodeCategoricals: Boolean = true): PipelineModel
  3. def getPartitionId: Int

    Returns the partition ID for the spark Dataset.

    Returns the partition ID for the spark Dataset.

    Used to make operations deterministic on same dataset.

    returns

    Returns the partition id.

  4. def getTaskId: Long

    Returns a unique task Id for the current task run on the executor.

    Returns a unique task Id for the current task run on the executor.

    returns

    A unique task id.

  5. def getWorkerId: Int

    Returns an integer ID for the current worker.

    Returns an integer ID for the current worker.

    returns

    In cluster, returns the executor id. In local case, returns the partition id.

  6. def initializeNativeLibrary(): Unit

    Loads the native shared object binaries lib_lightgbm.so and lib_lightgbm_swig.so

  7. def isLocalExecution: Boolean

    Returns true if spark is run in local mode.

    Returns true if spark is run in local mode.

    returns

    True if spark is run in local mode.

  8. def validate(result: Int, component: String): Unit
  9. def validateArray(result: SWIGTYPE_p_void, component: String): Unit