Packages

class LightGBMClassifier extends ProbabilisticClassifier[Vector, LightGBMClassifier, LightGBMClassificationModel] with LightGBMBase[LightGBMClassificationModel] with BasicLogging

Trains a LightGBM Classification model, a fast, distributed, high performance gradient boosting framework based on decision tree algorithms. For more information please see here: https://github.com/Microsoft/LightGBM. For parameter information see here: https://github.com/Microsoft/LightGBM/blob/master/docs/Parameters.rst

Linear Supertypes
LightGBMBase[LightGBMClassificationModel], BasicLogging, LightGBMParams, LightGBMObjectiveParams, LightGBMPredictionParams, LightGBMDartParams, LightGBMLearnerParams, LightGBMBinParams, LightGBMFractionParams, LightGBMSlotParams, LightGBMExecutionParams, HasInitScoreCol, HasValidationIndicatorCol, HasWeightCol, DefaultParamsWritable, MLWritable, Wrappable, RWrappable, PythonWrappable, BaseWrappable, ProbabilisticClassifier[Vector, LightGBMClassifier, LightGBMClassificationModel], ProbabilisticClassifierParams, HasThresholds, HasProbabilityCol, Classifier[Vector, LightGBMClassifier, LightGBMClassificationModel], ClassifierParams, HasRawPredictionCol, Predictor[Vector, LightGBMClassifier, LightGBMClassificationModel], PredictorParams, HasPredictionCol, HasFeaturesCol, HasLabelCol, Estimator[LightGBMClassificationModel], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LightGBMClassifier
  2. LightGBMBase
  3. BasicLogging
  4. LightGBMParams
  5. LightGBMObjectiveParams
  6. LightGBMPredictionParams
  7. LightGBMDartParams
  8. LightGBMLearnerParams
  9. LightGBMBinParams
  10. LightGBMFractionParams
  11. LightGBMSlotParams
  12. LightGBMExecutionParams
  13. HasInitScoreCol
  14. HasValidationIndicatorCol
  15. HasWeightCol
  16. DefaultParamsWritable
  17. MLWritable
  18. Wrappable
  19. RWrappable
  20. PythonWrappable
  21. BaseWrappable
  22. ProbabilisticClassifier
  23. ProbabilisticClassifierParams
  24. HasThresholds
  25. HasProbabilityCol
  26. Classifier
  27. ClassifierParams
  28. HasRawPredictionCol
  29. Predictor
  30. PredictorParams
  31. HasPredictionCol
  32. HasFeaturesCol
  33. HasLabelCol
  34. Estimator
  35. PipelineStage
  36. Logging
  37. Params
  38. Serializable
  39. Serializable
  40. Identifiable
  41. AnyRef
  42. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new LightGBMClassifier()
  2. new LightGBMClassifier(uid: String)

    uid

    The unique ID.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T
    Attributes
    protected
    Definition Classes
    Params
  4. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  5. def afterTrainBatch(batchIndex: Int, dataset: Dataset[_], model: LightGBMClassificationModel): Unit
    Definition Classes
    LightGBMBase
  6. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  7. val baggingFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  8. val baggingFreq: IntParam
    Definition Classes
    LightGBMParams
  9. val baggingSeed: IntParam
    Definition Classes
    LightGBMParams
  10. def beforeTrainBatch(batchIndex: Int, dataset: Dataset[_], model: Option[LightGBMClassificationModel]): Unit
    Definition Classes
    LightGBMBase
  11. val binSampleCount: IntParam
    Definition Classes
    LightGBMBinParams
  12. val boostFromAverage: BooleanParam
    Definition Classes
    LightGBMParams
  13. val boostingType: Param[String]
    Definition Classes
    LightGBMParams
  14. def castColumns(dataset: Dataset[_], trainingCols: Array[(String, Seq[DataType])]): DataFrame
    Attributes
    protected
    Definition Classes
    LightGBMBase
  15. val categoricalSlotIndexes: IntArrayParam
    Definition Classes
    LightGBMSlotParams
  16. val categoricalSlotNames: StringArrayParam
    Definition Classes
    LightGBMSlotParams
  17. val chunkSize: IntParam
    Definition Classes
    LightGBMExecutionParams
  18. lazy val classNameHelper: String
    Attributes
    protected
    Definition Classes
    BaseWrappable
  19. final def clear(param: Param[_]): LightGBMClassifier.this.type
    Definition Classes
    Params
  20. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  21. def companionModelClassName: String
    Attributes
    protected
    Definition Classes
    BaseWrappable
  22. def copy(extra: ParamMap): LightGBMClassifier
    Definition Classes
    LightGBMClassifier → Predictor → Estimator → PipelineStage → Params
  23. def copyValues[T <: Params](to: T, extra: ParamMap): T
    Attributes
    protected
    Definition Classes
    Params
  24. lazy val copyrightLines: String
    Attributes
    protected
    Definition Classes
    BaseWrappable
  25. final def defaultCopy[T <: Params](extra: ParamMap): T
    Attributes
    protected
    Definition Classes
    Params
  26. val defaultListenPort: IntParam
    Definition Classes
    LightGBMExecutionParams
  27. val delegate: Option[LightGBMDelegate]
    Definition Classes
    LightGBMParams
  28. val driverListenPort: IntParam
    Definition Classes
    LightGBMExecutionParams
  29. val dropRate: DoubleParam
    Definition Classes
    LightGBMDartParams
  30. val earlyStoppingRound: IntParam
    Definition Classes
    LightGBMLearnerParams
  31. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  32. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  33. def explainParam(param: Param[_]): String
    Definition Classes
    Params
  34. def explainParams(): String
    Definition Classes
    Params
  35. def extractInstances(dataset: Dataset[_], numClasses: Int): RDD[Instance]
    Attributes
    protected
    Definition Classes
    ClassifierParams
  36. def extractInstances(dataset: Dataset[_], validateInstance: (Instance) ⇒ Unit): RDD[Instance]
    Attributes
    protected
    Definition Classes
    PredictorParams
  37. def extractInstances(dataset: Dataset[_]): RDD[Instance]
    Attributes
    protected
    Definition Classes
    PredictorParams
  38. def extractLabeledPoints(dataset: Dataset[_], numClasses: Int): RDD[LabeledPoint]
    Attributes
    protected
    Definition Classes
    Classifier
  39. def extractLabeledPoints(dataset: Dataset[_]): RDD[LabeledPoint]
    Attributes
    protected
    Definition Classes
    Predictor
  40. final def extractParamMap(): ParamMap
    Definition Classes
    Params
  41. final def extractParamMap(extra: ParamMap): ParamMap
    Definition Classes
    Params
  42. val featureFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  43. final val featuresCol: Param[String]
    Definition Classes
    HasFeaturesCol
  44. val featuresShapCol: Param[String]
    Definition Classes
    LightGBMPredictionParams
  45. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  46. def fit(dataset: Dataset[_]): LightGBMClassificationModel
    Definition Classes
    Predictor → Estimator
  47. def fit(dataset: Dataset[_], paramMaps: Seq[ParamMap]): Seq[LightGBMClassificationModel]
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  48. def fit(dataset: Dataset[_], paramMap: ParamMap): LightGBMClassificationModel
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  49. def fit(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): LightGBMClassificationModel
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" ) @varargs()
  50. val fobj: FObjParam
    Definition Classes
    LightGBMObjectiveParams
  51. final def get[T](param: Param[T]): Option[T]
    Definition Classes
    Params
  52. def getBaggingFraction: Double
    Definition Classes
    LightGBMFractionParams
  53. def getBaggingFreq: Int
    Definition Classes
    LightGBMParams
  54. def getBaggingSeed: Int
    Definition Classes
    LightGBMParams
  55. def getBinSampleCount: Int
    Definition Classes
    LightGBMBinParams
  56. def getBoostFromAverage: Boolean
    Definition Classes
    LightGBMParams
  57. def getBoostingType: String
    Definition Classes
    LightGBMParams
  58. def getCategoricalIndexes(featuresSchema: StructField): Array[Int]

    Retrieves the categorical indexes in the features column.

    Retrieves the categorical indexes in the features column.

    featuresSchema

    The schema of the features column

    returns

    the categorical indexes in the features column.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  59. def getCategoricalSlotIndexes: Array[Int]
    Definition Classes
    LightGBMSlotParams
  60. def getCategoricalSlotNames: Array[String]
    Definition Classes
    LightGBMSlotParams
  61. def getChunkSize: Int
    Definition Classes
    LightGBMExecutionParams
  62. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  63. def getColumnParams: ColumnParams
    Attributes
    protected
    Definition Classes
    LightGBMBase
  64. def getDartParams: DartModeParams

    Constructs the DartModeParams

    Constructs the DartModeParams

    returns

    DartModeParams object containing parameters related to dart mode.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  65. def getDatasetParams(categoricalIndexes: Array[Int], numThreads: Int): String
    Definition Classes
    LightGBMBase
  66. final def getDefault[T](param: Param[T]): Option[T]
    Definition Classes
    Params
  67. def getDefaultListenPort: Int
    Definition Classes
    LightGBMExecutionParams
  68. def getDelegate: Option[LightGBMDelegate]
    Definition Classes
    LightGBMParams
  69. def getDriverListenPort: Int
    Definition Classes
    LightGBMExecutionParams
  70. def getDropRate: Double
    Definition Classes
    LightGBMDartParams
  71. def getEarlyStoppingRound: Int
    Definition Classes
    LightGBMLearnerParams
  72. def getExecutionParams(numTasksPerExec: Int): ExecutionParams

    Constructs the ExecutionParams.

    Constructs the ExecutionParams.

    returns

    ExecutionParams object containing parameters related to LightGBM execution.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  73. def getFObj: FObjTrait
    Definition Classes
    LightGBMObjectiveParams
  74. def getFeatureFraction: Double
    Definition Classes
    LightGBMFractionParams
  75. final def getFeaturesCol: String
    Definition Classes
    HasFeaturesCol
  76. def getFeaturesShapCol: String
    Definition Classes
    LightGBMPredictionParams
  77. def getImprovementTolerance: Double
    Definition Classes
    LightGBMLearnerParams
  78. def getInitScoreCol: String

    Definition Classes
    HasInitScoreCol
  79. def getIsProvideTrainingMetric: Boolean
    Definition Classes
    LightGBMParams
  80. def getIsUnbalance: Boolean
  81. final def getLabelCol: String
    Definition Classes
    HasLabelCol
  82. def getLambdaL1: Double
    Definition Classes
    LightGBMParams
  83. def getLambdaL2: Double
    Definition Classes
    LightGBMParams
  84. def getLeafPredictionCol: String
    Definition Classes
    LightGBMPredictionParams
  85. def getLearningRate: Double
    Definition Classes
    LightGBMParams
  86. def getMatrixType: String
    Definition Classes
    LightGBMExecutionParams
  87. def getMaxBin: Int
    Definition Classes
    LightGBMBinParams
  88. def getMaxBinByFeature: Array[Int]
    Definition Classes
    LightGBMParams
  89. def getMaxDeltaStep: Double
    Definition Classes
    LightGBMParams
  90. def getMaxDepth: Int
    Definition Classes
    LightGBMParams
  91. def getMaxDrop: Int
    Definition Classes
    LightGBMDartParams
  92. def getMetric: String
    Definition Classes
    LightGBMParams
  93. def getMinDataInLeaf: Int
    Definition Classes
    LightGBMParams
  94. def getMinGainToSplit: Double
    Definition Classes
    LightGBMParams
  95. def getMinSumHessianInLeaf: Double
    Definition Classes
    LightGBMParams
  96. def getModel(trainParams: TrainParams, lightGBMBooster: LightGBMBooster): LightGBMClassificationModel

    Gets the trained model given the train parameters and booster.

    Gets the trained model given the train parameters and booster.

    returns

    trained model.

    Definition Classes
    LightGBMClassifier → LightGBMBase
  97. def getModelString: String
    Definition Classes
    LightGBMParams
  98. def getNegBaggingFraction: Double
    Definition Classes
    LightGBMFractionParams
  99. def getNumBatches: Int
    Definition Classes
    LightGBMExecutionParams
  100. def getNumClasses(dataset: Dataset[_], maxNumClasses: Int): Int
    Attributes
    protected
    Definition Classes
    Classifier
  101. def getNumIterations: Int
    Definition Classes
    LightGBMParams
  102. def getNumLeaves: Int
    Definition Classes
    LightGBMParams
  103. def getNumTasks: Int
    Definition Classes
    LightGBMExecutionParams
  104. def getNumThreads: Int
    Definition Classes
    LightGBMExecutionParams
  105. def getObjective: String
    Definition Classes
    LightGBMObjectiveParams
  106. def getObjectiveParams: ObjectiveParams

    Constructs the ObjectiveParams.

    Constructs the ObjectiveParams.

    returns

    ObjectiveParams object containing parameters related to the objective function.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  107. def getOptGroupCol: Option[String]

    Optional group column for Ranking, set to None by default.

    Optional group column for Ranking, set to None by default.

    returns

    None

    Attributes
    protected
    Definition Classes
    LightGBMBase
  108. final def getOrDefault[T](param: Param[T]): T
    Definition Classes
    Params
  109. def getParallelism: String
    Definition Classes
    LightGBMExecutionParams
  110. def getParam(paramName: String): Param[Any]
    Definition Classes
    Params
  111. def getPosBaggingFraction: Double
    Definition Classes
    LightGBMFractionParams
  112. def getPredictDisableShapeCheck: Boolean
    Definition Classes
    LightGBMPredictionParams
  113. final def getPredictionCol: String
    Definition Classes
    HasPredictionCol
  114. final def getProbabilityCol: String
    Definition Classes
    HasProbabilityCol
  115. final def getRawPredictionCol: String
    Definition Classes
    HasRawPredictionCol
  116. def getRepartitionByGroupingColumn: Boolean
    Definition Classes
    LightGBMExecutionParams
  117. def getSkipDrop: Double
    Definition Classes
    LightGBMDartParams
  118. def getSlotNames: Array[String]
    Definition Classes
    LightGBMSlotParams
  119. def getSlotNamesWithMetadata(featuresSchema: StructField): Option[Array[String]]
    Definition Classes
    LightGBMBase
  120. def getThresholds: Array[Double]
    Definition Classes
    HasThresholds
  121. def getTimeout: Double
    Definition Classes
    LightGBMExecutionParams
  122. def getTopK: Int
    Definition Classes
    LightGBMExecutionParams
  123. def getTrainParams(numTasks: Int, dataset: Dataset[_], numTasksPerExec: Int): TrainParams

    Gets the training parameters.

    Gets the training parameters.

    numTasks

    The total number of tasks.

    dataset

    The training dataset.

    numTasksPerExec

    The number of tasks per executor.

    returns

    train parameters.

    Definition Classes
    LightGBMClassifier → LightGBMBase
  124. def getTrainingCols: Array[(String, Seq[DataType])]
    Attributes
    protected
    Definition Classes
    LightGBMBase
  125. def getUniformDrop: Boolean
    Definition Classes
    LightGBMDartParams
  126. def getUseBarrierExecutionMode: Boolean
    Definition Classes
    LightGBMExecutionParams
  127. def getUseSingleDatasetMode: Boolean
    Definition Classes
    LightGBMExecutionParams
  128. def getValidationIndicatorCol: String

    Definition Classes
    HasValidationIndicatorCol
  129. def getVerbosity: Int
    Definition Classes
    LightGBMParams
  130. def getWeightCol: String

    Definition Classes
    HasWeightCol
  131. def getXGBoostDartMode: Boolean
    Definition Classes
    LightGBMDartParams
  132. final def hasDefault[T](param: Param[T]): Boolean
    Definition Classes
    Params
  133. def hasParam(paramName: String): Boolean
    Definition Classes
    Params
  134. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  135. val improvementTolerance: DoubleParam
    Definition Classes
    LightGBMLearnerParams
  136. val initScoreCol: Param[String]

    The name of the initial score column

    The name of the initial score column

    Definition Classes
    HasInitScoreCol
  137. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  138. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  139. def innerTrain(dataset: Dataset[_], batchIndex: Int): LightGBMClassificationModel

    Inner train method for LightGBM learners.

    Inner train method for LightGBM learners. Calculates the number of workers, creates a driver thread, and runs mapPartitions on the dataset.

    dataset

    The dataset to train on.

    batchIndex

    In running in batch training mode, gets the batch number.

    returns

    The LightGBM Model from the trained LightGBM Booster.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  140. final def isDefined(param: Param[_]): Boolean
    Definition Classes
    Params
  141. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  142. val isProvideTrainingMetric: BooleanParam
    Definition Classes
    LightGBMParams
  143. final def isSet(param: Param[_]): Boolean
    Definition Classes
    Params
  144. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  145. val isUnbalance: BooleanParam
  146. final val labelCol: Param[String]
    Definition Classes
    HasLabelCol
  147. val lambdaL1: DoubleParam
    Definition Classes
    LightGBMParams
  148. val lambdaL2: DoubleParam
    Definition Classes
    LightGBMParams
  149. val leafPredictionCol: Param[String]
    Definition Classes
    LightGBMPredictionParams
  150. val learningRate: DoubleParam
    Definition Classes
    LightGBMParams
  151. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  152. def logBase(methodName: String): Unit
    Attributes
    protected
    Definition Classes
    BasicLogging
  153. def logClass(): Unit
    Definition Classes
    BasicLogging
  154. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  155. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  156. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  157. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  158. def logErrorBase(methodName: String, e: Exception): Unit
    Attributes
    protected
    Definition Classes
    BasicLogging
  159. def logFit[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  160. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  161. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  162. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  163. def logPredict[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  164. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  165. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  166. def logTrain[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  167. def logTransform[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  168. def logVerb[T](verb: String, f: ⇒ T): T
    Definition Classes
    BasicLogging
  169. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  170. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  171. def makePyFile(conf: CodegenConfig): Unit
    Definition Classes
    PythonWrappable
  172. def makeRFile(conf: CodegenConfig): Unit
    Definition Classes
    RWrappable
  173. val matrixType: Param[String]
    Definition Classes
    LightGBMExecutionParams
  174. val maxBin: IntParam
    Definition Classes
    LightGBMBinParams
  175. val maxBinByFeature: IntArrayParam
    Definition Classes
    LightGBMParams
  176. val maxDeltaStep: DoubleParam
    Definition Classes
    LightGBMParams
  177. val maxDepth: IntParam
    Definition Classes
    LightGBMParams
  178. val maxDrop: IntParam
    Definition Classes
    LightGBMDartParams
  179. val metric: Param[String]
    Definition Classes
    LightGBMParams
  180. val minDataInLeaf: IntParam
    Definition Classes
    LightGBMParams
  181. val minGainToSplit: DoubleParam
    Definition Classes
    LightGBMParams
  182. val minSumHessianInLeaf: DoubleParam
    Definition Classes
    LightGBMParams
  183. val modelString: Param[String]
    Definition Classes
    LightGBMParams
  184. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  185. val negBaggingFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  186. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  187. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  188. val numBatches: IntParam
    Definition Classes
    LightGBMExecutionParams
  189. val numIterations: IntParam
    Definition Classes
    LightGBMParams
  190. val numLeaves: IntParam
    Definition Classes
    LightGBMParams
  191. val numTasks: IntParam
    Definition Classes
    LightGBMExecutionParams
  192. val numThreads: IntParam
    Definition Classes
    LightGBMExecutionParams
  193. val objective: Param[String]
    Definition Classes
    LightGBMObjectiveParams
  194. val parallelism: Param[String]
    Definition Classes
    LightGBMExecutionParams
  195. lazy val params: Array[Param[_]]
    Definition Classes
    Params
  196. val posBaggingFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  197. val predictDisableShapeCheck: BooleanParam
    Definition Classes
    LightGBMPredictionParams
  198. final val predictionCol: Param[String]
    Definition Classes
    HasPredictionCol
  199. def prepareDataframe(dataset: Dataset[_], numTasks: Int): DataFrame
    Attributes
    protected
    Definition Classes
    LightGBMBase
  200. def preprocessData(dataset: DataFrame): DataFrame

    Allow algorithm specific preprocessing of dataset.

    Allow algorithm specific preprocessing of dataset.

    dataset

    The dataset to preprocess prior to training.

    returns

    The preprocessed data.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  201. final val probabilityCol: Param[String]
    Definition Classes
    HasProbabilityCol
  202. def pyAdditionalMethods: String
    Definition Classes
    PythonWrappable
  203. lazy val pyClassDoc: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  204. lazy val pyClassName: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  205. def pyExtraEstimatorImports: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  206. def pyExtraEstimatorMethods: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  207. lazy val pyInheritedClasses: Seq[String]
    Attributes
    protected
    Definition Classes
    PythonWrappable
  208. def pyInitFunc(): String
    Definition Classes
    PythonWrappable
  209. lazy val pyInternalWrapper: Boolean
    Attributes
    protected
    Definition Classes
    PythonWrappable
  210. lazy val pyObjectBaseClass: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  211. def pyParamArg[T](p: Param[T]): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  212. def pyParamDefault[T](p: Param[T]): Option[String]
    Attributes
    protected
    Definition Classes
    PythonWrappable
  213. def pyParamGetter(p: Param[_]): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  214. def pyParamSetter(p: Param[_]): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  215. def pyParamsArgs: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  216. def pyParamsDefaults: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  217. lazy val pyParamsDefinitions: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  218. def pyParamsGetters: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  219. def pyParamsSetters: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  220. def pythonClass(): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  221. def rClass(): String
    Attributes
    protected
    Definition Classes
    RWrappable
  222. def rDocString: String
    Attributes
    protected
    Definition Classes
    RWrappable
  223. def rExtraBodyLines: String
    Attributes
    protected
    Definition Classes
    RWrappable
  224. def rExtraInitLines: String
    Attributes
    protected
    Definition Classes
    RWrappable
  225. lazy val rFuncName: String
    Attributes
    protected
    Definition Classes
    RWrappable
  226. lazy val rInternalWrapper: Boolean
    Attributes
    protected
    Definition Classes
    RWrappable
  227. def rParamArg[T](p: Param[T]): String
    Attributes
    protected
    Definition Classes
    RWrappable
  228. def rParamsArgs: String
    Attributes
    protected
    Definition Classes
    RWrappable
  229. def rSetterLines: String
    Attributes
    protected
    Definition Classes
    RWrappable
  230. final val rawPredictionCol: Param[String]
    Definition Classes
    HasRawPredictionCol
  231. val repartitionByGroupingColumn: BooleanParam
    Definition Classes
    LightGBMExecutionParams
  232. def save(path: String): Unit
    Definition Classes
    MLWritable
    Annotations
    @Since( "1.6.0" ) @throws( ... )
  233. final def set(paramPair: ParamPair[_]): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  234. final def set(param: String, value: Any): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  235. final def set[T](param: Param[T], value: T): LightGBMClassifier.this.type
    Definition Classes
    Params
  236. def setBaggingFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  237. def setBaggingFreq(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  238. def setBaggingSeed(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  239. def setBinSampleCount(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMBinParams
  240. def setBoostFromAverage(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  241. def setBoostingType(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  242. def setCategoricalSlotIndexes(value: Array[Int]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMSlotParams
  243. def setCategoricalSlotNames(value: Array[String]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMSlotParams
  244. def setChunkSize(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  245. final def setDefault(paramPairs: ParamPair[_]*): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  246. final def setDefault[T](param: Param[T], value: T): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  247. def setDefaultListenPort(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  248. def setDelegate(delegate: LightGBMDelegate): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  249. def setDriverListenPort(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  250. def setDropRate(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  251. def setEarlyStoppingRound(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMLearnerParams
  252. def setFObj(value: FObjTrait): LightGBMClassifier.this.type
    Definition Classes
    LightGBMObjectiveParams
  253. def setFeatureFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  254. def setFeaturesCol(value: String): LightGBMClassifier
    Definition Classes
    Predictor
  255. def setFeaturesShapCol(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMPredictionParams
  256. def setImprovementTolerance(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMLearnerParams
  257. def setInitScoreCol(value: String): LightGBMClassifier.this.type

    Definition Classes
    HasInitScoreCol
  258. def setIsProvideTrainingMetric(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  259. def setIsUnbalance(value: Boolean): LightGBMClassifier.this.type
  260. def setLabelCol(value: String): LightGBMClassifier
    Definition Classes
    Predictor
  261. def setLambdaL1(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  262. def setLambdaL2(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  263. def setLeafPredictionCol(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMPredictionParams
  264. def setLearningRate(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  265. def setMatrixType(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  266. def setMaxBin(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMBinParams
  267. def setMaxBinByFeature(value: Array[Int]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  268. def setMaxDeltaStep(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  269. def setMaxDepth(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  270. def setMaxDrop(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  271. def setMetric(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  272. def setMinDataInLeaf(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  273. def setMinGainToSplit(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  274. def setMinSumHessianInLeaf(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  275. def setModelString(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  276. def setNegBaggingFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  277. def setNumBatches(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  278. def setNumIterations(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  279. def setNumLeaves(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  280. def setNumTasks(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  281. def setNumThreads(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  282. def setObjective(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMObjectiveParams
  283. def setParallelism(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  284. def setPosBaggingFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  285. def setPredictDisableShapeCheck(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMPredictionParams
  286. def setPredictionCol(value: String): LightGBMClassifier
    Definition Classes
    Predictor
  287. def setProbabilityCol(value: String): LightGBMClassifier
    Definition Classes
    ProbabilisticClassifier
  288. def setRawPredictionCol(value: String): LightGBMClassifier
    Definition Classes
    Classifier
  289. def setRepartitionByGroupingColumn(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  290. def setSkipDrop(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  291. def setSlotNames(value: Array[String]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMSlotParams
  292. def setThresholds(value: Array[Double]): LightGBMClassifier
    Definition Classes
    ProbabilisticClassifier
  293. def setTimeout(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  294. def setTopK(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  295. def setUniformDrop(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  296. def setUseBarrierExecutionMode(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  297. def setUseSingleDatasetMode(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  298. def setValidationIndicatorCol(value: String): LightGBMClassifier.this.type

    Definition Classes
    HasValidationIndicatorCol
  299. def setVerbosity(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  300. def setWeightCol(value: String): LightGBMClassifier.this.type

    Definition Classes
    HasWeightCol
  301. def setXGBoostDartMode(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  302. val skipDrop: DoubleParam
    Definition Classes
    LightGBMDartParams
  303. val slotNames: StringArrayParam
    Definition Classes
    LightGBMSlotParams
  304. def stringFromTrainedModel(model: LightGBMClassificationModel): String
    Definition Classes
    LightGBMClassifier → LightGBMBase
  305. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  306. val thresholds: DoubleArrayParam
    Definition Classes
    HasThresholds
  307. val timeout: DoubleParam
    Definition Classes
    LightGBMExecutionParams
  308. def toString(): String
    Definition Classes
    Identifiable → AnyRef → Any
  309. val topK: IntParam
    Definition Classes
    LightGBMExecutionParams
  310. def train(dataset: Dataset[_]): LightGBMClassificationModel

    Trains the LightGBM model.

    Trains the LightGBM model. If batches are specified, breaks training dataset into batches for training.

    dataset

    The input dataset to train.

    returns

    The trained model.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  311. def transformSchema(schema: StructType): StructType
    Definition Classes
    Predictor → PipelineStage
  312. def transformSchema(schema: StructType, logging: Boolean): StructType
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  313. val uid: String
    Definition Classes
    LightGBMClassifier → BasicLogging → Identifiable
  314. val uniformDrop: BooleanParam
    Definition Classes
    LightGBMDartParams
  315. val useBarrierExecutionMode: BooleanParam
    Definition Classes
    LightGBMExecutionParams
  316. val useSingleDatasetMode: BooleanParam
    Definition Classes
    LightGBMExecutionParams
  317. def validateAndTransformSchema(schema: StructType, fitting: Boolean, featuresDataType: DataType): StructType
    Attributes
    protected
    Definition Classes
    ProbabilisticClassifierParams → ClassifierParams → PredictorParams
  318. def validateLabel(label: Double, numClasses: Int): Unit
    Attributes
    protected
    Definition Classes
    Classifier
  319. def validateNumClasses(numClasses: Int): Unit
    Attributes
    protected
    Definition Classes
    Classifier
  320. val validationIndicatorCol: Param[String]

    The name of the validation indicator column

    The name of the validation indicator column

    Definition Classes
    HasValidationIndicatorCol
  321. val ver: String
    Definition Classes
    BasicLogging
  322. val verbosity: IntParam
    Definition Classes
    LightGBMParams
  323. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  324. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  325. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  326. val weightCol: Param[String]

    The name of the weight column

    The name of the weight column

    Definition Classes
    HasWeightCol
  327. def write: MLWriter
    Definition Classes
    DefaultParamsWritable → MLWritable
  328. val xgboostDartMode: BooleanParam
    Definition Classes
    LightGBMDartParams

Inherited from LightGBMBase[LightGBMClassificationModel]

Inherited from BasicLogging

Inherited from LightGBMParams

Inherited from LightGBMObjectiveParams

Inherited from LightGBMPredictionParams

Inherited from LightGBMDartParams

Inherited from LightGBMLearnerParams

Inherited from LightGBMBinParams

Inherited from LightGBMFractionParams

Inherited from LightGBMSlotParams

Inherited from LightGBMExecutionParams

Inherited from HasInitScoreCol

Inherited from HasValidationIndicatorCol

Inherited from HasWeightCol

Inherited from DefaultParamsWritable

Inherited from MLWritable

Inherited from Wrappable

Inherited from RWrappable

Inherited from PythonWrappable

Inherited from BaseWrappable

Inherited from ProbabilisticClassifier[Vector, LightGBMClassifier, LightGBMClassificationModel]

Inherited from ProbabilisticClassifierParams

Inherited from HasThresholds

Inherited from HasProbabilityCol

Inherited from Classifier[Vector, LightGBMClassifier, LightGBMClassificationModel]

Inherited from ClassifierParams

Inherited from HasRawPredictionCol

Inherited from Predictor[Vector, LightGBMClassifier, LightGBMClassificationModel]

Inherited from PredictorParams

Inherited from HasPredictionCol

Inherited from HasFeaturesCol

Inherited from HasLabelCol

Inherited from Estimator[LightGBMClassificationModel]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

getParam

param

setParam

Ungrouped