Packages

class LightGBMClassifier extends ProbabilisticClassifier[Vector, LightGBMClassifier, LightGBMClassificationModel] with LightGBMBase[LightGBMClassificationModel] with BasicLogging

Trains a LightGBM Classification model, a fast, distributed, high performance gradient boosting framework based on decision tree algorithms. For more information please see here: https://github.com/Microsoft/LightGBM. For parameter information see here: https://github.com/Microsoft/LightGBM/blob/master/docs/Parameters.rst

Linear Supertypes
LightGBMBase[LightGBMClassificationModel], BasicLogging, LightGBMParams, LightGBMObjectiveParams, LightGBMPredictionParams, LightGBMDartParams, LightGBMLearnerParams, LightGBMBinParams, LightGBMFractionParams, LightGBMSlotParams, LightGBMExecutionParams, HasInitScoreCol, HasValidationIndicatorCol, HasWeightCol, DefaultParamsWritable, MLWritable, Wrappable, RWrappable, PythonWrappable, BaseWrappable, ProbabilisticClassifier[Vector, LightGBMClassifier, LightGBMClassificationModel], ProbabilisticClassifierParams, HasThresholds, HasProbabilityCol, Classifier[Vector, LightGBMClassifier, LightGBMClassificationModel], ClassifierParams, HasRawPredictionCol, Predictor[Vector, LightGBMClassifier, LightGBMClassificationModel], PredictorParams, HasPredictionCol, HasFeaturesCol, HasLabelCol, Estimator[LightGBMClassificationModel], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. LightGBMClassifier
  2. LightGBMBase
  3. BasicLogging
  4. LightGBMParams
  5. LightGBMObjectiveParams
  6. LightGBMPredictionParams
  7. LightGBMDartParams
  8. LightGBMLearnerParams
  9. LightGBMBinParams
  10. LightGBMFractionParams
  11. LightGBMSlotParams
  12. LightGBMExecutionParams
  13. HasInitScoreCol
  14. HasValidationIndicatorCol
  15. HasWeightCol
  16. DefaultParamsWritable
  17. MLWritable
  18. Wrappable
  19. RWrappable
  20. PythonWrappable
  21. BaseWrappable
  22. ProbabilisticClassifier
  23. ProbabilisticClassifierParams
  24. HasThresholds
  25. HasProbabilityCol
  26. Classifier
  27. ClassifierParams
  28. HasRawPredictionCol
  29. Predictor
  30. PredictorParams
  31. HasPredictionCol
  32. HasFeaturesCol
  33. HasLabelCol
  34. Estimator
  35. PipelineStage
  36. Logging
  37. Params
  38. Serializable
  39. Serializable
  40. Identifiable
  41. AnyRef
  42. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new LightGBMClassifier()
  2. new LightGBMClassifier(uid: String)

    uid

    The unique ID.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T
    Attributes
    protected
    Definition Classes
    Params
  4. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  5. def afterTrainBatch(batchIndex: Int, dataset: Dataset[_], model: LightGBMClassificationModel): Unit
    Definition Classes
    LightGBMBase
  6. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  7. val baggingFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  8. val baggingFreq: IntParam
    Definition Classes
    LightGBMParams
  9. val baggingSeed: IntParam
    Definition Classes
    LightGBMParams
  10. def beforeTrainBatch(batchIndex: Int, dataset: Dataset[_], model: Option[LightGBMClassificationModel]): Unit
    Definition Classes
    LightGBMBase
  11. val binSampleCount: IntParam
    Definition Classes
    LightGBMBinParams
  12. val boostFromAverage: BooleanParam
    Definition Classes
    LightGBMParams
  13. val boostingType: Param[String]
    Definition Classes
    LightGBMParams
  14. def castColumns(dataset: Dataset[_], trainingCols: Array[(String, Seq[DataType])]): DataFrame
    Attributes
    protected
    Definition Classes
    LightGBMBase
  15. val categoricalSlotIndexes: IntArrayParam
    Definition Classes
    LightGBMSlotParams
  16. val categoricalSlotNames: StringArrayParam
    Definition Classes
    LightGBMSlotParams
  17. val chunkSize: IntParam
    Definition Classes
    LightGBMExecutionParams
  18. lazy val classNameHelper: String
    Attributes
    protected
    Definition Classes
    BaseWrappable
  19. final def clear(param: Param[_]): LightGBMClassifier.this.type
    Definition Classes
    Params
  20. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  21. def companionModelClassName: String
    Attributes
    protected
    Definition Classes
    BaseWrappable
  22. def copy(extra: ParamMap): LightGBMClassifier
    Definition Classes
    LightGBMClassifier → Predictor → Estimator → PipelineStage → Params
  23. def copyValues[T <: Params](to: T, extra: ParamMap): T
    Attributes
    protected
    Definition Classes
    Params
  24. lazy val copyrightLines: String
    Attributes
    protected
    Definition Classes
    BaseWrappable
  25. final def defaultCopy[T <: Params](extra: ParamMap): T
    Attributes
    protected
    Definition Classes
    Params
  26. val defaultListenPort: IntParam
    Definition Classes
    LightGBMExecutionParams
  27. val delegate: Option[LightGBMDelegate]
    Definition Classes
    LightGBMParams
  28. val driverListenPort: IntParam
    Definition Classes
    LightGBMExecutionParams
  29. val dropRate: DoubleParam
    Definition Classes
    LightGBMDartParams
  30. val earlyStoppingRound: IntParam
    Definition Classes
    LightGBMLearnerParams
  31. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  32. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  33. def explainParam(param: Param[_]): String
    Definition Classes
    Params
  34. def explainParams(): String
    Definition Classes
    Params
  35. def extractInstances(dataset: Dataset[_], numClasses: Int): RDD[Instance]
    Attributes
    protected
    Definition Classes
    ClassifierParams
  36. def extractInstances(dataset: Dataset[_], validateInstance: (Instance) ⇒ Unit): RDD[Instance]
    Attributes
    protected
    Definition Classes
    PredictorParams
  37. def extractInstances(dataset: Dataset[_]): RDD[Instance]
    Attributes
    protected
    Definition Classes
    PredictorParams
  38. def extractLabeledPoints(dataset: Dataset[_], numClasses: Int): RDD[LabeledPoint]
    Attributes
    protected
    Definition Classes
    Classifier
  39. def extractLabeledPoints(dataset: Dataset[_]): RDD[LabeledPoint]
    Attributes
    protected
    Definition Classes
    Predictor
  40. final def extractParamMap(): ParamMap
    Definition Classes
    Params
  41. final def extractParamMap(extra: ParamMap): ParamMap
    Definition Classes
    Params
  42. val featureFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  43. final val featuresCol: Param[String]
    Definition Classes
    HasFeaturesCol
  44. val featuresShapCol: Param[String]
    Definition Classes
    LightGBMPredictionParams
  45. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  46. def fit(dataset: Dataset[_]): LightGBMClassificationModel
    Definition Classes
    Predictor → Estimator
  47. def fit(dataset: Dataset[_], paramMaps: Seq[ParamMap]): Seq[LightGBMClassificationModel]
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  48. def fit(dataset: Dataset[_], paramMap: ParamMap): LightGBMClassificationModel
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  49. def fit(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): LightGBMClassificationModel
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" ) @varargs()
  50. val fobj: FObjParam
    Definition Classes
    LightGBMObjectiveParams
  51. final def get[T](param: Param[T]): Option[T]
    Definition Classes
    Params
  52. def getBaggingFraction: Double
    Definition Classes
    LightGBMFractionParams
  53. def getBaggingFreq: Int
    Definition Classes
    LightGBMParams
  54. def getBaggingSeed: Int
    Definition Classes
    LightGBMParams
  55. def getBinSampleCount: Int
    Definition Classes
    LightGBMBinParams
  56. def getBoostFromAverage: Boolean
    Definition Classes
    LightGBMParams
  57. def getBoostingType: String
    Definition Classes
    LightGBMParams
  58. def getCategoricalIndexes(featuresSchema: StructField): Array[Int]

    Retrieves the categorical indexes in the features column.

    Retrieves the categorical indexes in the features column.

    featuresSchema

    The schema of the features column

    returns

    the categorical indexes in the features column.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  59. def getCategoricalSlotIndexes: Array[Int]
    Definition Classes
    LightGBMSlotParams
  60. def getCategoricalSlotNames: Array[String]
    Definition Classes
    LightGBMSlotParams
  61. def getChunkSize: Int
    Definition Classes
    LightGBMExecutionParams
  62. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  63. def getColumnParams: ColumnParams
    Attributes
    protected
    Definition Classes
    LightGBMBase
  64. def getDartParams: DartModeParams

    Constructs the DartModeParams

    Constructs the DartModeParams

    returns

    DartModeParams object containing parameters related to dart mode.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  65. def getDatasetParams(categoricalIndexes: Array[Int], numThreads: Int): String
    Definition Classes
    LightGBMBase
  66. final def getDefault[T](param: Param[T]): Option[T]
    Definition Classes
    Params
  67. def getDefaultListenPort: Int
    Definition Classes
    LightGBMExecutionParams
  68. def getDelegate: Option[LightGBMDelegate]
    Definition Classes
    LightGBMParams
  69. def getDriverListenPort: Int
    Definition Classes
    LightGBMExecutionParams
  70. def getDropRate: Double
    Definition Classes
    LightGBMDartParams
  71. def getEarlyStoppingRound: Int
    Definition Classes
    LightGBMLearnerParams
  72. def getExecutionParams: ExecutionParams

    Constructs the ExecutionParams.

    Constructs the ExecutionParams.

    returns

    ExecutionParams object containing parameters related to LightGBM execution.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  73. def getFObj: FObjTrait
    Definition Classes
    LightGBMObjectiveParams
  74. def getFeatureFraction: Double
    Definition Classes
    LightGBMFractionParams
  75. final def getFeaturesCol: String
    Definition Classes
    HasFeaturesCol
  76. def getFeaturesShapCol: String
    Definition Classes
    LightGBMPredictionParams
  77. def getImprovementTolerance: Double
    Definition Classes
    LightGBMLearnerParams
  78. def getInitScoreCol: String

    Definition Classes
    HasInitScoreCol
  79. def getIsProvideTrainingMetric: Boolean
    Definition Classes
    LightGBMParams
  80. def getIsUnbalance: Boolean
  81. final def getLabelCol: String
    Definition Classes
    HasLabelCol
  82. def getLambdaL1: Double
    Definition Classes
    LightGBMParams
  83. def getLambdaL2: Double
    Definition Classes
    LightGBMParams
  84. def getLeafPredictionCol: String
    Definition Classes
    LightGBMPredictionParams
  85. def getLearningRate: Double
    Definition Classes
    LightGBMParams
  86. def getMatrixType: String
    Definition Classes
    LightGBMExecutionParams
  87. def getMaxBin: Int
    Definition Classes
    LightGBMBinParams
  88. def getMaxBinByFeature: Array[Int]
    Definition Classes
    LightGBMParams
  89. def getMaxDeltaStep: Double
    Definition Classes
    LightGBMParams
  90. def getMaxDepth: Int
    Definition Classes
    LightGBMParams
  91. def getMaxDrop: Int
    Definition Classes
    LightGBMDartParams
  92. def getMetric: String
    Definition Classes
    LightGBMParams
  93. def getMinDataInLeaf: Int
    Definition Classes
    LightGBMParams
  94. def getMinGainToSplit: Double
    Definition Classes
    LightGBMParams
  95. def getMinSumHessianInLeaf: Double
    Definition Classes
    LightGBMParams
  96. def getModel(trainParams: TrainParams, lightGBMBooster: LightGBMBooster): LightGBMClassificationModel

    Gets the trained model given the train parameters and booster.

    Gets the trained model given the train parameters and booster.

    returns

    trained model.

    Definition Classes
    LightGBMClassifier → LightGBMBase
  97. def getModelString: String
    Definition Classes
    LightGBMParams
  98. def getNegBaggingFraction: Double
    Definition Classes
    LightGBMFractionParams
  99. def getNumBatches: Int
    Definition Classes
    LightGBMExecutionParams
  100. def getNumClasses(dataset: Dataset[_], maxNumClasses: Int): Int
    Attributes
    protected
    Definition Classes
    Classifier
  101. def getNumIterations: Int
    Definition Classes
    LightGBMParams
  102. def getNumLeaves: Int
    Definition Classes
    LightGBMParams
  103. def getNumTasks: Int
    Definition Classes
    LightGBMExecutionParams
  104. def getNumThreads: Int
    Definition Classes
    LightGBMExecutionParams
  105. def getObjective: String
    Definition Classes
    LightGBMObjectiveParams
  106. def getObjectiveParams: ObjectiveParams

    Constructs the ObjectiveParams.

    Constructs the ObjectiveParams.

    returns

    ObjectiveParams object containing parameters related to the objective function.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  107. def getOptGroupCol: Option[String]

    Optional group column for Ranking, set to None by default.

    Optional group column for Ranking, set to None by default.

    returns

    None

    Attributes
    protected
    Definition Classes
    LightGBMBase
  108. final def getOrDefault[T](param: Param[T]): T
    Definition Classes
    Params
  109. def getParallelism: String
    Definition Classes
    LightGBMExecutionParams
  110. def getParam(paramName: String): Param[Any]
    Definition Classes
    Params
  111. def getPosBaggingFraction: Double
    Definition Classes
    LightGBMFractionParams
  112. final def getPredictionCol: String
    Definition Classes
    HasPredictionCol
  113. final def getProbabilityCol: String
    Definition Classes
    HasProbabilityCol
  114. final def getRawPredictionCol: String
    Definition Classes
    HasRawPredictionCol
  115. def getRepartitionByGroupingColumn: Boolean
    Definition Classes
    LightGBMExecutionParams
  116. def getSkipDrop: Double
    Definition Classes
    LightGBMDartParams
  117. def getSlotNames: Array[String]
    Definition Classes
    LightGBMSlotParams
  118. def getSlotNamesWithMetadata(featuresSchema: StructField): Option[Array[String]]
    Definition Classes
    LightGBMBase
  119. def getThresholds: Array[Double]
    Definition Classes
    HasThresholds
  120. def getTimeout: Double
    Definition Classes
    LightGBMExecutionParams
  121. def getTopK: Int
    Definition Classes
    LightGBMExecutionParams
  122. def getTrainParams(numTasks: Int, dataset: Dataset[_], numTasksPerExec: Int): TrainParams

    Gets the training parameters.

    Gets the training parameters.

    numTasks

    The total number of tasks.

    dataset

    The training dataset.

    numTasksPerExec

    The number of tasks per executor.

    returns

    train parameters.

    Definition Classes
    LightGBMClassifier → LightGBMBase
  123. def getTrainingCols: Array[(String, Seq[DataType])]
    Attributes
    protected
    Definition Classes
    LightGBMBase
  124. def getUniformDrop: Boolean
    Definition Classes
    LightGBMDartParams
  125. def getUseBarrierExecutionMode: Boolean
    Definition Classes
    LightGBMExecutionParams
  126. def getUseSingleDatasetMode: Boolean
    Definition Classes
    LightGBMExecutionParams
  127. def getValidationIndicatorCol: String

    Definition Classes
    HasValidationIndicatorCol
  128. def getVerbosity: Int
    Definition Classes
    LightGBMParams
  129. def getWeightCol: String

    Definition Classes
    HasWeightCol
  130. def getXGBoostDartMode: Boolean
    Definition Classes
    LightGBMDartParams
  131. final def hasDefault[T](param: Param[T]): Boolean
    Definition Classes
    Params
  132. def hasParam(paramName: String): Boolean
    Definition Classes
    Params
  133. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  134. val improvementTolerance: DoubleParam
    Definition Classes
    LightGBMLearnerParams
  135. val initScoreCol: Param[String]

    The name of the initial score column

    The name of the initial score column

    Definition Classes
    HasInitScoreCol
  136. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  137. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  138. def innerTrain(dataset: Dataset[_], batchIndex: Int): LightGBMClassificationModel

    Inner train method for LightGBM learners.

    Inner train method for LightGBM learners. Calculates the number of workers, creates a driver thread, and runs mapPartitions on the dataset.

    dataset

    The dataset to train on.

    batchIndex

    In running in batch training mode, gets the batch number.

    returns

    The LightGBM Model from the trained LightGBM Booster.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  139. final def isDefined(param: Param[_]): Boolean
    Definition Classes
    Params
  140. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  141. val isProvideTrainingMetric: BooleanParam
    Definition Classes
    LightGBMParams
  142. final def isSet(param: Param[_]): Boolean
    Definition Classes
    Params
  143. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  144. val isUnbalance: BooleanParam
  145. final val labelCol: Param[String]
    Definition Classes
    HasLabelCol
  146. val lambdaL1: DoubleParam
    Definition Classes
    LightGBMParams
  147. val lambdaL2: DoubleParam
    Definition Classes
    LightGBMParams
  148. val leafPredictionCol: Param[String]
    Definition Classes
    LightGBMPredictionParams
  149. val learningRate: DoubleParam
    Definition Classes
    LightGBMParams
  150. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  151. def logBase(methodName: String): Unit
    Attributes
    protected
    Definition Classes
    BasicLogging
  152. def logClass(): Unit
    Definition Classes
    BasicLogging
  153. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  154. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  155. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  156. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  157. def logErrorBase(methodName: String, e: Exception): Unit
    Attributes
    protected
    Definition Classes
    BasicLogging
  158. def logFit[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  159. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  160. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  161. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  162. def logPredict[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  163. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  164. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  165. def logTrain[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  166. def logTransform[T](f: ⇒ T): T
    Definition Classes
    BasicLogging
  167. def logVerb[T](verb: String, f: ⇒ T): T
    Definition Classes
    BasicLogging
  168. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  169. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  170. def makePyFile(conf: CodegenConfig): Unit
    Definition Classes
    PythonWrappable
  171. def makeRFile(conf: CodegenConfig): Unit
    Definition Classes
    RWrappable
  172. val matrixType: Param[String]
    Definition Classes
    LightGBMExecutionParams
  173. val maxBin: IntParam
    Definition Classes
    LightGBMBinParams
  174. val maxBinByFeature: IntArrayParam
    Definition Classes
    LightGBMParams
  175. val maxDeltaStep: DoubleParam
    Definition Classes
    LightGBMParams
  176. val maxDepth: IntParam
    Definition Classes
    LightGBMParams
  177. val maxDrop: IntParam
    Definition Classes
    LightGBMDartParams
  178. val metric: Param[String]
    Definition Classes
    LightGBMParams
  179. val minDataInLeaf: IntParam
    Definition Classes
    LightGBMParams
  180. val minGainToSplit: DoubleParam
    Definition Classes
    LightGBMParams
  181. val minSumHessianInLeaf: DoubleParam
    Definition Classes
    LightGBMParams
  182. val modelString: Param[String]
    Definition Classes
    LightGBMParams
  183. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  184. val negBaggingFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  185. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  186. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  187. val numBatches: IntParam
    Definition Classes
    LightGBMExecutionParams
  188. val numIterations: IntParam
    Definition Classes
    LightGBMParams
  189. val numLeaves: IntParam
    Definition Classes
    LightGBMParams
  190. val numTasks: IntParam
    Definition Classes
    LightGBMExecutionParams
  191. val numThreads: IntParam
    Definition Classes
    LightGBMExecutionParams
  192. val objective: Param[String]
    Definition Classes
    LightGBMObjectiveParams
  193. val parallelism: Param[String]
    Definition Classes
    LightGBMExecutionParams
  194. lazy val params: Array[Param[_]]
    Definition Classes
    Params
  195. val posBaggingFraction: DoubleParam
    Definition Classes
    LightGBMFractionParams
  196. final val predictionCol: Param[String]
    Definition Classes
    HasPredictionCol
  197. def prepareDataframe(dataset: Dataset[_], numTasks: Int): DataFrame
    Attributes
    protected
    Definition Classes
    LightGBMBase
  198. def preprocessData(dataset: DataFrame): DataFrame

    Allow algorithm specific preprocessing of dataset.

    Allow algorithm specific preprocessing of dataset.

    dataset

    The dataset to preprocess prior to training.

    returns

    The preprocessed data.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  199. final val probabilityCol: Param[String]
    Definition Classes
    HasProbabilityCol
  200. def pyAdditionalMethods: String
    Definition Classes
    PythonWrappable
  201. lazy val pyClassDoc: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  202. lazy val pyClassName: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  203. def pyExtraEstimatorImports: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  204. def pyExtraEstimatorMethods: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  205. lazy val pyInheritedClasses: Seq[String]
    Attributes
    protected
    Definition Classes
    PythonWrappable
  206. def pyInitFunc(): String
    Definition Classes
    PythonWrappable
  207. lazy val pyInternalWrapper: Boolean
    Attributes
    protected
    Definition Classes
    PythonWrappable
  208. lazy val pyObjectBaseClass: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  209. def pyParamArg[T](p: Param[T]): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  210. def pyParamDefault[T](p: Param[T]): Option[String]
    Attributes
    protected
    Definition Classes
    PythonWrappable
  211. def pyParamGetter(p: Param[_]): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  212. def pyParamSetter(p: Param[_]): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  213. def pyParamsArgs: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  214. def pyParamsDefaults: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  215. lazy val pyParamsDefinitions: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  216. def pyParamsGetters: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  217. def pyParamsSetters: String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  218. def pythonClass(): String
    Attributes
    protected
    Definition Classes
    PythonWrappable
  219. def rClass(): String
    Attributes
    protected
    Definition Classes
    RWrappable
  220. def rDocString: String
    Attributes
    protected
    Definition Classes
    RWrappable
  221. def rExtraBodyLines: String
    Attributes
    protected
    Definition Classes
    RWrappable
  222. def rExtraInitLines: String
    Attributes
    protected
    Definition Classes
    RWrappable
  223. lazy val rFuncName: String
    Attributes
    protected
    Definition Classes
    RWrappable
  224. lazy val rInternalWrapper: Boolean
    Attributes
    protected
    Definition Classes
    RWrappable
  225. def rParamArg[T](p: Param[T]): String
    Attributes
    protected
    Definition Classes
    RWrappable
  226. def rParamsArgs: String
    Attributes
    protected
    Definition Classes
    RWrappable
  227. def rSetterLines: String
    Attributes
    protected
    Definition Classes
    RWrappable
  228. final val rawPredictionCol: Param[String]
    Definition Classes
    HasRawPredictionCol
  229. val repartitionByGroupingColumn: BooleanParam
    Definition Classes
    LightGBMExecutionParams
  230. def save(path: String): Unit
    Definition Classes
    MLWritable
    Annotations
    @Since( "1.6.0" ) @throws( ... )
  231. final def set(paramPair: ParamPair[_]): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  232. final def set(param: String, value: Any): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  233. final def set[T](param: Param[T], value: T): LightGBMClassifier.this.type
    Definition Classes
    Params
  234. def setBaggingFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  235. def setBaggingFreq(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  236. def setBaggingSeed(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  237. def setBinSampleCount(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMBinParams
  238. def setBoostFromAverage(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  239. def setBoostingType(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  240. def setCategoricalSlotIndexes(value: Array[Int]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMSlotParams
  241. def setCategoricalSlotNames(value: Array[String]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMSlotParams
  242. def setChunkSize(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  243. final def setDefault(paramPairs: ParamPair[_]*): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  244. final def setDefault[T](param: Param[T], value: T): LightGBMClassifier.this.type
    Attributes
    protected
    Definition Classes
    Params
  245. def setDefaultListenPort(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  246. def setDelegate(delegate: LightGBMDelegate): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  247. def setDriverListenPort(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  248. def setDropRate(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  249. def setEarlyStoppingRound(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMLearnerParams
  250. def setFObj(value: FObjTrait): LightGBMClassifier.this.type
    Definition Classes
    LightGBMObjectiveParams
  251. def setFeatureFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  252. def setFeaturesCol(value: String): LightGBMClassifier
    Definition Classes
    Predictor
  253. def setFeaturesShapCol(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMPredictionParams
  254. def setImprovementTolerance(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMLearnerParams
  255. def setInitScoreCol(value: String): LightGBMClassifier.this.type

    Definition Classes
    HasInitScoreCol
  256. def setIsProvideTrainingMetric(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  257. def setIsUnbalance(value: Boolean): LightGBMClassifier.this.type
  258. def setLabelCol(value: String): LightGBMClassifier
    Definition Classes
    Predictor
  259. def setLambdaL1(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  260. def setLambdaL2(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  261. def setLeafPredictionCol(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMPredictionParams
  262. def setLearningRate(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  263. def setMatrixType(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  264. def setMaxBin(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMBinParams
  265. def setMaxBinByFeature(value: Array[Int]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  266. def setMaxDeltaStep(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  267. def setMaxDepth(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  268. def setMaxDrop(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  269. def setMetric(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  270. def setMinDataInLeaf(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  271. def setMinGainToSplit(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  272. def setMinSumHessianInLeaf(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  273. def setModelString(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  274. def setNegBaggingFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  275. def setNumBatches(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  276. def setNumIterations(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  277. def setNumLeaves(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  278. def setNumTasks(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  279. def setNumThreads(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  280. def setObjective(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMObjectiveParams
  281. def setParallelism(value: String): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  282. def setPosBaggingFraction(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMFractionParams
  283. def setPredictionCol(value: String): LightGBMClassifier
    Definition Classes
    Predictor
  284. def setProbabilityCol(value: String): LightGBMClassifier
    Definition Classes
    ProbabilisticClassifier
  285. def setRawPredictionCol(value: String): LightGBMClassifier
    Definition Classes
    Classifier
  286. def setRepartitionByGroupingColumn(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  287. def setSkipDrop(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  288. def setSlotNames(value: Array[String]): LightGBMClassifier.this.type
    Definition Classes
    LightGBMSlotParams
  289. def setThresholds(value: Array[Double]): LightGBMClassifier
    Definition Classes
    ProbabilisticClassifier
  290. def setTimeout(value: Double): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  291. def setTopK(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  292. def setUniformDrop(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  293. def setUseBarrierExecutionMode(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  294. def setUseSingleDatasetMode(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMExecutionParams
  295. def setValidationIndicatorCol(value: String): LightGBMClassifier.this.type

    Definition Classes
    HasValidationIndicatorCol
  296. def setVerbosity(value: Int): LightGBMClassifier.this.type
    Definition Classes
    LightGBMParams
  297. def setWeightCol(value: String): LightGBMClassifier.this.type

    Definition Classes
    HasWeightCol
  298. def setXGBoostDartMode(value: Boolean): LightGBMClassifier.this.type
    Definition Classes
    LightGBMDartParams
  299. val skipDrop: DoubleParam
    Definition Classes
    LightGBMDartParams
  300. val slotNames: StringArrayParam
    Definition Classes
    LightGBMSlotParams
  301. def stringFromTrainedModel(model: LightGBMClassificationModel): String
    Definition Classes
    LightGBMClassifier → LightGBMBase
  302. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  303. val thresholds: DoubleArrayParam
    Definition Classes
    HasThresholds
  304. val timeout: DoubleParam
    Definition Classes
    LightGBMExecutionParams
  305. def toString(): String
    Definition Classes
    Identifiable → AnyRef → Any
  306. val topK: IntParam
    Definition Classes
    LightGBMExecutionParams
  307. def train(dataset: Dataset[_]): LightGBMClassificationModel

    Trains the LightGBM model.

    Trains the LightGBM model. If batches are specified, breaks training dataset into batches for training.

    dataset

    The input dataset to train.

    returns

    The trained model.

    Attributes
    protected
    Definition Classes
    LightGBMBase
  308. def transformSchema(schema: StructType): StructType
    Definition Classes
    Predictor → PipelineStage
  309. def transformSchema(schema: StructType, logging: Boolean): StructType
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  310. val uid: String
    Definition Classes
    LightGBMClassifier → BasicLogging → Identifiable
  311. val uniformDrop: BooleanParam
    Definition Classes
    LightGBMDartParams
  312. val useBarrierExecutionMode: BooleanParam
    Definition Classes
    LightGBMExecutionParams
  313. val useSingleDatasetMode: BooleanParam
    Definition Classes
    LightGBMExecutionParams
  314. def validateAndTransformSchema(schema: StructType, fitting: Boolean, featuresDataType: DataType): StructType
    Attributes
    protected
    Definition Classes
    ProbabilisticClassifierParams → ClassifierParams → PredictorParams
  315. def validateLabel(label: Double, numClasses: Int): Unit
    Attributes
    protected
    Definition Classes
    Classifier
  316. def validateNumClasses(numClasses: Int): Unit
    Attributes
    protected
    Definition Classes
    Classifier
  317. val validationIndicatorCol: Param[String]

    The name of the validation indicator column

    The name of the validation indicator column

    Definition Classes
    HasValidationIndicatorCol
  318. val ver: String
    Definition Classes
    BasicLogging
  319. val verbosity: IntParam
    Definition Classes
    LightGBMParams
  320. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  321. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  322. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  323. val weightCol: Param[String]

    The name of the weight column

    The name of the weight column

    Definition Classes
    HasWeightCol
  324. def write: MLWriter
    Definition Classes
    DefaultParamsWritable → MLWritable
  325. val xgboostDartMode: BooleanParam
    Definition Classes
    LightGBMDartParams

Inherited from LightGBMBase[LightGBMClassificationModel]

Inherited from BasicLogging

Inherited from LightGBMParams

Inherited from LightGBMObjectiveParams

Inherited from LightGBMPredictionParams

Inherited from LightGBMDartParams

Inherited from LightGBMLearnerParams

Inherited from LightGBMBinParams

Inherited from LightGBMFractionParams

Inherited from LightGBMSlotParams

Inherited from LightGBMExecutionParams

Inherited from HasInitScoreCol

Inherited from HasValidationIndicatorCol

Inherited from HasWeightCol

Inherited from DefaultParamsWritable

Inherited from MLWritable

Inherited from Wrappable

Inherited from RWrappable

Inherited from PythonWrappable

Inherited from BaseWrappable

Inherited from ProbabilisticClassifier[Vector, LightGBMClassifier, LightGBMClassificationModel]

Inherited from ProbabilisticClassifierParams

Inherited from HasThresholds

Inherited from HasProbabilityCol

Inherited from Classifier[Vector, LightGBMClassifier, LightGBMClassificationModel]

Inherited from ClassifierParams

Inherited from HasRawPredictionCol

Inherited from Predictor[Vector, LightGBMClassifier, LightGBMClassificationModel]

Inherited from PredictorParams

Inherited from HasPredictionCol

Inherited from HasFeaturesCol

Inherited from HasLabelCol

Inherited from Estimator[LightGBMClassificationModel]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

getParam

param

setParam

Ungrouped