case class TrainingContext(batchIndex: Int, sharedStateSingleton: SharedSingleton[SharedState], schema: StructType, numCols: Int, numInitScoreClasses: Int, trainingParams: BaseTrainParams, networkParams: NetworkParams, columnParams: ColumnParams, datasetParams: String, featureNames: Option[Array[String]], numTasksPerExecutor: Int, validationData: Option[Broadcast[Array[Row]]], broadcastedSampleData: Option[Broadcast[Array[Row]]], partitionCounts: Option[Array[Long]]) extends Serializable with Product

Object to encapsulate all information about a training session that does not change during execution and can be created on the driver. There is also a reference to the shared state in an executor, which can change over time.

Linear Supertypes
Product, Equals, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. TrainingContext
  2. Product
  3. Equals
  4. Serializable
  5. Serializable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TrainingContext(batchIndex: Int, sharedStateSingleton: SharedSingleton[SharedState], schema: StructType, numCols: Int, numInitScoreClasses: Int, trainingParams: BaseTrainParams, networkParams: NetworkParams, columnParams: ColumnParams, datasetParams: String, featureNames: Option[Array[String]], numTasksPerExecutor: Int, validationData: Option[Broadcast[Array[Row]]], broadcastedSampleData: Option[Broadcast[Array[Row]]], partitionCounts: Option[Array[Long]])

Value Members

  1. val batchIndex: Int
  2. val broadcastedSampleData: Option[Broadcast[Array[Row]]]
  3. val columnParams: ColumnParams
  4. val datasetParams: String
  5. val earlyStoppingRound: Int
  6. val featureNames: Option[Array[String]]
  7. val hasGroups: Boolean
  8. val hasGroupsAsInt: Int
  9. val hasInitialScores: Boolean
  10. val hasInitialScoresAsInt: Int
  11. val hasValidationData: Boolean
  12. val hasWeights: Boolean
  13. val hasWeightsAsInt: Int
  14. val improvementTolerance: Double
  15. def incrementArrayProcessedSignal(log: Logger): Int
  16. def incrementDataPrepDoneSignal(log: Logger): Unit
  17. val isBulk: Boolean
  18. val isClassification: Boolean
  19. val isProvideTrainingMetric: Boolean
  20. val isStreaming: Boolean
  21. val microBatchSize: Int
  22. val networkParams: NetworkParams
  23. val numCols: Int
  24. val numInitScoreClasses: Int
  25. val numTasksPerExecutor: Int
  26. val partitionCounts: Option[Array[Long]]
  27. val schema: StructType
  28. def sharedState(): SharedState
  29. val sharedStateSingleton: SharedSingleton[SharedState]
  30. def shouldCreateValidationDataset(): Boolean

    Determines if the current task should calculate the validation Dataset.

    Determines if the current task should calculate the validation Dataset. Only 1 task per executor needs to do it, and first one to call this gets the assignment.

    returns

    True if the current task should create, false otherwise.

  31. implicit def toInt(b: Boolean): Int
  32. val trainingParams: BaseTrainParams
  33. val useSingleDatasetMode: Boolean
  34. val validationData: Option[Broadcast[Array[Row]]]