case class TrainingContext(batchIndex: Int, sharedStateSingleton: SharedSingleton[SharedState], schema: StructType, numCols: Int, numInitScoreClasses: Int, trainingParams: BaseTrainParams, networkParams: NetworkParams, columnParams: ColumnParams, datasetParams: String, featureNames: Option[Array[String]], numTasksPerExecutor: Int, validationData: Option[Broadcast[Array[Row]]], broadcastedSampleData: Option[Broadcast[Array[Row]]], partitionCounts: Option[Array[Long]]) extends Serializable with Product

Object to encapsulate all information about a training session that does not change during execution and can be created on the driver. There is also a reference to the shared state in an executor, which can change over time.

Linear Supertypes
Product, Equals, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. TrainingContext
  2. Product
  3. Equals
  4. Serializable
  5. Serializable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new TrainingContext(batchIndex: Int, sharedStateSingleton: SharedSingleton[SharedState], schema: StructType, numCols: Int, numInitScoreClasses: Int, trainingParams: BaseTrainParams, networkParams: NetworkParams, columnParams: ColumnParams, datasetParams: String, featureNames: Option[Array[String]], numTasksPerExecutor: Int, validationData: Option[Broadcast[Array[Row]]], broadcastedSampleData: Option[Broadcast[Array[Row]]], partitionCounts: Option[Array[Long]])

Value Members

  1. val batchIndex: Int
  2. val broadcastedSampleData: Option[Broadcast[Array[Row]]]
  3. val columnParams: ColumnParams
  4. val datasetParams: String
  5. val earlyStoppingRound: Int
  6. val featureNames: Option[Array[String]]
  7. val hasGroups: Boolean
  8. val hasInitialScores: Boolean
  9. val hasValidationData: Boolean
  10. val hasWeights: Boolean
  11. val improvementTolerance: Double
  12. def incrementArrayProcessedSignal(log: Logger): Int
  13. def incrementDataPrepDoneSignal(log: Logger): Unit
  14. val isClassification: Boolean
  15. val isProvideTrainingMetric: Boolean
  16. val isStreaming: Boolean
  17. val microBatchSize: Int
  18. val networkParams: NetworkParams
  19. val numCols: Int
  20. val numInitScoreClasses: Int
  21. val numTasksPerExecutor: Int
  22. val partitionCounts: Option[Array[Long]]
  23. val schema: StructType
  24. def sharedState(): SharedState
  25. val sharedStateSingleton: SharedSingleton[SharedState]
  26. def shouldCreateValidationDataset(): Boolean

    Determines if the current task should calculate the validation Dataset.

    Determines if the current task should calculate the validation Dataset. Only 1 task per executor needs to do it, and first one to call this gets the assignment.

    returns

    True if the current task should create, false otherwise.

  27. val trainingParams: BaseTrainParams
  28. val useSingleDatasetMode: Boolean
  29. val validationData: Option[Broadcast[Array[Row]]]