Type Members

1.  class ContextualBanditMetrics extends Serializable
2.  class ExampleStack extends AnyRef
3.  trait HasAdditionalFeatures extends Params

   VW support multiple input columns which are mapped to namespaces.

   VW support multiple input columns which are mapped to namespaces. Note: when one wants to create quadratic features within VW you'd specify additionalFeatures. Each feature column is treated as one namespace. Using -q 'uc' for columns 'user' and 'content' you'd get all quadratics for features in user/content (the first letter is called feature group and VW users are used to it... before somebody starts complaining ;)

4.  trait HasNumBits extends Params

   Controls hashing parameters such us number of bits (numbits) and how to handle collisions.

5.  trait HasSumCollisions extends Params

   Controls hashing parameters such us number of bits (numbits) and how to handle collisions.

6.  final case class KahanSum(sum: Double = 0, c: Double = 0) extends Product with Serializable

   Aggregator state.

   Aggregator state.

   sum

   the accumulator

   c

   a running compensation for lost low-order bits

   Note

   cannot use generics for double vs float due to perf: https://stackoverflow.com/questions/4753629/how-do-i-make-a-class-generic-for-all-numeric-types

7.  class KahanSumAggregator extends Aggregator[Float, KahanSum, Float] with Serializable with SynapseMLLogging

   Implementation of Kahan summation (https://en.wikipedia.org/wiki/Kahan_summation_algorithm)

   Implementation of Kahan summation (https://en.wikipedia.org/wiki/Kahan_summation_algorithm)

   Kahan-Babushka-Neumaier sum aggregator make sure lots of small numbers are accumulated numerically stable.

8.  case class NamespaceInfo(hash: Int, featureGroup: Char, colIdx: Int) extends Product with Serializable
9.  case class PathAndData(path: String, bytes: Array[Byte]) extends Product with Serializable
10.  abstract class PredictionBuffer extends Serializable

    Collects predictions.

11.  class PredictionBufferDiscard extends PredictionBuffer
12.  class PredictionBufferKeep extends PredictionBuffer
13.  case class TrainContext(vw: VowpalWabbitNative, synchronizationSchedule: VowpalWabbitSyncSchedule, predictionBuffer: PredictionBuffer = new PredictionBufferDiscard, collectOneStepAheadPrediction: Boolean = false, contextualBanditMetrics: ContextualBanditMetrics = new ContextualBanditMetrics, totalTime: StopWatch = new StopWatch, nativeIngestTime: StopWatch = new StopWatch, learnTime: StopWatch = new StopWatch, multipassTime: StopWatch = new StopWatch) extends Product with Serializable
14.  case class TrainingResult(model: Option[Array[Byte]], stats: TrainingStats) extends Product with Serializable
15.  case class TrainingStats(partitionId: Int, arguments: String, learningRate: Double, powerT: Double, hashSeed: Int, numBits: Int, numberOfExamplesPerPass: Long, weightedExampleSum: Double, weightedLabelSum: Double, averageLoss: Double, bestConstant: Float, bestConstantLoss: Float, totalNumberOfFeatures: Long, timeTotalNs: Long, timeNativeIngestNs: Long, timeLearnNs: Long, timeMultipassNs: Long, ipsEstimate: Double, snipsEstimate: Double) extends Product with Serializable
16.  class VectorZipper extends Transformer with HasInputCols with HasOutputCol with Wrappable with ComplexParamsWritable with SynapseMLLogging

    Combine one or more input columns into a sequence in the output column.

17.  trait VowpalWabbitBase extends Wrappable with ComplexParamsWritable with Logging
18.  trait VowpalWabbitBaseLearner extends VowpalWabbitBase

    Base implementation of VowpalWabbit learners.

    Base implementation of VowpalWabbit learners.

    Note

    parameters that regularly are swept through are exposed as proper parameters.

19.  trait VowpalWabbitBaseModel extends Params

    Base trait to wrap the model for prediction.

20.  trait VowpalWabbitBaseModelSpark extends VowpalWabbitBaseModel with HasFeaturesCol with HasRawPredictionCol with HasAdditionalFeatures

    Base implementation for models that use Spark-based features and result in Spark vectors

21.  trait VowpalWabbitBaseProgressive extends Transformer with VowpalWabbitBase

    VowpalWabbit is focused on online learning.

    VowpalWabbit is focused on online learning. In these settings it is common to operate in progressive validation using a 1-step ahead approach. By default when VW learns from data, it first computes the prediction without learning and then updates the model from the new data. This is especially useful in bandit scenarios as one wants to avoid cheating - as in "knowing the future".

22.  trait VowpalWabbitBaseSpark extends VowpalWabbitBaseLearner with HasLabelCol with HasWeightCol with HasFeaturesCol with HasAdditionalFeatures

    * Base implementation for estimators that use Spark-based features (e.g.

    * Base implementation for estimators that use Spark-based features (e.g. SparkML vectors)

23.  class VowpalWabbitCSETransformer extends Transformer with SynapseMLLogging with Wrappable with ComplexParamsWritable

    Emits continuous success experimentation metrics for contextual bandit style predictions and logs.

24.  class VowpalWabbitClassificationModel extends ProbabilisticClassificationModel[Row, VowpalWabbitClassificationModel] with VowpalWabbitBaseModelSpark with ComplexParamsWritable with Wrappable with SynapseMLLogging
25.  class VowpalWabbitClassifier extends ProbabilisticClassifier[Row, VowpalWabbitClassifier, VowpalWabbitClassificationModel] with VowpalWabbitBaseSpark with ComplexParamsWritable with SynapseMLLogging

    VowpalWabbit exposed as SparkML classifier.

26.  class VowpalWabbitClusterUtil extends AnyRef

    Helper to spin up spanning tree coordinator for AllReduce.

27.  class VowpalWabbitContextualBandit extends Predictor[Row, VowpalWabbitContextualBandit, VowpalWabbitContextualBanditModel] with VowpalWabbitContextualBanditBase with HasParallelismInjected with ComplexParamsWritable with SynapseMLLogging
28.  trait VowpalWabbitContextualBanditBase extends VowpalWabbitBaseSpark
29.  class VowpalWabbitContextualBanditModel extends PredictionModel[Row, VowpalWabbitContextualBanditModel] with VowpalWabbitBaseModelSpark with VowpalWabbitContextualBanditBase with ComplexParamsWritable with SynapseMLLogging
30.  class VowpalWabbitDSJsonTransformer extends Transformer with SynapseMLLogging with Wrappable with ComplexParamsWritable
31.  class VowpalWabbitFeaturizer extends Transformer with HasInputCols with HasOutputCol with HasNumBits with HasSumCollisions with Wrappable with ComplexParamsWritable with SynapseMLLogging

    Exposes VW-style featurizer using hashing to SparkML eco system.

32.  class VowpalWabbitGeneric extends Estimator[VowpalWabbitGenericModel] with VowpalWabbitBaseLearner with HasInputCol with SynapseMLLogging

    This Estimator supports driving VW using VW-style examples (e.g.

    This Estimator supports driving VW using VW-style examples (e.g. 0 |a b c)

33.  class VowpalWabbitGenericModel extends Model[VowpalWabbitGenericModel] with VowpalWabbitBaseModel with HasInputCol with ComplexParamsWritable with Wrappable with SynapseMLLogging
34.  class VowpalWabbitGenericProgressive extends Transformer with VowpalWabbitBaseProgressive with HasInputCol with SynapseMLLogging

    VW-style string based input implementation of online learning with progressive (1-step ahead) output.

35.  class VowpalWabbitInteractions extends Transformer with HasInputCols with HasOutputCol with HasNumBits with HasSumCollisions with Wrappable with ComplexParamsWritable with SynapseMLLogging

    This transformer is not intended to be used with VW classifier or regressor, but rather to bring sparse interaction concept to other SparkML learners (e.g.

    This transformer is not intended to be used with VW classifier or regressor, but rather to bring sparse interaction concept to other SparkML learners (e.g. LR).

36.  class VowpalWabbitMurmurWithPrefix extends Serializable

    VW style murmur hash with pre-hashing of an initially specified prefix.

37.  class VowpalWabbitRegressionModel extends RegressionModel[Row, VowpalWabbitRegressionModel] with VowpalWabbitBaseModelSpark with ComplexParamsWritable with Wrappable with SynapseMLLogging
38.  class VowpalWabbitRegressor extends BaseRegressor[Row, VowpalWabbitRegressor, VowpalWabbitRegressionModel] with VowpalWabbitBaseSpark with ComplexParamsWritable with SynapseMLLogging

    VowpalWabbit exposed as SparkML regressor.

39.  trait VowpalWabbitSyncSchedule extends Serializable

    Defines when VW needs to synchronize across partitions.

40.  class VowpalWabbitSyncScheduleDisabled extends VowpalWabbitSyncSchedule
41.  class VowpalWabbitSyncScheduleSplits extends VowpalWabbitSyncSchedule

    Row-count based splitting.