vw

Type Members

1. trait HasAdditionalFeatures extends Wrappable

   

   VW support multiple input columns which are mapped to namespaces.

   VW support multiple input columns which are mapped to namespaces. Note: when one wants to create quadratic features within VW you'd specify additionalFeatures. Each feature column is treated as one namespace. Using -q 'uc' for columns 'user' and 'content' you'd get all quadratics for features in user/content (the first letter is called feature group and VW users are used to it... before somebody starts complaining ;)

2. trait HasNumBits extends Wrappable

   

   Controls hashing parameters such us number of bits (numbits) and how to handle collisions.

3. trait HasSumCollisions extends Wrappable

   

   Controls hashing parameters such us number of bits (numbits) and how to handle collisions.

4. case class NamespaceInfo(hash: Int, featureGroup: Char, colIdx: Int) extends Product with Serializable

   

5. case class PathAndData(path: String, bytes: Array[Byte]) extends Product with Serializable

   

6. case class TrainingResult(model: Option[Array[Byte]], stats: TrainingStats) extends Product with Serializable

   

7. case class TrainingStats(partitionId: Int, arguments: String, learningRate: Double, powerT: Double, hashSeed: Int, numBits: Int, numberOfExamplesPerPass: Long, weightedExampleSum: Double, weightedLabelSum: Double, averageLoss: Double, bestConstant: Float, bestConstantLoss: Float, totalNumberOfFeatures: Long, timeTotalNs: Long, timeNativeIngestNs: Long, timeLearnNs: Long, timeMultipassNs: Long) extends Product with Serializable

   

8. trait VowpalWabbitBase extends Wrappable with DefaultParamsWritable with HasWeightCol with HasAdditionalFeatures with Logging

   

   Base implementation of VowpalWabbit learners.

   Base implementation of VowpalWabbit learners.

   Annotations

   @InternalWrapper()

   Note

   parameters that regularly are swept through are exposed as proper parameters.

9. trait VowpalWabbitBaseModel extends HasFeaturesCol with HasRawPredictionCol with HasAdditionalFeatures with ComplexParamsWritable

   

   Base trait to wrap the model for prediction.

10. class VowpalWabbitClassificationModel extends ProbabilisticClassificationModel[Row, VowpalWabbitClassificationModel] with VowpalWabbitBaseModel

    

    Annotations

    @InternalWrapper()

11. class VowpalWabbitClassifier extends ProbabilisticClassifier[Row, VowpalWabbitClassifier, VowpalWabbitClassificationModel] with VowpalWabbitBase

    

    Annotations

    @InternalWrapper()

12. class VowpalWabbitFeaturizer extends Transformer with HasInputCols with HasOutputCol with HasNumBits with HasSumCollisions with Wrappable with ComplexParamsWritable

    

13. class VowpalWabbitInteractions extends Transformer with HasInputCols with HasOutputCol with HasNumBits with HasSumCollisions with Wrappable with ComplexParamsWritable

    

    This transformer is not intended to be used with VW classifier or regressor, but rather to bring sparse interaction concept to other SparkML learners (e.g.

    This transformer is not intended to be used with VW classifier or regressor, but rather to bring sparse interaction concept to other SparkML learners (e.g. LR).

14. class VowpalWabbitMurmurWithPrefix extends Serializable

    

    VW style murmur hash with pre-hashing of an initially specified prefix.

15. class VowpalWabbitRegressionModel extends RegressionModel[Row, VowpalWabbitRegressionModel] with VowpalWabbitBaseModel with ComplexParamsWritable

    

    Annotations

    @InternalWrapper()

16. class VowpalWabbitRegressor extends BaseRegressor[Row, VowpalWabbitRegressor, VowpalWabbitRegressionModel] with VowpalWabbitBase

    

    Annotations

    @InternalWrapper()