StringSplitFeaturizer

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

6. val columnName: String

   

   used as feature name prefix.

   used as feature name prefix.

   Definition Classes

   StringSplitFeaturizer → Featurizer

7. final def eq(arg0: AnyRef): Boolean

   

   Definition Classes

   AnyRef

8. def equals(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

9. def featurize(row: Row, indices: ArrayBuilder[Int], values: ArrayBuilder[Double]): Unit

   

   Featurize a single row.

   Featurize a single row.

   row

   input row.

   indices

   output indices.

   values

   output values.

   Definition Classes

   StringSplitFeaturizer → Featurizer

   Note

   this interface isn't very Scala-esce, but it avoids lots of allocation. Also due to SparseVector limitations we don't support 64bit indices (e.g. indices are signed 32bit ints)

10. val fieldIdx: Int

    

    input field index.

    input field index.

    Definition Classes

    StringSplitFeaturizer → Featurizer

11. def finalize(): Unit

    

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

12. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

13. def hashCode(): Int

    

    Definition Classes

    AnyRef → Any

14. lazy val hasher: VowpalWabbitMurmurWithPrefix

    

    Initialize hasher that already pre-hashes the column prefix.

    Initialize hasher that already pre-hashes the column prefix.

    Attributes

    protected

    Definition Classes

    Featurizer

15. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

16. val mask: Int

    

    bit mask applied to final hash.

17. val namespaceHash: Int

    

    pre-hashed namespace.

18. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

19. val nonWhiteSpaces: Regex

    

    (?U) makes \w unicode aware https://stackoverflow.com/questions/4304928/unicode-equivalents-for-w-and-b-in-java-regular-expressions we could follow https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text.CountVectorizer.html but that strips single character words...

    (?U) makes \w unicode aware https://stackoverflow.com/questions/4304928/unicode-equivalents-for-w-and-b-in-java-regular-expressions we could follow https://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text.CountVectorizer.html but that strips single character words...

    TODO: expose as user configurable parameter

20. final def notify(): Unit

    

    Definition Classes

    AnyRef

21. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

22. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

23. def toString(): String

    

    Definition Classes

    AnyRef → Any

24. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

25. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

26. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )