Packages

package stages

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. class Cacher extends Transformer with Wrappable with DefaultParamsWritable with SynapseMLLogging
  2. class ClassBalancer extends Estimator[ClassBalancerModel] with DefaultParamsWritable with HasInputCol with HasOutputCol with Wrappable with SynapseMLLogging

    An estimator that calculates the weights for balancing a dataset.

    An estimator that calculates the weights for balancing a dataset. For example, if the negative class is half the size of the positive class, the weights will be 2 for rows with negative classes and 1 for rows with positive classes. these weights can be used in weighted classifiers and regressors to correct for heavily skewed datasets. The inputCol should be the labels of the classes, and the output col will be the requisite weights.

  3. class ClassBalancerModel extends Model[ClassBalancerModel] with ComplexParamsWritable with Wrappable with HasInputCol with HasOutputCol with SynapseMLLogging
  4. class Consolidator[T] extends AnyRef
  5. class DropColumns extends Transformer with Wrappable with DefaultParamsWritable with SynapseMLLogging

    DropColumns takes a dataframe and a list of columns to drop as input and returns a dataframe comprised of only those columns not listed in the input list.

  6. class DynamicBufferedBatcher[T] extends Iterator[List[T]]
  7. class DynamicMiniBatchTransformer extends Transformer with MiniBatchBase with SynapseMLLogging
  8. class EnsembleByKey extends Transformer with Wrappable with DefaultParamsWritable with SynapseMLLogging
  9. class Explode extends Transformer with HasInputCol with HasOutputCol with Wrappable with DefaultParamsWritable with SynapseMLLogging
  10. class FixedBatcher[T] extends Iterator[List[T]]
  11. class FixedBufferedBatcher[T] extends Iterator[List[T]]
  12. class FixedMiniBatchTransformer extends Transformer with MiniBatchBase with HasBatchSize with SynapseMLLogging
  13. class FlattenBatch extends Transformer with Wrappable with DefaultParamsWritable with SynapseMLLogging
  14. trait HasBatchSize extends Params
  15. trait HasMiniBatcher extends Params
  16. class Lambda extends Transformer with Wrappable with ComplexParamsWritable with SynapseMLLogging
  17. trait MiniBatchBase extends Transformer with DefaultParamsWritable with Wrappable with SynapseMLLogging
  18. class MultiColumnAdapter extends Estimator[PipelineModel] with Wrappable with ComplexParamsWritable with SynapseMLLogging

    The MultiColumnAdapter takes a unary pipeline stage and a list of input output column pairs and applies the pipeline stage to each input column after being fit

  19. class PartitionConsolidator extends Transformer with ConcurrencyParams with HasInputCol with HasOutputCol with ComplexParamsWritable with SynapseMLLogging
  20. class RenameColumn extends Transformer with Wrappable with DefaultParamsWritable with HasInputCol with HasOutputCol with SynapseMLLogging

    RenameColumn takes a dataframe with an input and an output column name and returns a dataframe comprised of the original columns with the input column renamed as the output column name.

  21. class Repartition extends Transformer with Wrappable with DefaultParamsWritable with SynapseMLLogging

    Partitions the dataset into n partitions

  22. class SelectColumns extends Transformer with Wrappable with DefaultParamsWritable with SynapseMLLogging

    SelectColumns takes a dataframe and a list of columns to select as input and returns a dataframe comprised of only those columns listed in the input list.

    SelectColumns takes a dataframe and a list of columns to select as input and returns a dataframe comprised of only those columns listed in the input list.

    The columns to be selected is a list of column names

  23. class StratifiedRepartition extends Transformer with Wrappable with DefaultParamsWritable with HasLabelCol with HasSeed with SynapseMLLogging

    StratifiedRepartition repartitions the DataFrame such that each label is selected in each partition.

    StratifiedRepartition repartitions the DataFrame such that each label is selected in each partition. This may be necessary in some cases such as in LightGBM multiclass classification, where it is necessary for at least one instance of each label to be present on each partition.

  24. class SummarizeData extends Transformer with SummarizeDataParams with SynapseMLLogging

    Compute summary statistics for the dataset.

    Compute summary statistics for the dataset. The following statistics are computed: - counts - basic - sample - percentiles - errorThreshold - error threshold for quantiles

  25. trait SummarizeDataParams extends Wrappable with DefaultParamsWritable
  26. class TextPreprocessor extends Transformer with HasInputCol with HasOutputCol with Wrappable with ComplexParamsWritable with SynapseMLLogging

    TextPreprocessor takes a dataframe and a dictionary that maps (text -> replacement text), scans each cell in the input col and replaces all substring matches with the corresponding value.

    TextPreprocessor takes a dataframe and a dictionary that maps (text -> replacement text), scans each cell in the input col and replaces all substring matches with the corresponding value. Priority is given to longer keys and from left to right.

  27. class TimeIntervalBatcher[T] extends Iterator[List[T]]
  28. class TimeIntervalMiniBatchTransformer extends Transformer with MiniBatchBase with SynapseMLLogging
  29. class Timer extends Estimator[TimerModel] with TimerParams with ComplexParamsWritable with SynapseMLLogging
  30. class TimerModel extends Model[TimerModel] with TimerParams with ComplexParamsWritable with SynapseMLLogging
  31. trait TimerParams extends Wrappable
  32. class Trie extends Serializable
  33. class UDFTransformer extends Transformer with Wrappable with ComplexParamsWritable with HasInputCol with HasInputCols with HasOutputCol with SynapseMLLogging

    UDFTransformer takes as input input column, output column, and a UserDefinedFunction returns a dataframe comprised of the original columns with the output column as the result of the udf applied to the input column

  34. class UnicodeNormalize extends Transformer with HasInputCol with HasOutputCol with Wrappable with ComplexParamsWritable with SynapseMLLogging

    UnicodeNormalize takes a dataframe and normalizes the unicode representation.

Value Members

  1. object Cacher extends DefaultParamsReadable[Cacher] with Serializable
  2. object ClassBalancer extends DefaultParamsReadable[ClassBalancer] with Serializable
  3. object ClassBalancerModel extends ComplexParamsReadable[ClassBalancerModel] with Serializable
  4. object DropColumns extends DefaultParamsReadable[DropColumns] with Serializable
  5. object DynamicMiniBatchTransformer extends DefaultParamsReadable[DynamicMiniBatchTransformer] with Serializable
  6. object EnsembleByKey extends DefaultParamsReadable[EnsembleByKey] with Serializable
  7. object Explode extends DefaultParamsReadable[Explode] with Serializable
  8. object FixedMiniBatchTransformer extends DefaultParamsReadable[FixedMiniBatchTransformer] with Serializable
  9. object FlattenBatch extends DefaultParamsReadable[FlattenBatch] with Serializable
  10. object Lambda extends ComplexParamsReadable[Lambda] with Serializable
  11. object MultiColumnAdapter extends ComplexParamsReadable[MultiColumnAdapter] with Serializable
  12. object PartitionConsolidator extends DefaultParamsReadable[PartitionConsolidator] with Serializable
  13. object RenameColumn extends DefaultParamsReadable[RenameColumn] with Serializable
  14. object Repartition extends DefaultParamsReadable[Repartition] with Serializable
  15. object SPConstants

    Constants for StratifiedRepartition.

  16. object SelectColumns extends DefaultParamsReadable[SelectColumns] with Serializable
  17. object StratifiedRepartition extends DefaultParamsReadable[DropColumns] with Serializable
  18. object SummarizeData extends DefaultParamsReadable[SummarizeData] with Serializable
  19. object TextPreprocessor extends ComplexParamsReadable[TextPreprocessor] with Serializable
  20. object TimeIntervalMiniBatchTransformer extends DefaultParamsReadable[TimeIntervalMiniBatchTransformer] with Serializable
  21. object Timer extends ComplexParamsReadable[Timer] with Serializable
  22. object TimerModel extends ComplexParamsReadable[TimerModel] with Serializable
  23. object Trie extends Serializable
  24. object UDFTransformer extends ComplexParamsReadable[UDFTransformer] with Serializable
  25. object UnicodeNormalize extends ComplexParamsReadable[UnicodeNormalize] with Serializable
  26. object udfs

Ungrouped