mmlspark.image package¶
Submodules¶
mmlspark.image.ResizeImageTransformer module¶
- class mmlspark.image.ResizeImageTransformer.ResizeImageTransformer(java_obj=None, height=None, inputCol='image', nChannels=None, outputCol='ResizeImageTransformer_b10b0ddc80d9_output', width=None)[source]¶
Bases:
mmlspark.core.schema.Utils.ComplexParamsMixin
,pyspark.ml.util.JavaMLReadable
,pyspark.ml.util.JavaMLWritable
,pyspark.ml.wrapper.JavaTransformer
- Parameters
- height = Param(parent='undefined', name='height', doc='the width of the image')¶
- inputCol = Param(parent='undefined', name='inputCol', doc='The name of the input column')¶
- nChannels = Param(parent='undefined', name='nChannels', doc='the number of channels of the target image')¶
- outputCol = Param(parent='undefined', name='outputCol', doc='The name of the output column')¶
- setParams(height=None, inputCol='image', nChannels=None, outputCol='ResizeImageTransformer_b10b0ddc80d9_output', width=None)[source]¶
Set the (keyword only) parameters
- width = Param(parent='undefined', name='width', doc='the width of the image')¶
mmlspark.image.UnrollBinaryImage module¶
- class mmlspark.image.UnrollBinaryImage.UnrollBinaryImage(java_obj=None, height=None, inputCol='image', nChannels=None, outputCol='UnrollImage_c462fc9c425d_output', width=None)[source]¶
Bases:
mmlspark.core.schema.Utils.ComplexParamsMixin
,pyspark.ml.util.JavaMLReadable
,pyspark.ml.util.JavaMLWritable
,pyspark.ml.wrapper.JavaTransformer
- Parameters
- height = Param(parent='undefined', name='height', doc='the width of the image')¶
- inputCol = Param(parent='undefined', name='inputCol', doc='The name of the input column')¶
- nChannels = Param(parent='undefined', name='nChannels', doc='the number of channels of the target image')¶
- outputCol = Param(parent='undefined', name='outputCol', doc='The name of the output column')¶
- setParams(height=None, inputCol='image', nChannels=None, outputCol='UnrollImage_c462fc9c425d_output', width=None)[source]¶
Set the (keyword only) parameters
- width = Param(parent='undefined', name='width', doc='the width of the image')¶
mmlspark.image.UnrollImage module¶
- class mmlspark.image.UnrollImage.UnrollImage(java_obj=None, inputCol='image', outputCol='UnrollImage_156ed53bcda8_output')[source]¶
Bases:
mmlspark.core.schema.Utils.ComplexParamsMixin
,pyspark.ml.util.JavaMLReadable
,pyspark.ml.util.JavaMLWritable
,pyspark.ml.wrapper.JavaTransformer
- Parameters
- inputCol = Param(parent='undefined', name='inputCol', doc='The name of the input column')¶
- outputCol = Param(parent='undefined', name='outputCol', doc='The name of the output column')¶
Module contents¶
MMLSpark is an ecosystem of tools aimed towards expanding the distributed computing framework Apache Spark in several new directions. MMLSpark adds many deep learning and data science tools to the Spark ecosystem, including seamless integration of Spark Machine Learning pipelines with Microsoft Cognitive Toolkit (CNTK), LightGBM and OpenCV. These tools enable powerful and highly-scalable predictive and analytical models for a variety of datasources.
MMLSpark also brings new networking capabilities to the Spark Ecosystem. With the HTTP on Spark project, users can embed any web service into their SparkML models. In this vein, MMLSpark provides easy to use SparkML transformers for a wide variety of Microsoft Cognitive Services. For production grade deployment, the Spark Serving project enables high throughput, sub-millisecond latency web services, backed by your Spark cluster.
MMLSpark requires Scala 2.11, Spark 2.4+, and Python 3.5+.