synapse.ml.explainers package

Submodules

synapse.ml.explainers.ICETransformer module

class synapse.ml.explainers.ICETransformer.ICETransformer(java_obj=None, categoricalFeatures=[], dependenceNameCol='pdpBasedDependence', featureNameCol='featureNames', kind='individual', model=None, numSamples=None, numericFeatures=[], targetClasses=[], targetClassesCol=None, targetCol='probability')

Bases: _ICETransformer

setCategoricalFeatures(values: List[Union[str, Dict]])

Args: values: The list of values that represent categorical features to explain. Values are list of dicts with parameters or just a list of names of categorical features

setNumericFeatures(values: List[Union[str, Dict]])

Args: values: The list of values that represent numeric features to explain. Values are list of dicts with parameters or just a list of names of numeric features

synapse.ml.explainers.ImageLIME module

class synapse.ml.explainers.ImageLIME.ImageLIME(java_obj=None, cellSize=16.0, inputCol=None, kernelWidth=0.75, metricsCol='r2', model=None, modifier=130.0, numSamples=900, outputCol='ImageLIME_d3760e2ec06e__output', regularization=0.0, samplingFraction=0.7, superpixelCol='superpixels', targetClasses=[], targetClassesCol=None, targetCol='probability')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• cellSize (float) – Number that controls the size of the superpixels

• inputCol (str) – input column name

• kernelWidth (float) – Kernel width. Default value: sqrt (number of features) * 0.75

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• modifier (float) – Controls the trade-off spatial and color distance

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• regularization (float) – Regularization param for the lasso. Default value: 0.

• samplingFraction (float) – The fraction of superpixels (for image) or tokens (for text) to keep on

• superpixelCol (str) – The column holding the superpixel decompositions

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

cellSize = Param(parent='undefined', name='cellSize', doc='Number that controls the size of the superpixels')

getCellSize()

Returns:

Number that controls the size of the superpixels

Return type:

cellSize

getInputCol()

Returns:

input column name

Return type:

inputCol

static getJavaPackage()

Returns package name String.

getKernelWidth()

Returns:

Kernel width. Default value: sqrt (number of features) * 0.75

Return type:

kernelWidth

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getModifier()

Returns:

Controls the trade-off spatial and color distance

Return type:

modifier

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getRegularization()

Returns:

Regularization param for the lasso. Default value: 0.

Return type:

regularization

getSamplingFraction()

Returns:

The fraction of superpixels (for image) or tokens (for text) to keep on

Return type:

samplingFraction

getSuperpixelCol()

Returns:

The column holding the superpixel decompositions

Return type:

superpixelCol

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

inputCol = Param(parent='undefined', name='inputCol', doc='input column name')

kernelWidth = Param(parent='undefined', name='kernelWidth', doc='Kernel width. Default value: sqrt (number of features) * 0.75')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

modifier = Param(parent='undefined', name='modifier', doc='Controls the trade-off spatial and color distance')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

regularization = Param(parent='undefined', name='regularization', doc='Regularization param for the lasso. Default value: 0.')

samplingFraction = Param(parent='undefined', name='samplingFraction', doc='The fraction of superpixels (for image) or tokens (for text) to keep on')

setCellSize(value)

Parameters:

cellSize – Number that controls the size of the superpixels

setInputCol(value)

Parameters:

inputCol – input column name

setKernelWidth(value)

Parameters:

kernelWidth – Kernel width. Default value: sqrt (number of features) * 0.75

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setModifier(value)

Parameters:

modifier – Controls the trade-off spatial and color distance

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(cellSize=16.0, inputCol=None, kernelWidth=0.75, metricsCol='r2', model=None, modifier=130.0, numSamples=900, outputCol='ImageLIME_d3760e2ec06e__output', regularization=0.0, samplingFraction=0.7, superpixelCol='superpixels', targetClasses=[], targetClassesCol=None, targetCol='probability')

Set the (keyword only) parameters

setRegularization(value)

Parameters:

regularization – Regularization param for the lasso. Default value: 0.

setSamplingFraction(value)

Parameters:

samplingFraction – The fraction of superpixels (for image) or tokens (for text) to keep on

setSuperpixelCol(value)

Parameters:

superpixelCol – The column holding the superpixel decompositions

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

superpixelCol = Param(parent='undefined', name='superpixelCol', doc='The column holding the superpixel decompositions')

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

synapse.ml.explainers.ImageSHAP module

class synapse.ml.explainers.ImageSHAP.ImageSHAP(java_obj=None, cellSize=16.0, infWeight=100000000.0, inputCol=None, metricsCol='r2', model=None, modifier=130.0, numSamples=None, outputCol='ImageSHAP_1addae04d339__output', superpixelCol='superpixels', targetClasses=[], targetClassesCol=None, targetCol='probability')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• cellSize (float) – Number that controls the size of the superpixels

• infWeight (float) – The double value to represent infinite weight. Default: 1E8.

• inputCol (str) – input column name

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• modifier (float) – Controls the trade-off spatial and color distance

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• superpixelCol (str) – The column holding the superpixel decompositions

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

cellSize = Param(parent='undefined', name='cellSize', doc='Number that controls the size of the superpixels')

getCellSize()

Returns:

Number that controls the size of the superpixels

Return type:

cellSize

getInfWeight()

Returns:

The double value to represent infinite weight. Default: 1E8.

Return type:

infWeight

getInputCol()

Returns:

input column name

Return type:

inputCol

static getJavaPackage()

Returns package name String.

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getModifier()

Returns:

Controls the trade-off spatial and color distance

Return type:

modifier

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getSuperpixelCol()

Returns:

The column holding the superpixel decompositions

Return type:

superpixelCol

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

infWeight = Param(parent='undefined', name='infWeight', doc='The double value to represent infinite weight. Default: 1E8.')

inputCol = Param(parent='undefined', name='inputCol', doc='input column name')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

modifier = Param(parent='undefined', name='modifier', doc='Controls the trade-off spatial and color distance')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

setCellSize(value)

Parameters:

cellSize – Number that controls the size of the superpixels

setInfWeight(value)

Parameters:

infWeight – The double value to represent infinite weight. Default: 1E8.

setInputCol(value)

Parameters:

inputCol – input column name

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setModifier(value)

Parameters:

modifier – Controls the trade-off spatial and color distance

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(cellSize=16.0, infWeight=100000000.0, inputCol=None, metricsCol='r2', model=None, modifier=130.0, numSamples=None, outputCol='ImageSHAP_1addae04d339__output', superpixelCol='superpixels', targetClasses=[], targetClassesCol=None, targetCol='probability')

Set the (keyword only) parameters

setSuperpixelCol(value)

Parameters:

superpixelCol – The column holding the superpixel decompositions

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

superpixelCol = Param(parent='undefined', name='superpixelCol', doc='The column holding the superpixel decompositions')

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

synapse.ml.explainers.TabularLIME module

class synapse.ml.explainers.TabularLIME.TabularLIME(java_obj=None, backgroundData=None, categoricalFeatures=[], inputCols=None, kernelWidth=0.75, metricsCol='r2', model=None, numSamples=1000, outputCol='TabularLIME_cef95e0deecc__output', regularization=0.0, targetClasses=[], targetClassesCol=None, targetCol='probability')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• backgroundData (object) – A dataframe containing background data

• categoricalFeatures (list) – Name of features that should be treated as categorical variables.

• inputCols (list) – input column names

• kernelWidth (float) – Kernel width. Default value: sqrt (number of features) * 0.75

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• regularization (float) – Regularization param for the lasso. Default value: 0.

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

backgroundData = Param(parent='undefined', name='backgroundData', doc='A dataframe containing background data')

categoricalFeatures = Param(parent='undefined', name='categoricalFeatures', doc='Name of features that should be treated as categorical variables.')

getBackgroundData()

Returns:

A dataframe containing background data

Return type:

backgroundData

getCategoricalFeatures()

Returns:

Name of features that should be treated as categorical variables.

Return type:

categoricalFeatures

getInputCols()

Returns:

input column names

Return type:

inputCols

static getJavaPackage()

Returns package name String.

getKernelWidth()

Returns:

Kernel width. Default value: sqrt (number of features) * 0.75

Return type:

kernelWidth

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getRegularization()

Returns:

Regularization param for the lasso. Default value: 0.

Return type:

regularization

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

inputCols = Param(parent='undefined', name='inputCols', doc='input column names')

kernelWidth = Param(parent='undefined', name='kernelWidth', doc='Kernel width. Default value: sqrt (number of features) * 0.75')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

regularization = Param(parent='undefined', name='regularization', doc='Regularization param for the lasso. Default value: 0.')

setBackgroundData(value)

Parameters:

backgroundData – A dataframe containing background data

setCategoricalFeatures(value)

Parameters:

categoricalFeatures – Name of features that should be treated as categorical variables.

setInputCols(value)

Parameters:

inputCols – input column names

setKernelWidth(value)

Parameters:

kernelWidth – Kernel width. Default value: sqrt (number of features) * 0.75

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(backgroundData=None, categoricalFeatures=[], inputCols=None, kernelWidth=0.75, metricsCol='r2', model=None, numSamples=1000, outputCol='TabularLIME_cef95e0deecc__output', regularization=0.0, targetClasses=[], targetClassesCol=None, targetCol='probability')

Set the (keyword only) parameters

setRegularization(value)

Parameters:

regularization – Regularization param for the lasso. Default value: 0.

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

synapse.ml.explainers.TabularSHAP module

class synapse.ml.explainers.TabularSHAP.TabularSHAP(java_obj=None, backgroundData=None, infWeight=100000000.0, inputCols=None, metricsCol='r2', model=None, numSamples=None, outputCol='TabularSHAP_d16e5c3c47f8__output', targetClasses=[], targetClassesCol=None, targetCol='probability')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• backgroundData (object) – A dataframe containing background data

• infWeight (float) – The double value to represent infinite weight. Default: 1E8.

• inputCols (list) – input column names

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

backgroundData = Param(parent='undefined', name='backgroundData', doc='A dataframe containing background data')

getBackgroundData()

Returns:

A dataframe containing background data

Return type:

backgroundData

getInfWeight()

Returns:

The double value to represent infinite weight. Default: 1E8.

Return type:

infWeight

getInputCols()

Returns:

input column names

Return type:

inputCols

static getJavaPackage()

Returns package name String.

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

infWeight = Param(parent='undefined', name='infWeight', doc='The double value to represent infinite weight. Default: 1E8.')

inputCols = Param(parent='undefined', name='inputCols', doc='input column names')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

setBackgroundData(value)

Parameters:

backgroundData – A dataframe containing background data

setInfWeight(value)

Parameters:

infWeight – The double value to represent infinite weight. Default: 1E8.

setInputCols(value)

Parameters:

inputCols – input column names

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(backgroundData=None, infWeight=100000000.0, inputCols=None, metricsCol='r2', model=None, numSamples=None, outputCol='TabularSHAP_d16e5c3c47f8__output', targetClasses=[], targetClassesCol=None, targetCol='probability')

Set the (keyword only) parameters

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

synapse.ml.explainers.TextLIME module

class synapse.ml.explainers.TextLIME.TextLIME(java_obj=None, inputCol=None, kernelWidth=0.75, metricsCol='r2', model=None, numSamples=1000, outputCol='TextLIME_4c9655cde17d__output', regularization=0.0, samplingFraction=0.7, targetClasses=[], targetClassesCol=None, targetCol='probability', tokensCol='tokens')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• inputCol (str) – input column name

• kernelWidth (float) – Kernel width. Default value: sqrt (number of features) * 0.75

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• regularization (float) – Regularization param for the lasso. Default value: 0.

• samplingFraction (float) – The fraction of superpixels (for image) or tokens (for text) to keep on

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

• tokensCol (str) – The column holding the tokens

getInputCol()

Returns:

input column name

Return type:

inputCol

static getJavaPackage()

Returns package name String.

getKernelWidth()

Returns:

Kernel width. Default value: sqrt (number of features) * 0.75

Return type:

kernelWidth

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getRegularization()

Returns:

Regularization param for the lasso. Default value: 0.

Return type:

regularization

getSamplingFraction()

Returns:

The fraction of superpixels (for image) or tokens (for text) to keep on

Return type:

samplingFraction

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

getTokensCol()

Returns:

The column holding the tokens

Return type:

tokensCol

inputCol = Param(parent='undefined', name='inputCol', doc='input column name')

kernelWidth = Param(parent='undefined', name='kernelWidth', doc='Kernel width. Default value: sqrt (number of features) * 0.75')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

regularization = Param(parent='undefined', name='regularization', doc='Regularization param for the lasso. Default value: 0.')

samplingFraction = Param(parent='undefined', name='samplingFraction', doc='The fraction of superpixels (for image) or tokens (for text) to keep on')

setInputCol(value)

Parameters:

inputCol – input column name

setKernelWidth(value)

Parameters:

kernelWidth – Kernel width. Default value: sqrt (number of features) * 0.75

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(inputCol=None, kernelWidth=0.75, metricsCol='r2', model=None, numSamples=1000, outputCol='TextLIME_4c9655cde17d__output', regularization=0.0, samplingFraction=0.7, targetClasses=[], targetClassesCol=None, targetCol='probability', tokensCol='tokens')

Set the (keyword only) parameters

setRegularization(value)

Parameters:

regularization – Regularization param for the lasso. Default value: 0.

setSamplingFraction(value)

Parameters:

samplingFraction – The fraction of superpixels (for image) or tokens (for text) to keep on

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

setTokensCol(value)

Parameters:

tokensCol – The column holding the tokens

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

tokensCol = Param(parent='undefined', name='tokensCol', doc='The column holding the tokens')

synapse.ml.explainers.TextSHAP module

class synapse.ml.explainers.TextSHAP.TextSHAP(java_obj=None, infWeight=100000000.0, inputCol=None, metricsCol='r2', model=None, numSamples=None, outputCol='TextSHAP_2c14c7a023f0__output', targetClasses=[], targetClassesCol=None, targetCol='probability', tokensCol='tokens')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• infWeight (float) – The double value to represent infinite weight. Default: 1E8.

• inputCol (str) – input column name

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

• tokensCol (str) – The column holding the tokens

getInfWeight()

Returns:

The double value to represent infinite weight. Default: 1E8.

Return type:

infWeight

getInputCol()

Returns:

input column name

Return type:

inputCol

static getJavaPackage()

Returns package name String.

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

getTokensCol()

Returns:

The column holding the tokens

Return type:

tokensCol

infWeight = Param(parent='undefined', name='infWeight', doc='The double value to represent infinite weight. Default: 1E8.')

inputCol = Param(parent='undefined', name='inputCol', doc='input column name')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

setInfWeight(value)

Parameters:

infWeight – The double value to represent infinite weight. Default: 1E8.

setInputCol(value)

Parameters:

inputCol – input column name

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(infWeight=100000000.0, inputCol=None, metricsCol='r2', model=None, numSamples=None, outputCol='TextSHAP_2c14c7a023f0__output', targetClasses=[], targetClassesCol=None, targetCol='probability', tokensCol='tokens')

Set the (keyword only) parameters

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

setTokensCol(value)

Parameters:

tokensCol – The column holding the tokens

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

tokensCol = Param(parent='undefined', name='tokensCol', doc='The column holding the tokens')

synapse.ml.explainers.VectorLIME module

class synapse.ml.explainers.VectorLIME.VectorLIME(java_obj=None, backgroundData=None, inputCol=None, kernelWidth=0.75, metricsCol='r2', model=None, numSamples=1000, outputCol='VectorLIME_2ad0edc838e2__output', regularization=0.0, targetClasses=[], targetClassesCol=None, targetCol='probability')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• backgroundData (object) – A dataframe containing background data

• inputCol (str) – input column name

• kernelWidth (float) – Kernel width. Default value: sqrt (number of features) * 0.75

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• regularization (float) – Regularization param for the lasso. Default value: 0.

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

backgroundData = Param(parent='undefined', name='backgroundData', doc='A dataframe containing background data')

getBackgroundData()

Returns:

A dataframe containing background data

Return type:

backgroundData

getInputCol()

Returns:

input column name

Return type:

inputCol

static getJavaPackage()

Returns package name String.

getKernelWidth()

Returns:

Kernel width. Default value: sqrt (number of features) * 0.75

Return type:

kernelWidth

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getRegularization()

Returns:

Regularization param for the lasso. Default value: 0.

Return type:

regularization

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

inputCol = Param(parent='undefined', name='inputCol', doc='input column name')

kernelWidth = Param(parent='undefined', name='kernelWidth', doc='Kernel width. Default value: sqrt (number of features) * 0.75')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

regularization = Param(parent='undefined', name='regularization', doc='Regularization param for the lasso. Default value: 0.')

setBackgroundData(value)

Parameters:

backgroundData – A dataframe containing background data

setInputCol(value)

Parameters:

inputCol – input column name

setKernelWidth(value)

Parameters:

kernelWidth – Kernel width. Default value: sqrt (number of features) * 0.75

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(backgroundData=None, inputCol=None, kernelWidth=0.75, metricsCol='r2', model=None, numSamples=1000, outputCol='VectorLIME_2ad0edc838e2__output', regularization=0.0, targetClasses=[], targetClassesCol=None, targetCol='probability')

Set the (keyword only) parameters

setRegularization(value)

Parameters:

regularization – Regularization param for the lasso. Default value: 0.

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

synapse.ml.explainers.VectorSHAP module

class synapse.ml.explainers.VectorSHAP.VectorSHAP(java_obj=None, backgroundData=None, infWeight=100000000.0, inputCol=None, metricsCol='r2', model=None, numSamples=None, outputCol='VectorSHAP_a68d505cfda1__output', targetClasses=[], targetClassesCol=None, targetCol='probability')

Bases: ComplexParamsMixin, JavaMLReadable, JavaMLWritable, JavaTransformer

Parameters:

• backgroundData (object) – A dataframe containing background data

• infWeight (float) – The double value to represent infinite weight. Default: 1E8.

• inputCol (str) – input column name

• metricsCol (str) – Column name for fitting metrics

• model (object) – The model to be interpreted.

• numSamples (int) – Number of samples to generate.

• outputCol (str) – output column name

• targetClasses (list) – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

• targetClassesCol (str) – The name of the column that specifies the indices of the classes for multinomial classification models.

• targetCol (str) – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

backgroundData = Param(parent='undefined', name='backgroundData', doc='A dataframe containing background data')

getBackgroundData()

Returns:

A dataframe containing background data

Return type:

backgroundData

getInfWeight()

Returns:

The double value to represent infinite weight. Default: 1E8.

Return type:

infWeight

getInputCol()

Returns:

input column name

Return type:

inputCol

static getJavaPackage()

Returns package name String.

getMetricsCol()

Returns:

Column name for fitting metrics

Return type:

metricsCol

getModel()

Returns:

The model to be interpreted.

Return type:

model

getNumSamples()

Returns:

Number of samples to generate.

Return type:

numSamples

getOutputCol()

Returns:

output column name

Return type:

outputCol

getTargetClasses()

Returns:

The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

Return type:

targetClasses

getTargetClassesCol()

Returns:

The name of the column that specifies the indices of the classes for multinomial classification models.

Return type:

targetClassesCol

getTargetCol()

Returns:

The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

Return type:

targetCol

infWeight = Param(parent='undefined', name='infWeight', doc='The double value to represent infinite weight. Default: 1E8.')

inputCol = Param(parent='undefined', name='inputCol', doc='input column name')

metricsCol = Param(parent='undefined', name='metricsCol', doc='Column name for fitting metrics')

model = Param(parent='undefined', name='model', doc='The model to be interpreted.')

numSamples = Param(parent='undefined', name='numSamples', doc='Number of samples to generate.')

outputCol = Param(parent='undefined', name='outputCol', doc='output column name')

classmethod read()

Returns an MLReader instance for this class.

setBackgroundData(value)

Parameters:

backgroundData – A dataframe containing background data

setInfWeight(value)

Parameters:

infWeight – The double value to represent infinite weight. Default: 1E8.

setInputCol(value)

Parameters:

inputCol – input column name

setMetricsCol(value)

Parameters:

metricsCol – Column name for fitting metrics

setModel(value)

Parameters:

model – The model to be interpreted.

setNumSamples(value)

Parameters:

numSamples – Number of samples to generate.

setOutputCol(value)

Parameters:

outputCol – output column name

setParams(backgroundData=None, infWeight=100000000.0, inputCol=None, metricsCol='r2', model=None, numSamples=None, outputCol='VectorSHAP_a68d505cfda1__output', targetClasses=[], targetClassesCol=None, targetCol='probability')

Set the (keyword only) parameters

setTargetClasses(value)

Parameters:

targetClasses – The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.

setTargetClassesCol(value)

Parameters:

targetClassesCol – The name of the column that specifies the indices of the classes for multinomial classification models.

setTargetCol(value)

Parameters:

targetCol – The column name of the prediction target to explain (i.e. the response variable). This is usually set to “prediction” for regression models and “probability” for probabilistic classification models. Default value: probability

targetClasses = Param(parent='undefined', name='targetClasses', doc='The indices of the classes for multinomial classification models. Default: 0.For regression models this parameter is ignored.')

targetClassesCol = Param(parent='undefined', name='targetClassesCol', doc='The name of the column that specifies the indices of the classes for multinomial classification models.')

targetCol = Param(parent='undefined', name='targetCol', doc='The column name of the prediction target to explain (i.e. the response variable). This is usually set to "prediction" for regression models and "probability" for probabilistic classification models. Default value: probability')

Module contents

SynapseML is an ecosystem of tools aimed towards expanding the distributed computing framework Apache Spark in several new directions. SynapseML adds many deep learning and data science tools to the Spark ecosystem, including seamless integration of Spark Machine Learning pipelines with Microsoft Cognitive Toolkit (CNTK), LightGBM and OpenCV. These tools enable powerful and highly-scalable predictive and analytical models for a variety of datasources.

SynapseML also brings new networking capabilities to the Spark Ecosystem. With the HTTP on Spark project, users can embed any web service into their SparkML models. In this vein, SynapseML provides easy to use SparkML transformers for a wide variety of Microsoft Cognitive Services. For production grade deployment, the Spark Serving project enables high throughput, sub-millisecond latency web services, backed by your Spark cluster.

SynapseML requires Scala 2.12, Spark 3.0+, and Python 3.6+.