ParzenWindowClassifier#

class skactiveml.classifier.ParzenWindowClassifier(n_neighbors=None, metric='rbf', metric_dict=None, classes=None, missing_label=nan, cost_matrix=None, class_prior=0.0, random_state=None, target_type='auto')[source]#

Bases: ClassFrequencyEstimator

Parzen Window Classifier (PWC)

The “Parzen Window Classifier” (PWC) [1] is a simple and probabilistic classifier. This classifier is based on a non-parametric density estimation obtained by applying a kernel function.

Parameters:
classesarray-like of shape (n_classes,) or a list of array-like of shape (2,), default=None

Holds the label for each class. Nested binary vocabularies describe one vocabulary per output for multi-label classification. If None, the classes are determined during the fit.

missing_labelscalar or string or np.nan or None, default=np.nan

Value to represent a missing label.

cost_matrixarray-like of shape (n_classes, n_classes), default=None

Cost matrix with cost_matrix[i,j] indicating cost of predicting class classes[j] for a sample of class classes[i]. Can be only set, if classes is not None.

class_priorfloat or array-like of shape (n_classes,) or (n_outputs, 2), default=0

Prior observations of the class frequency estimates. If class_prior is an array for single-output classification, class_prior[i] indicates the non-negative prior number of samples belonging to class classes_[i]. For multi-label classification, an array contains one binary prior per output. If class_prior is a float, it indicates the non-negative prior number of samples per class for every output.

metricstr or callable, default=’rbf’

The metric must be a valid kernel defined by the function sklearn.metrics.pairwise.pairwise_kernels.

n_neighborsint or None, default=None

Number of nearest neighbours. Default is None, which means all available samples are considered.

metric_dictdict, default=None

Any further parameters are passed directly to the kernel function. For the kernel ‘rbf’ we allow the use of mean bandwidth criterion [2] and use it when gamma is set to ‘mean’ (i.e., {‘gamma’: ‘mean’})..

random_stateint or RandomState instance or None, default=None

Determines random number for predict method. Pass an int for reproducible results across multiple method calls.

target_type“auto” or “single-output” or “multi-label”, default=”auto”

Declared target type. This estimator supports single-output and multi-label classification.

Attributes:
classes_numpy.ndarray of shape (n_classes,) or list of numpy.ndarray

Holds the label for each class after fitting.

class_prior_np.ndarray of shape (n_classes,) or (n_outputs, 2)

Prior observations of the class frequency estimates, ordered like classes_ for single-output targets and like each output’s canonical binary vocabulary for multi-label targets.

cost_matrix_np.ndarray of shape (classes, classes)

Cost matrix with cost_matrix_[i,j] indicating cost of predicting class classes_[j] for a sample of class classes_[i].

X_np.ndarray of shape (n_samples, n_features)

The sample matrix X is the feature matrix representing the samples.

V_np.ndarray of shape (n_samples, n_classes) or (n_samples, n_outputs, 2)

The class labels are represented by counting vectors. For multi-label targets, V_[i, j, c] contains the weighted count for class c of output j at training sample X_[i].

References

[1]

O. Chapelle, “Active Learning for Parzen Window Classifier”, Proceedings of the Tenth International Workshop Artificial Intelligence and Statistics, 2005.

[2]

Chaudhuri, A., Kakde, D., Sadek, C., Gonzalez, L., & Kong, S., “The Mean and Median Criteria for Kernel Bandwidth Selection for Support Vector Data Description” IEEE International Conference on Data Mining Workshops (ICDMW), 2017.

Methods

fit(X, y[, sample_weight])

Fit the model using X as samples and y as class labels.

predict(X, **kwargs)

Return class label predictions for the test samples X.

predict_freq(X)

Return class frequency estimates for the input samples X.

predict_proba(X, **kwargs)

Return probability estimates for the test data X.

sample_proba(X[, n_samples, random_state])

Samples probability vectors from Dirichlet distributions whose parameters alphas are defined as the sum of the frequency estimates returned by predict_freq and the class_prior.

score(X, y[, sample_weight])

Return the mean accuracy on the given test data and labels.

get_metadata_routing()

Get metadata routing of this object.

get_params([deep])

Get parameters for this estimator.

set_fit_request(*[, sample_weight])

Configure whether metadata should be requested to be passed to the fit method.

set_params(**params)

Set the parameters of this estimator.

set_score_request(*[, sample_weight])

Configure whether metadata should be requested to be passed to the score method.

Attributes

ParzenWindowClassifier.fit(X, y, sample_weight=None)[source]#

Fit the model using X as samples and y as class labels.

Parameters:
Xarray-like of shape (n_samples, n_features)

The feature matrix representing the samples.

yarray-like of shape (n_samples,) or (n_samples, n_outputs)

It contains the class labels of the training samples.

sample_weightarray-like of shape (n_samples,) or (n_samples, n_outputs), default=None

It contains the weights of the training samples’ class labels. One weight per sample or one weight per target entry can be provided.

Returns:
selfParzenWindowClassifier,

The ParzenWindowClassifier is fitted on the training data.

ParzenWindowClassifier.predict(X, **kwargs)#

Return class label predictions for the test samples X.

Parameters:
Xarray-like of shape (n_samples, …)

Input samples.

Returns:
ynumpy.ndarray of shape (n_samples,)

Predicted class labels of the test samples X.

ParzenWindowClassifier.predict_freq(X)[source]#

Return class frequency estimates for the input samples X.

Parameters:
Xarray-like or shape (n_samples, n_features) or shape (n_samples, m_samples) if metric == ‘precomputed’

Input samples.

Returns:
Fnp.ndarray of shape (n_samples, n_classes) or (n_samples, n_outputs, 2)

The class frequency estimates of the input samples. Classes are ordered according to the attribute classes_.

ParzenWindowClassifier.predict_proba(X, **kwargs)#

Return probability estimates for the test data X.

Parameters:
Xarray-like of shape (n_samples, n_features)

Input samples.

Returns:
Parray-like of shape (n_samples, n_classes) or (n_samples, n_outputs)

The class probabilities of the test samples. For multi-label targets, each entry is the probability of the second class in the corresponding canonical binary class vocabulary. An output with zero estimated frequencies and zero prior has probability 0.5.

ParzenWindowClassifier.sample_proba(X, n_samples=10, random_state=None)#

Samples probability vectors from Dirichlet distributions whose parameters alphas are defined as the sum of the frequency estimates returned by predict_freq and the class_prior.

Parameters:
Xarray-like of shape (n_test_samples, n_features)

Test samples for which n_samples probability vectors are to be sampled.

n_samplesint, default=10

Number of probability vectors to sample for each X[i].

random_stateint or numpy.random.RandomState or None, default=None

Ensure reproducibility when sampling probability vectors from the Dirichlet distributions.

Returns:
Parray-like of shape (n_samples, n_test_samples, n_classes) or (n_samples, n_test_samples, n_outputs, 2)

There are n_samples class probability vectors for each test sample in X. For multi-label targets, the final axis follows each output’s canonical binary class vocabulary.

Raises:
ValueError

If any class has zero frequency observations after adding the prior. Set a positive class_prior to make every Dirichlet parameter positive.

ParzenWindowClassifier.score(X, y, sample_weight=None)#

Return the mean accuracy on the given test data and labels.

Parameters:
Xarray-like of shape (n_samples, …)

Test samples.

yarray-like of shape (n_samples,)

True class labels of the test samples X.

sample_weightarray-like of shape (n_samples,), default=None

Sample weights of the test sample X.

Returns:
scorefloat

Mean accuracy of self.predict(X) regarding y.

ParzenWindowClassifier.get_metadata_routing()#

Get metadata routing of this object.

Please check User Guide on how the routing mechanism works.

Returns:
routingMetadataRequest

A MetadataRequest encapsulating routing information.

ParzenWindowClassifier.get_params(deep=True)#

Get parameters for this estimator.

Parameters:
deepbool, default=True

If True, will return the parameters for this estimator and contained subobjects that are estimators.

Returns:
paramsdict

Parameter names mapped to their values.

ParzenWindowClassifier.set_fit_request(*, sample_weight: bool | None | str = '$UNCHANGED$') → ParzenWindowClassifier#

Configure whether metadata should be requested to be passed to the fit method.

Note that this method is only relevant when this estimator is used as a sub-estimator within a meta-estimator and metadata routing is enabled with enable_metadata_routing=True (see sklearn.set_config()). Please check the User Guide on how the routing mechanism works.

The options for each parameter are:

  • True: metadata is requested, and passed to fit if provided. The request is ignored if metadata is not provided.

  • False: metadata is not requested and the meta-estimator will not pass it to fit.

  • None: metadata is not requested, and the meta-estimator will raise an error if the user provides it.

  • str: metadata should be passed to the meta-estimator with this given alias instead of the original name.

The default (sklearn.utils.metadata_routing.UNCHANGED) retains the existing request. This allows you to change the request for some parameters and not others.

Added in version 1.3.

Parameters:
sample_weightstr, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED

Metadata routing for sample_weight parameter in fit.

Returns:
selfobject

The updated object.

ParzenWindowClassifier.set_params(**params)#

Set the parameters of this estimator.

The method works on simple estimators as well as on nested objects (such as Pipeline). The latter have parameters of the form <component>__<parameter> so that it’s possible to update each component of a nested object.

Parameters:
**paramsdict

Estimator parameters.

Returns:
selfestimator instance

Estimator instance.

ParzenWindowClassifier.set_score_request(*, sample_weight: bool | None | str = '$UNCHANGED$') → ParzenWindowClassifier#

Configure whether metadata should be requested to be passed to the score method.

Note that this method is only relevant when this estimator is used as a sub-estimator within a meta-estimator and metadata routing is enabled with enable_metadata_routing=True (see sklearn.set_config()). Please check the User Guide on how the routing mechanism works.

The options for each parameter are:

  • True: metadata is requested, and passed to score if provided. The request is ignored if metadata is not provided.

  • False: metadata is not requested and the meta-estimator will not pass it to score.

  • None: metadata is not requested, and the meta-estimator will raise an error if the user provides it.

  • str: metadata should be passed to the meta-estimator with this given alias instead of the original name.

The default (sklearn.utils.metadata_routing.UNCHANGED) retains the existing request. This allows you to change the request for some parameters and not others.

Added in version 1.3.

Parameters:
sample_weightstr, True, False, or None, default=sklearn.utils.metadata_routing.UNCHANGED

Metadata routing for sample_weight parameter in score.

Returns:
selfobject

The updated object.

ParzenWindowClassifier.METRICS = ['additive_chi2', 'chi2', 'cosine', 'linear', 'poly', 'polynomial', 'rbf', 'laplacian', 'sigmoid', 'precomputed']#

Examples using skactiveml.classifier.ParzenWindowClassifier#

Batch Active Learning by Diverse Gradient Embedding (BADGE)

Batch Active Learning by Diverse Gradient Embedding (BADGE)

Clustering Uncertainty-weighted Embeddings (CLUE)

Clustering Uncertainty-weighted Embeddings (CLUE)

Contrastive Active Learning (CAL)

Contrastive Active Learning (CAL)

Core Set

Core Set

Active Learning with Cost Embedding (ALCE)

Active Learning with Cost Embedding (ALCE)

Discriminative Active Learning (DAL)

Discriminative Active Learning (DAL)

Dropout Query (DropQuery)

Dropout Query (DropQuery)

Epistemic Uncertainty Sampling (EpisUS)

Epistemic Uncertainty Sampling (EpisUS)

Fast Active Learning by Contrastive UNcertainty (FALCUN)

Fast Active Learning by Contrastive UNcertainty (FALCUN)

Label Cardinality Inconsistency (LCI)

Label Cardinality Inconsistency (LCI)

MaxHerding

MaxHerding

Maximum Loss Reduction with Maximal Confidence (MMC)

Maximum Loss Reduction with Maximal Confidence (MMC)

Monte-Carlo Expected Error Reduction (EER) with Log-Loss

Monte-Carlo Expected Error Reduction (EER) with Log-Loss

Monte-Carlo Expected Error Reduction (EER) with Misclassification-Loss

Monte-Carlo Expected Error Reduction (EER) with Misclassification-Loss

Parallel Utility Estimation Wrapper

Parallel Utility Estimation Wrapper

Probability Coverage (ProbCover)

Probability Coverage (ProbCover)

Multi-class Probabilistic Active Learning (McPAL)

Multi-class Probabilistic Active Learning (McPAL)

Query-by-Committee (QBC) with Kullback-Leibler Divergence

Query-by-Committee (QBC) with Kullback-Leibler Divergence

Query-by-Committee (QBC) with Variation Ratios

Query-by-Committee (QBC) with Variation Ratios

Query-by-Committee (QBC) with Vote Entropy

Query-by-Committee (QBC) with Vote Entropy

Querying Informative and Representative Examples (QUIRE)

Querying Informative and Representative Examples (QUIRE)

Random Sampling

Random Sampling

Sub-sampling Wrapper

Sub-sampling Wrapper

Typical Clustering (TypiClust)

Typical Clustering (TypiClust)

Uncertainty Herding (UHerding)

Uncertainty Herding (UHerding)

Uncertainty Sampling (US) with Entropy

Uncertainty Sampling (US) with Entropy

Uncertainty Sampling (US) with Least-Confidence

Uncertainty Sampling (US) with Least-Confidence

Uncertainty Sampling (US) with Margin

Uncertainty Sampling (US) with Margin

Uncertainty Sampling with Expected Average Precision (USAP)

Uncertainty Sampling with Expected Average Precision (USAP)

Value of Information (VOI)

Value of Information (VOI)

Value of Information (VOI) on Labeled Samples

Value of Information (VOI) on Labeled Samples

Value of Information (VOI) on Unlabeled Samples

Value of Information (VOI) on Unlabeled Samples

Interval Estimation Threshold

Interval Estimation Threshold

Core Set + Greedy Selection

Core Set + Greedy Selection

Random Sampling

Random Sampling

Cognitive Dual-Query Strategy with Fixed-Uncertainty

Cognitive Dual-Query Strategy with Fixed-Uncertainty

Cognitive Dual-Query Strategy with Random Sampling

Cognitive Dual-Query Strategy with Random Sampling

Cognitive Dual-Query Strategy with Randomized-Variable-Uncertainty

Cognitive Dual-Query Strategy with Randomized-Variable-Uncertainty

Cognitive Dual-Query Strategy with Variable-Uncertainty

Cognitive Dual-Query Strategy with Variable-Uncertainty

Fixed-Uncertainty

Fixed-Uncertainty

Periodic Sampling

Periodic Sampling

Randomized-Variable-Uncertainty

Randomized-Variable-Uncertainty

Split

Split

Density Based Active Learning for Data Streams

Density Based Active Learning for Data Streams

Probabilistic Active Learning in Datastreams

Probabilistic Active Learning in Datastreams

Stream Random Sampling

Stream Random Sampling

Variable-Uncertainty

Variable-Uncertainty