DEVELOPMENT... OpenML
Flow
sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.ensemble._hist_gradient_boosting.gradient_boosting.HistGradientBoostingClassifier)

sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.ensemble._hist_gradient_boosting.gradient_boosting.HistGradientBoostingClassifier)

Visibility: public Uploaded 16-11-2019 by Nathan sklearn==0.23.dev0 numpy>=1.6.1 scipy>=0.9 603 runs
0 likes downloaded by 0 people 0 issues 0 downvotes , 0 total downloads
  • openml-python python scikit-learn sklearn sklearn_0.23.dev0 study_231
Issue #Downvotes for this reason By


Loading wiki
Help us complete this description Edit
Randomized search on hyper parameters. RandomizedSearchCV implements a "fit" and a "score" method. It also implements "predict", "predict_proba", "decision_function", "transform" and "inverse_transform" if they are implemented in the estimator used. The parameters of the estimator used to apply these methods are optimized by cross-validated search over parameter settings. In contrast to GridSearchCV, not all parameter values are tried out, but rather a fixed number of parameter settings is sampled from the specified distributions. The number of parameter settings that are tried is given by n_iter. If all parameters are presented as a list, sampling without replacement is performed. If at least one parameter is given as a distribution, sampling with replacement is used. It is highly recommended to use continuous distributions for continuous parameters.

Components

estimatorsklearn.ensemble._hist_gradient_boosting.gradient_boosting.HistGradientBoostingClassifier(6)A object of that type is instantiated for each grid point This is assumed to implement the scikit-learn estimator interface Either estimator needs to provide a ``score`` function, or ``scoring`` must be passed

Parameters

cvDetermines the cross-validation splitting strategy Possible inputs for cv are: - None, to use the default 5-fold cross validation, - integer, to specify the number of folds in a `(Stratified)KFold`, - :term:`CV splitter`, - An iterable yielding (train, test) splits as arrays of indices For integer/None inputs, if the estimator is a classifier and ``y`` is either binary or multiclass, :class:`StratifiedKFold` is used. In all other cases, :class:`KFold` is used Refer :ref:`User Guide ` for the various cross-validation strategies that can be used here .. versionchanged:: 0.22 ``cv`` default value if None changed from 3-fold to 5-folddefault: null
error_scoreValue to assign to the score if an error occurs in estimator fitting If set to 'raise', the error is raised. If a numeric value is given, FitFailedWarning is raised. This parameter does not affect the refit step, which will always raise the error. Default is ``np.nan``default: NaN
estimatorA object of that type is instantiated for each grid point This is assumed to implement the scikit-learn estimator interface Either estimator needs to provide a ``score`` function, or ``scoring`` must be passeddefault: {"oml-python:serialized_object": "component_reference", "value": {"key": "estimator", "step_name": null}}
iidIf True, return the average score across folds, weighted by the number of samples in each test set. In this case, the data is assumed to be identically distributed across the folds, and the loss minimized is the total loss per sample, and not the mean loss across the folds .. deprecated:: 0.22 Parameter ``iid`` is deprecated in 0.22 and will be removed in 0.24default: "deprecated"
n_iterNumber of parameter settings that are sampled. n_iter trades off runtime vs quality of the solutiondefault: 3
n_jobsNumber of jobs to run in parallel ``None`` means 1 unless in a :obj:`joblib.parallel_backend` context ``-1`` means using all processors. See :term:`Glossary ` for more detailsdefault: null
param_distributionsDictionary with parameters names (string) as keys and distributions or lists of parameters to try. Distributions must provide a ``rvs`` method for sampling (such as those from scipy.stats.distributions) If a list is given, it is sampled uniformly If a list of dicts is given, first a dict is sampled uniformly, and then a parameter is sampled using that dict as abovedefault: {"l2_regularization": [0, 0.01, 0.1], "learning_rate": [0.01, 0.1, 1], "max_depth": [5, 6, 7, 8, 9, 1000], "max_leaf_nodes": [30, 31, 32, 33, 34, 35, 36, 37, 38, 39], "min_samples_leaf": [2, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29]}
pre_dispatchControls the number of jobs that get dispatched during parallel execution. Reducing this number can be useful to avoid an explosion of memory consumption when more jobs get dispatched than CPUs can process. This parameter can be: - None, in which case all the jobs are immediately created and spawned. Use this for lightweight and fast-running jobs, to avoid delays due to on-demand spawning of the jobs - An int, giving the exact number of total jobs that are spawned - A string, giving an expression as a function of n_jobs, as in '2*n_jobs'default: "2*n_jobs"
random_statePseudo random number generator state used for random uniform sampling from lists of possible values instead of scipy.stats distributions If int, random_state is the seed used by the random number generator; If RandomState instance, random_state is the random number generator; If None, the random number generator is the RandomState instance used by `np.random`default: 0
refitRefit an estimator using the best found parameters on the whole dataset For multiple metric evaluation, this needs to be a string denoting the scorer that would be used to find the best parameters for refitting the estimator at the end Where there are considerations other than maximum score in choosing a best estimator, ``refit`` can be set to a function which returns the selected ``best_index_`` given the ``cv_results``. In that case, the ``best_estimator_`` and ``best_parameters_`` will be set according to the returned ``best_index_`` while the ``best_score_`` attribute will not be availble The refitted estimator is made available at the ``best_estimator_`` attribute and permits using ``predict`` directly on this ``RandomizedSearchCV`` instance Also for multiple metric evaluation, the attributes ``best_index_``, ``best_score_`` and ``best_params_`` will only be available if ``refit`` is set and all of them will be determined w.r.t this s...default: true
return_train_scoreIf ``False``, the ``cv_results_`` attribute will not include training scores Computing training scores is used to get insights on how different parameter settings impact the overfitting/underfitting trade-off However computing the scores on the training set can be computationally expensive and is not strictly required to select the parameters that yield the best generalization performance.default: false
scoringA single string (see :ref:`scoring_parameter`) or a callable (see :ref:`scoring`) to evaluate the predictions on the test set For evaluating multiple metrics, either give a list of (unique) strings or a dict with names as keys and callables as values NOTE that when using custom scorers, each scorer should return a single value. Metric functions returning a list/array of values can be wrapped into multiple scorers that return one value each See :ref:`multimetric_grid_search` for an example If None, the estimator's score method is useddefault: null
verboseControls the verbosity: the higher, the more messagesdefault: 0

0
Runs

List all runs
Parameter:
Rendering chart
Rendering table