On the efficient use of uncertainty when performing expensive ROC optimisation
Fieldsend, Jonathan E.; Everson, Richard M.
Date: 28 September 2008
Conference paper
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Publisher DOI
Abstract
When optimising receiver operating characteristic (ROC) curves there is an inherent degree of uncertainty associated with the operating point evaluation of a model parameterisation x. This is due to the finite amount of training data used to evaluate the true and false positive rates of x. The uncertainty associated with any particular ...
When optimising receiver operating characteristic (ROC) curves there is an inherent degree of uncertainty associated with the operating point evaluation of a model parameterisation x. This is due to the finite amount of training data used to evaluate the true and false positive rates of x. The uncertainty associated with any particular x can be reduced, but only at the computation cost of evaluating more data. Here we explicitly represent this uncertainty through the use of probabilistically non-dominated archives, and show how expensive ROC optimisation problems may be tackled by only evaluating a small subset of the available data at each generation of an optimisation algorithm. Illustrative results are given on data sets from the well known UCI machine learning repository.
Computer Science
Faculty of Environment, Science and Economy
Item views 0
Full item downloads 0