Constrained monotone regression of ROC curves and histograms using splines and polynomials
- 19 November 2002
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
Receiver operating characteristics (ROC) curves have the property that they start at (0,1) and end at (1,0) and are monotonically decreasing. Furthermore, a parametric representation for the curves is more natural, since ROCs need not be single valued functions: they can start with infinite slope. We show how to fit parametric splines and polynomials to ROC data with the end-point and monotonicity constraints. Spline and polynomial representations provide us a way of computing derivatives at various locations of the ROC curve, which are necessary in order to find the optimal operating points. Density functions are not monotonic but the cumulative density functions are. Thus in order to fit a spline to a density function, we fit a monotonic spline to the cumulative density function and then take the derivative of the fitted spline function. Just as ROCs have end-point constraints, the density functions have end-point constraints. Furthermore, derivatives of splines are spline functions and can be computed in closed form. Thus smoothing of histograms can also be treated as a constrained monotone regression problem. The algorithms were implementation in a mathematical programming language called AMPL and results on sample data sets are given.Keywords
This publication has 11 references indexed in Scilit:
- A quantitative methodology for analyzing the performance of detection algorithmsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A methodology for quantitative performance evaluation of detection algorithmsIEEE Transactions on Image Processing, 1995
- Monotonic Smoothing Splines Fitted by Cross ValidationSIAM Journal on Scientific Computing, 1994
- Part I: Modeling image curves using invariant 3-D object curve models-a path to 3-D recognition and shape estimation from image contoursPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1994
- Optimization Software GuidePublished by Society for Industrial & Applied Mathematics (SIAM) ,1993
- Monotone Regression Splines in ActionStatistical Science, 1988
- User's Guide for NPSOL (Version 4.0): A Fortran Package for Nonlinear Programming.Published by Defense Technical Information Center (DTIC) ,1986
- The Monotone Smoothing of ScatterplotsTechnometrics, 1984
- Monotone Piecewise Cubic InterpolationSIAM Journal on Numerical Analysis, 1980
- A Practical Guide to SplinesPublished by Springer Nature ,1978