Some Aspects of Measurement Error in Linear Regression of Astronomical Data
Top Cited Papers
- 20 August 2007
- journal article
- Published by American Astronomical Society in The Astrophysical Journal
- Vol. 665 (2) , 1489-1506
- https://doi.org/10.1086/519947
Abstract
I describe a Bayesian method to account for measurement errors in linear regression of astronomical data. The method allows for heteroscedastic and possibly correlated measurement errors, and intrinsic scatter in the regression relationship. The method is based on deriving a likelihood function for the measured data, and I focus on the case when the intrinsic distribution of the independent variables can be approximated using a mixture of Gaussians. I generalize the method to incorporate multiple independent variables, non-detections, and selection effects (e.g., Malmquist bias). A Gibbs sampler is described for simulating random draws from the probability distribution of the parameters, given the observed data. I use simulation to compare the method with other common estimators. The simulations illustrate that the Gaussian mixture model outperforms other common estimators and can effectively give constraints on the regression parameters, even when the measurement errors dominate the observed scatter, source detection fraction is low, or the intrinsic distribution of the independent variables is not a mixture of Gaussians. I conclude by using this method to fit the X-ray spectral slope as a function of Eddington ratio using a sample of 39 z < 0.8 radio-quiet quasars. I confirm the correlation seen by other authors between the radio-quiet quasar X-ray spectral slope and the Eddington ratio, where the X-ray spectral slope softens as the Eddington ratio increases.Comment: 39 pages, 11 figures, 1 table, accepted by ApJ. IDL routines (linmix_err.pro) for performing the Markov Chain Monte Carlo are available at the IDL astronomy user's library, http://idlastro.gsfc.nasa.gov/homepage.htmKeywords
All Related Versions
This publication has 51 references indexed in Scilit:
- A general maximum likelihood analysis of measurement error in generalized linear modelsStatistics and Computing, 2002
- Flexible Parametric Measurement Error ModelsBiometrics, 1999
- Bootstrap Methods and their ApplicationPublished by Cambridge University Press (CUP) ,1997
- Linear Regression for Astronomical Data with Measurement Errors and Intrinsic ScatterThe Astrophysical Journal, 1996
- A test for partial correlation with censored astronomical dataMonthly Notices of the Royal Astronomical Society, 1996
- Understanding the Metropolis-Hastings AlgorithmThe American Statistician, 1995
- Bayesian Analysis of Errors-in-Variables Regression ModelsPublished by JSTOR ,1995
- Measurement Error in Nonlinear ModelsPublished by Springer Nature ,1995
- Simple Method for Fitting Data when Both Variables Have UncertaintiesAmerican Journal of Physics, 1974
- Likelihood Distributions for Estimating Functions When Both Variables Are Subject to ErrorTechnometrics, 1967