Abstract
Least-squares variance component estimation (LS-VCE) is a simple, flexible and attractive method for the estimation of unknown variance and covariance components. LS-VCE is simple because it is based on the well-known principle of LS; it is flexible because it works with a user-defined weight matrix; and it is attractive because it allows one to directly apply the existing body of knowledge of LS theory. In this contribution, we present the LS-VCE method for different scenarios and explore its various properties. The method is described for three classes of weight matrices: a general weight matrix, a weight matrix from the unit weight matrix class; and a weight matrix derived from the class of elliptically contoured distributions. We also compare the LS-VCE method with some of the existing VCE methods. Some of them are shown to be special cases of LS-VCE. We also show how the existing body of knowledge of LS theory can be used to one’s advantage for studying various aspects of VCE, such as the precision and estimability of VCE, the use of a-priori variance component information, and the problem of nonlinear VCE. Finally, we show how the mean and the variance of the fixed effect estimator of the linear model are affected by the results of LS-VCE. Various examples are given to illustrate the theory.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Amiri-Simkooei AR (2003) Formulation of L1 norm minimization in Gauss–Markov models. J Surv Eng 129(1):37–43
Amiri-Simkooei AR, Tiberius CCJM, Teunissen PJG (2006) Noise characteristics in high precision GPS positioning. In: VI Hotine-Marussi symposium of theoretical and computational geodesy: challenge and role of modern geodesy, 29 May–2 June, Wuhan University, China
Amiri-Simkooei AR (2007) Least-squares variance component estimation: theory and GPS applications, Ph.D. thesis, Delft University of Technology, Publication on Geodesy, 64, Netherlands Geodetic Commission, Delft
Amiri-Simkooei AR, Tiberius CCJM (2007) Assessing receiver noise using GPS short baseline time series. GPS Solutions 11(1):21–35
Amiri-Simkooei AR, Tiberius CCJM, Teunissen PJG (2007) Assessment of noise in GPS coordinate time series: methodology and results. J Geophys Res (in press). doi:10.1029/2006JB004913
Baarda W (1973) S-Transformations and criterion matrices, Netherlands Geodetic Commission, Publ. on Geodesy, New Series, Vol. 5(1), Delft
Berkane M, Bentler PM (1986) Moments of elliptically distributed random variates. Statist Probab Lett 4:333–335
Bischoff W, Heck B, Howind J, Teusch A (2005) A procedure for testing the assumption of homoscedasticity in least squares residuals: a case study of GPS carrier-phase observations. J Geod 78:397–404
Bischoff W, Heck B, Howind J, Teusch A (2006) A procedure for estimating the variance function of linear models and for checking the appropriateness of estimated variances: a case study of GPS carrier-phase observations. J Geod 79(12):694–704
Bock Y (1998) Medium distance GPS measurements. In: Teunissen PJG, Kleusberg A (eds) GPS for geodesy, 2nd edn. Springer, Heidelberg
Bona P (2000) Precision, cross correlation, and time correlation of GPS phase and code observations. GPS Solutions 4(2):3–13
Brunner FK, Hartinger H, Troyer L (1999) GPS signal diffraction modelling: the stochastic SIGMA-Δ model. J Geod 73:259–267
Caspary WF (1987) Concepts of network and deformation analysis. school of surveying, The University of New South Wales, Kensington, pp 97–111
Chen YQ, Chrzanowski A, Kavouras M (1990) Assessment of observations using minimum norm quadratic unbiased estimation (MINQUE). CISM J ACSGS 44:39–46
Crocetto N, Gatti M, Russo P (2000) Simplified formulas for the BIQUE estimation of variance components in disjunctive observation groups. J Geod 73:173–179
Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman & Hall/CRC
Euler HJ, Goad C (1991) On optimal filtering of GPS dual frequency observations without using orbit information. Bull Geod 65:130–143
Fotopoulos G (2003) An analysis on the optimal combination of geoid, orthometric and ellipsoidal height data, PhD thesis, Department of Geomatics Engineering, University of Calgary, Alberta, Calgary
Fotopoulos G (2005) Calibration of geoid error models via a combined adjustment of ellipsoidal, orthometric and gravimetric geoid height data. J Geod 79(1–3):111–123
Gerdan GP (1995) A comparison of four methods of weighting double difference pseudo range measurements. Trans Tasman Surv 1(1):60–66
Gianniou M (1996) Genauigkeitssteigerung bei kurzzeit-statischen und kinematischen Satellitenmessungen bis hin zu Echtzeitanwendung. PhD-thesis, Deutsche Geodaetische Kommission, Reihe C, No. 458, Muenchen
Grafarend EW (1985) Variance–covariance component estimation: theoretical results and geodetic applications. Statist Decis Suppl 2:407–441
Gupta AK, Varga T (1993) Elliptically contoured models in statistics. Kluwer, Dordrecht
Hansen PC (1998) Rank-deficient and discrete Ill-posed problems: numerical aspects of linear inversion (Siam Monographs on Mathematical Modeling and Computation), Philadelphia
Harville DA (1977) Maximum likelihood approaches to variance component estimation and to related 2097 problems. J Am Statist Assoc 72:320–340
Jin XX, de Jong CD (1996) Relationship between satellite elevation and precision of GPS code observations. J Navig 49: 253–265
Jonkman NF (1997) Integer GPS-ambiguity estimation without the receiver-satellite geometry. MGP-Series, No. 18, Delft University of Technology
Kuhri AI, Mathew T, Sinha BK (1998) Statistical tests for mixed linear models. Wiley, New York
Koch KR (1978) Schätzung von varianzkomponenten. Allgemeine Vermessungs Nachrichten 85:264–269
Koch KR (1986) Maximum likelihood estimate of variance components. Bull Géod 60:329–338
Koch KR (1987) Bayesian inference for variance components. Manuscr Geod 12:309–313
Koch KR (1998) Parameter estimation and hypothesis testing in linear models. Springer, Berlin
Koch KR, Kusche J (2002) Regularization of geopotential determination from satellite data by variance components. J Geod 76:259–268
Kubik K (1970) The estimation of the weights of measured quantities within the method of least squares. Bull Géod 95:21–40
Kusche J (2003) Noise variance estimation and optimal weight determination for GOCE gravity recovery. Adv Geosci 1:81–85
Lawson CL, Hanson RJ (1974) Solving least-squares problems. Prentice-Hall, Series in Automatic Computation
Lucas JR, Dillinger WH (1998) MINQUE for block diagonal bordered systems such as those encountered in VLBI data analysis. J Geod 72:343–349
Magnus JR (1988) Linear structures. London School of Economics and Political Science, Charles Griffin & Company LTD, London, Oxford University Press, New York
Mao A, Harrison CGA, Dixon TH (1999) Noise in GPS coordinates time series. J Geophys Res 104:2797–2816
Maruyama Y, Seo T (2003) Estimation of moment parameters in elliptical distributions. J Japan Statist Soc 33(2):215–229
Myers RH (1986) Classical and modern regression with applications. Duxburry Press
Ou Z (1989) Estimation of variance and covariance components. Bull Géod 63:139–148
Ou Z (1991) Approximative Bayes estimation for variance components. Manuscr Geod 16:168–172
Patterson HD, Thompson R (1971) Recovery of inter-block information when block sizes are unequal. Biometrika 58
Radovanovic RS, El-Sheimy N, Teskey WF (2004) Variance-covariance modeling of atmospheric errors for satellite-based network positioning. J Inst Navig 51(2):161–170
Rao CR (1971) Estimation of variance and covariance components—MINQUE theory. J Multivar Anal 1:257–275
Rao CR, Mitra SK (1971) Generalized inverses of matrices and its applications. Wiley, New York
Rao CR, Kleffe J (1988) Estimation of variance components and applications, Vol. 3, North Holland, Series in Statistics and Probability
Rao CR, Toutenburg H (1995) Linear models: least squares and alternatives, Springer Series in Statistics
Rao PSRS (1997) Variance component estimation: mixed models, methodologies and applications. Chapman & Hall
Sahin M, Cross PA, Sellers PC (1992) Variance component estimation applied to satellite laser ranging. Bull Géod 66:284–295
Satirapod C, Wang J, Rizos C (2002) A simplified MINQUE procedure for estimation of variance–covariance components of GPS observables. Surv Rev 36(286):582–590
Schaffrin B, Bock Y (1988) A unified scheme for processing GPS dual-band observations. Bull Geod 62:142–160
Sjöberg LE (1983) Unbiased estimation of variance–covariance components in condition adjustment with unknowns—a MINQUE approach. ZfV 108(9):382–387
Sjöberg LE (1984) Non negative variance component estimation in the Gauss-Helmert adjustment model. Manuscr Geod 9:247–280
Teunissen PJG (1985) Generalized inverses, adjustment, the datum problem and S-transformations. In: Grafarend EW, Sanso F. (eds) Optimization and design of geodetic networks
Teunissen PJG (1988) Towards a least-squares framework for adjusting and testing of both functional and stochastic model. Geodetic Computing Centre, Delft, MGP Series No. 26, 2004 (Reprint 1988)
Teunissen PJG (1990) Nonlinear least-squares. Manus Geod 15(3):137–150
Teunissen PJG (1998) The ionosphere-weighted GPS baseline precision in canonical form. J Geod 72:107–117
Teunissen PJG, Jonkman NF, Tiberius CCJM (1998) Weighting GPS dual frequency observations: bearing the cross of cross-correlation. GPS Solutions 2(2):28–37
Teunissen PJG (2000) Adjustment theory: an introduction. Delft University Press, Delft University of Technology, Series on Mathematical Geodesy and Positioning
Teunissen PJG, Amiri-Simkooei AR (2006) Variance component estimation by the method of least-squares. In: VI Hotine-Marussi symposium of theoretical and computational geodesy: challenge and Role of Modern Geodesy 29 May–2 June, Wuhan University, China
Tiberius CCJM (1998) Recursive data processing for kinematic GPS surveying. Publications on Geodesy, No. 45 Netherlands Geodetic Commission, Delft, The Netherlands
Tiberius CCJM, Jonkman N, Kenselaar F (1999) The stochastics of GPS observables. GPS World Innon 10(2):49–54
Tiberius CCJM, Borre K (2000) Time series analysis of GPS observables. Proc. ION-GPS2000, 1885–1894
Tiberius CCJM, Kenselaar F (2000) Estimation of the stochastic model for GPS code and phase observables. Surv Rev 35(277): 441–454
Tiberius CCJM, Kenselaar F (2003) Variance component estimation and precise GPS positioning: case study. J Surv Eng 129(1):11–18
Wang J, Stewart MP, Sakiri M (1998) Stochastic modeling for static GPS baseline data processing. J Surv Eng 124(4):171–181
Wang J, Satirapod C, Rizos C (2002) Stochastic assessment of GPS carrier phase measurements for precise static relative positioning. J Geod 76(2):95–104
Wei WWS (1990) Time series analysis. Addison-Wesley, Redwood City
Williams SDP, Bock Y, Fang P, Jamason P, Nikolaidis RM, Miller M, Johnson DJ (2004) Error analysis of continuous GPS position time series. J Geophys Res 109:B03412
Yu Z (1992) A generalization theory of estimation of variance– covariance components. Manuscr Geod 17:295–301
Yu Z (1996) A universal formula of maximum likelihood estimation of variance-covariance components. J Geod 70:233–240
Zhang J, Bock Y, Johnson, Fang P, Williams S, Genrich J, Wdowinski S, Behr J (1997) Southern California permanent GPS geodetic array: error analysis of daily position estimates and site velocitties. J Geophys Res 102:18035–18055
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License ( https://creativecommons.org/licenses/by-nc/2.0 ), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Teunissen, P.J.G., Amiri-Simkooei, A.R. Least-squares variance component estimation. J Geod 82, 65–82 (2008). https://doi.org/10.1007/s00190-007-0157-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00190-007-0157-x