Abstract
Ensemble size is critical to the efficiency and performance of the ensemble Kalman filter, but when the ensemble size is small, the Kalman gain generally cannot be well estimated. To reduce the negative effect of spurious correlations, a regularization process applied on either the covariance or the Kalman gain seems to be necessary. In this paper, we evaluate and compare the estimation errors when two regularization methods including the distance-dependent localization and the bootstrap-based screening are applied on the covariance and on the Kalman gain. The investigations were carried out through two examples: 1D linear problem without dynamics but for which the true Kalman gain can be computed and a 2D highly nonlinear reservoir fluid flow problem. The investigation resulted in three primary conclusions. First, if localizations of two covariance matrices are not consistent, the estimate of the Kalman gain will generally be poor at the observation location. The consistency condition can be difficult to apply for nonlocal observations. Second, the estimate of the Kalman gain that results from covariance regularization is generally subject to greater errors than the estimate of the Kalman gain that results from Kalman gain regularization. Third, in terms of removing spurious correlations in the estimation of spatially correlated variables, the performance of screening Kalman gain is comparable as the performance of localization methods (applied on either covariance or Kalman gain), but screening Kalman gain outperforms the localization methods in terms of generality for application, as the screening method can be used for estimating both spatially correlated and uncorrelated variables, and moreover, no assumption about the prior covariance is required for the screening method.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Agbalaka, C.C., Oliver, D.S.: Application of the EnKF and localization to automatic history matching of facies distribution and production data. Math. Geosci. 40(4), 353–374 (2008)
Anderson, J.L.: Exploring the need for localization in ensemble data assimilation using a hierarchical ensemble filter. Phys. Nonlinear Phenom. 230(1–2), 99–111 (2007)
Bergemann, K., Reich, S.: A localization technique for ensemble Kalman filters. Q. J. R. Meteorol. Soc. 136(648, Part A), 701–707 (2010). doi:10.1002/qj.591
Chen, Y., Oliver, D.: Cross-covariances and localization for EnKF in multiphase flow data assimilation. Comput. Geosci. 14, 579–601 (2010). doi:10.1007/s10596-009-9174-6
Chen, Y., Oliver, D.S.: Ensemble-based closed-loop optimization applied to Brugge Field. SPE Reserv. Evalu. Eng. 13(1), 56–71 (2010). doi:10.2118/118926-PA
Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap, 1st edn. Chapman & Hall/CRC, Boca Raton (1993)
Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res. 99(C5), 10, 143–10, 162 (1994)
Evensen, G., Hove, J., Meisingset, H.C., Reiso, E., Seim, K.S., Espelid, Ø.: Using the EnKF for assisted history matching of a North Sea reservoir model (SPE 106184). In: Proceedings of the 2007 SPE Reservoir Simulation Symposium (2007)
Fertig, E.J., Hunt, B.R., Ott, E., Szunyogh, I.: Assimilating non-local observations with a local ensemble Kalman filter. Tellus A 59(5), 719–730 (2007). doi:10.1111/j.1600-0870.2007.00260.x
Furrer, R., Bengtsson, T.: Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants. J. Multivar. Anal. 98(2), 227–255 (2007). doi:10.1016/j.jmva.2006.08.003
Gu, Y., Oliver, D.S.: History matching of the PUNQ-S3 reservoir model using the ensemble Kalman filter. SPE J. 10(2), 51–65 (2005). doi:10.2118/89942-PA
Hamill, T.M., Whitaker, J.S., Snyder, C.: Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Weather Rev. 129(11), 2776–2790 (2001)
Haugen, V., Naevdal, G., Natvik, L.J., Evensen, G., Berg, A.M., Flornes, K.M.: History matching using the ensemble Kalman filter on a North Sea field case. SPE J. 13(4), 382–391 (2008)
Houtekamer, P.L., Mitchell, H.L.: Data assimilation using an ensemble Kalman filter technique. Mon. Weather Rev. 126(3), 796–811 (1998)
Houtekamer, P.L., Mitchell, H.L.: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Weather Rev. 129(1), 123–137 (2001)
Houtekamer, P.L., Mitchell, H.L., Pellerin, G., Buehner, M., Charron, M., Spacek, L., Hansen, B.: Atmospheric data assimilation with an ensemble Kalman filter: results with real observations. Mon. Weather Rev. 133(3), 604–620 (2005)
Lorenc, A.C.: The potential of the ensemble Kalman filter for NWP—a comparison with 4D-Var. Q. J. R. Meteorol. Soc. 129(595), 3183–3203 (2003)
Nævdal, G., Johnsen, L.M., Aanonsen, S.I., Vefring, E.H.: Reservoir monitoring and continuous model updating using ensemble Kalman filter. SPE J. 10(1), 66–74 (2005). doi:10.2118/84372-PA
Schlumberger (2006) Eclipse Technical and Reference Manual. Schlumberger, Abingdon
Zhang, Y., Oliver, D.S.: History matching using a multiscale stochastic model with the ensemble Kalman filter: a field case study. SPE J. (2010). doi:10.2118/118879-PA
Zhang, Y., Oliver, D.S.: Improving the ensemble estimate of the Kalman gain by bootstrap sampling. Math. Geosci. 42(3), 327–345 (2010). doi:10.1007/s11004-010-9267-8
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Zhang, Y., Oliver, D.S. Evaluation and error analysis: Kalman gain regularization versus covariance regularization. Comput Geosci 15, 489–508 (2011). https://doi.org/10.1007/s10596-010-9218-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10596-010-9218-y