In this survey, the authors examine the trade-off between the unbiased, optimal, and in-between solutions in finite impulse response (FIR) filtering. Specifically, they refer to linear discrete real-time invariant state-space models with zero mean noise sources having arbitrary covariances (not obligatorily delta shaped) and distributions (not obligatorily Gaussian). They systematically analyse the following batch filtering algorithms: unbiased FIR (UFIR) subject to the unbiasedness condition, optimal FIR (OFIR) which minimises the mean square error (MSE), OFIR with embedded unbiasedness (EU) which minimises the MSE subject to the unbiasedness constraint, and optimal UFIR (OUFIR) which minimises the MSE in the UFIR estimate. Based on extensive investigations of the polynomial and harmonic models, the authors show that the OFIR-EU and OUFIR filters have higher immunity against errors in the noise statistics and better robustness against temporary model uncertainties than the OFIR and Kalman filters.

References

1. 1)
  - 15. Kwon, W.H., Han, S.: ‘Receding horizon control: model predictive control for state models’ (Springer, London, UK, 2005).
2. 2)
  - 10. Simon, D.: ‘Optimal state estimation: Kalman, Hinf, and nonlinear approaches’ (John Wiley & Sons, Honboken, NJ, 2006).
3. 3)
  - 49. Lee, Y.S., Han, S.: ‘A minimum variance FIR filter with an N∞ error bound and its application to the current measuring circuitry’, Measurement, 2014, 50, pp. 115–120 (doi: 10.1016/j.measurement.2013.12.039).
4. 4)
  - 44. Simon, D., Shmaliy, Y.S.: ‘Unified forms for Kalman and finite impulse response filtering and smoothing’, Automatica, 2013, 49, (6), pp. 1892–1899 (doi: 10.1016/j.automatica.2013.02.026).
5. 5)
  - 39. Salmi, J., Richter, A., Koivunen, V.: ‘Detection and tracking of MIMO propagation path parameters using state-space approach’, IEEE Trans. Signal Process., 2009, 57, (4), pp. 1538–1550 (doi: 10.1109/TSP.2008.2011823).
6. 6)
  - 38. Ahn, C.K., Han, S., Kwon, W.H.: ‘H∞ FIR filters for linear continuous-time state-space systems’, IEEE Signal Process. Lett., 2006, 13, (9), pp. 557–560 (doi: 10.1109/LSP.2006.874448).
7. 7)
  - 2. Stark, H., Woods, J.W.: ‘Probability, random processes, and estimation theory for engineers’ (Prentice Hall, Upper Saddle River, NJ, 1994, 2nd edn.).
8. 8)
  - 1. Gauss, C.F.: ‘Theory of the combination of observations least subject to errors’ (SIAM Publication, Philadelphia, 1995), Translated by G. W. Stewart.
9. 9)
  - 24. Ahn, C.K.: ‘Strictly passive FIR filtering for state-space models with external disturbance’, Int. J. Electron. Commun., 2012, 66, (11), pp. 944–948 (doi: 10.1016/j.aeue.2012.04.002).
10. 10)
  - 34. Kou, Y., Jiao, Y., Xu, D., et al: ‘Low-cost precise measurement of oscillator frequency instability based on GNSS carrier observation’, Adv. Space Res., 2013, 51, (6), pp. 969–977 (doi: 10.1016/j.asr.2012.11.007).
11. 11)
  - 21. Kwon, W.H., Kim, P.S., Han, S.: ‘A receding horizon unbiased FIR filter for discrete-time state space models’, Automatica, 2002, 38, (3), pp. 545–551 (doi: 10.1016/S0005-1098(01)00242-4).
12. 12)
  - 29. Liu, D., Liu, X.: ‘Optimal state estimation without the requirement of a priori statistics information of the initial state’, IEEE Trans. Autom. Control, 1994, 39, (10), pp. 2087–2091 (doi: 10.1109/9.328818).
13. 13)
  - 20. Kwon, W.H., Kim, P.S., Park, P.: ‘A receding horizon Kalman FIR filter for discrete time-invariant systems’, IEEE Trans. Autom. Control, 1999, 99, (9), pp. 1787–1791 (doi: 10.1109/9.788554).
14. 14)
  - 4. Aitken, A.C.: ‘On least squares and linear combinations of observations’. Proc. of the Royal Society of Edinburgh, 1935, vol. 55, pp. 42–48.
15. 15)
  - 45. Echeverria, F.R., Sarr, A., Shmaliy, Y.S.: ‘Optimal memory for discrete-time FIR filters in state-space’, IEEE Trans. Signal Process., 2014, 62, pp. 557–561 (doi: 10.1109/TSP.2013.2290504).
16. 16)
  - 18. Zhang, S., Wang, Z., Ding, D., et al.: ‘On design of robust fault detection filter in finite-frequency domain with regional pole assignment’, IEEE Trans. Circuits Syst. II, 2015, 62, (4), pp. 382–386 (doi: 10.1109/TCSII.2014.2387684).
17. 17)
  - 46. Zhao, S., Shmaliy, Y.S., Liu, F.: ‘Fast computation of discrete optimal FIR estimates in white Gaussian noise’, IEEE Signal Process. Lett., 2015, 22, (6), pp. 718–722 (doi: 10.1109/LSP.2014.2368777).
18. 18)
  - 23. Shmaliy, Y.S.: ‘Optimal gains of FIR estimations for a class of discrete-time state-space models’, IEEE Trans. Signal Process. Lett., 2008, 15, pp. 517–520 (doi: 10.1109/LSP.2008.925746).
19. 19)
  - 17. Dong, H., Wang, Z., Ding, S.X., et al.: ‘Event-based H∞ filter design for a class of nonlinear time-varying systems with fading channels and multiplicative noises’, IEEE Trans. Signal Process., 2015, 63, (13), pp. 3387–3395 (doi: 10.1109/TSP.2015.2422676).
20. 20)
  - 9. Hardy, M.: ‘An illuminating counterexample’, Am. Math. Mon., 2003, 110, (3), pp. 232–238 (doi: 10.2307/3647938).
21. 21)
  - 32. Iwata, T., Imae, M., Suzuyama, T., et al: ‘Simulation and ground experiments of remote synchronization system for on-board crystal oscillator of quazi-zenith satellite system’, J. Inst. Navig., 2006, 53, pp. 231–235 (doi: 10.1002/j.2161-4296.2006.tb00385.x).
22. 22)
  - 42. Shmaliy, Y.S.: ‘Unbiased FIR filtering of discrete-time polynomial state-space models’, IEEE Trans. Signal Process., 2009, 57, (4), pp. 1241–1249 (doi: 10.1109/TSP.2008.2010640).
23. 23)
  - 40. Nevat, I., Yuan, J.: ‘Joint channel tracking and decoding for BICM-OFDM systems using consistency test and adaptive detection selection’, IEEE Trans. Veh. Technol., 2009, 58, (8), pp. 4316–4328 (doi: 10.1109/TVT.2009.2018548).
24. 24)
  - 30. Ling, K.V., Lim, K.W.: ‘Receding horizon recursive state estimation’, IEEE Trans. Autom. Control, 1999, 44, (9), pp. 1750–1753 (doi: 10.1109/9.788546).
25. 25)
  - 16. Shmaliy, Y.S.: ‘Linear optimal FIR estimation of discrete time-invariant state-space models’, IEEE Trans. Signal Process., 2010, 58, (6), pp. 3086–3096 (doi: 10.1109/TSP.2010.2045422).
26. 26)
  - 27. Shmaliy, Y.S., Mendoza, L.J.M.: ‘FIR smoothing of discrete-time polynomial signals in state space’, IEEE Trans. Signal Process., 2010, 58, (5), pp. 2544–2555 (doi: 10.1109/TSP.2010.2041595).
27. 27)
  - 41. Shmaliy, Y.S., Manzano, O.I.: ‘Time-variant linear optimal finite impulse response estimator for discrete state-space models’, Int. J. Adapt. Control Signal Process., 2012, 26, (2), pp. 95–104 (doi: 10.1002/acs.1274).
28. 28)
  - 22. Shmaliy, Y.S.: ‘An iterative Kalman-like algorithm ignoring noise and initial conditions’, IEEE Trans. Signal Process., 2011, 59, (6), pp. 2465–2473 (doi: 10.1109/TSP.2011.2129516).
29. 29)
  - 26. Mirkin, L.: ‘On the H1 fixed-lag smoothing: how to exploit the information preview’, Automatica, 2003, 39, (8), pp. 1495–1504 (doi: 10.1016/S0005-1098(03)00141-9).
30. 30)
  - 18. Jazwinski, A.H.: ‘Limited memory optimal filtering’, IEEE Trans. Autom. Control, 1968, 13, (10), pp. 558–563 (doi: 10.1109/TAC.1968.1098981).
31. 31)
  - 19. Kwon, O.K., Kwon, W.H., Lee, K.S.: ‘FIR filters and recursive forms for discrete-time state-space models’, Automatica, 1989, 25, (5), pp. 715–728 (doi: 10.1016/0005-1098(89)90027-7).
32. 32)
  - 5. Kay, S.M.: ‘Fundamentals of statistical signal processing’ (Prentice Hall, New York, 2001).
33. 33)
  - 35. Choi, J.-W., Han, S., Cioffi, J.M.: ‘An FIR channel estimation filter with robustness to channel mismatch condition’, IEEE Trans. Broadcast., 2008, 54, (1), pp. 127–130 (doi: 10.1109/TBC.2007.914658).
34. 34)
  - 33. Levine, J.: ‘Invited review article: the statistical modeling of atomic clocks and the design of time scales’, Rev. Sci. Instrum., 2012, 83, (2), p. 021101 (doi: 10.1063/1.3681448).
35. 35)
  - 8. Gibbs, B.P.: ‘Advanced Kalman filtering, least-squares and modeling’ (John Wiley & Sons, Hoboken, NJ, 2011).
36. 36)
  - 51. Shmaliy, Y.S., Simon, D.: ‘Iterative unbiased FIR state estimation: a review of algorithms’, EURASIP J. Adv. Signal Process., 2013, 113, (1), pp. 1–16.
37. 37)
  - 47. Zhao, S., Shmaliy, Y.S., Liu, F., et al: ‘Effect of embedded unbiasedness on discrete-time optimal FIR filtering estimates’, EURASIP J. Adv. Signal Process., 2015, 2015, (1), pp. 1–13 (doi: 10.1186/s13634-015-0268-0).
38. 38)
  - 48. Zhao, S., Shmaliy, Y.S., Huang, B., et al: ‘Minimum variance unbiased FIR filter for discrete time-variant models’, Automatica, 2015, 53, pp. 355–361 (doi: 10.1016/j.automatica.2015.01.022).
39. 39)
  - 14. Jazwinski, A.H.: ‘Stochastic processes and filtering theory’ (Academic, New York, 1970).
40. 40)
  - 3. Stapleton, J.H.: ‘Linear statistical models’ (Wiley, New York, 2009, 2nd edn.).
41. 41)
  - 28. Kwon, B.K., Han, S., Kim, O.K., et al: ‘Minimum variance FIR smoothers for discrete-time state space models’, IEEE Trans. Signal Process. Lett., 2007, 14, (8), pp. 557–560 (doi: 10.1109/LSP.2007.891840).
42. 42)
  - 28. Liu, Q., Wang, Z., He, X., et al: ‘Event-based recursive distributed filtering over wireless sensor networks’, IEEE Trans. Autom. Control, 2015, 60, (9), pp. 2470–2475 (doi: 10.1109/TAC.2015.2390554).
43. 43)
  - 31. Makhoul, J.: ‘Linear prediction: a tutorial review’, Proc. IEEE, 1975, 63, pp. 561–580 (doi: 10.1109/PROC.1975.9792).
44. 44)
  - 10. Ding, D.R., Wang, Z.D., Shen, B., Dong, H.L.: ‘Envelope-constrained H∞ filtering with fading measurements and randomly occurring nonlinearities: the finite horizon case’, Automatica, 2015, 55, (ISSN 0005-1098), pp. 37–45 (doi: 10.1016/j.automatica.2015.02.024).
45. 45)
  - 28. Dong, H., Wang, Z., Ding, S.X., Gao, H.: ‘Finite-horizon estimation of randomly occurring faults for a class of nonlinear time-varying systems’, Automatica, 2014, 50, (12), pp. 3182–3189 (doi: 10.1016/j.automatica.2014.10.026).
46. 46)
  - 7. Shmaliy, Y.S.: ‘An unbiased FIR filter for TIE model of a local clock in applications to GPS-based timekeeping’, IEEE Trans. Ultrason. Ferroelectr. Freq. Control, 2006, 53, (5), pp. 862–870 (doi: 10.1109/TUFFC.2006.1632677).
47. 47)
  - 43. Shmaliy, Y.S.: ‘Suboptimal FIR filtering of nonlinear models in additive white Gaussian noise’, IEEE Trans. Signal Process., 2012, 60, (10), pp. 5519–5527 (doi: 10.1109/TSP.2012.2205569).
48. 48)
  - 6. Kim, P.S., Lee, M.E.: ‘A new FIR filter for state estimation and its applications’, J. Comput. Sci. Technol., 2007, 22, (5), pp. 779–784 (doi: 10.1007/s11390-007-9085-8).
49. 49)
  - 25. Ahn, C.K., Kim, P.S.: ‘Fixed-lag maximum likelihood FIR smoother for state-space models’, IEICE Electron. Express, 2008, 5, (1), pp. 11–16 (doi: 10.1587/elex.5.11).
50. 50)
  - 50. Kim, P.S.: ‘An alternative FIR filter for state estimation in discrete-time systems’, Digit. Signal Process., 2010, 20, (3), pp. 935–943 (doi: 10.1016/j.dsp.2009.10.033).
51. 51)
  - 17. Johnson, K.R.: ‘Optimum, linear, discrete filtering of signals containing a nonrandom component’, IRE Trans. Inf. Theory, 1956, 2, (2), pp. 49–55 (doi: 10.1109/TIT.1956.1056784).

Unbiased, optimal, and in-betweens: the trade-off in discrete finite impulse response filtering

References

Related content