1. Home
  2. ⧑ Industrial Control Group
  3. About orthogonal projection theorem for Kalman filtering

About orthogonal projection theorem for Kalman filtering

In Kalman filtering, the minimum variance estimator can be found by orthogonal projection of X(k) on the space spanned by linear combinations of observations Y(0), Y(1),...Y(k).

Is this estimator unbiased? How to show, if it is?

Because if I were to look at the best estimator from another way, e.g. a conditional expectation approach i.e. minimum variance estimator = E{X(k)|Y(0), Y(1),...Y(k)}, then taking expectation on both sides, I can show that the estimator is unbiased. What about in the orthogonal projection case?

Please advise. Thanks!

Regards

Reply to
Beihai
Loading thread data ...

Kalman filters are usually only described in detail, in DSP algorithms, in my experience. If you find a good, detailed reference on Kalman filters, that is not deeply embedded in DSP mathematics and techniques, please let me know.

I prefer Kalman Filters (implemented with algebra) but, I'm still looking for that detailed, simplistic reference.

James

Reply to
James

For a linear system excited by white Gaussian noise, the optimal estimator is the linear system that gives the minimum variance. The solution is unique -- while the implementation may differ there is no other optimal solution that doesn't give exactly the same results.

The Kalman filter in this case is that linear system (it's time-varying, but it's linear).

So I think it's safe to say that the estimate is unbiased.

Reply to
Tim Wescott

What do you mean by DSP? (dynamic stochastic programming?).

An old "favourite" reference is the book:

Jazwinski AH (1970) Stochastic Processes and Filtering Theory. Academic Press

A more recent thing, more embedded in a statistical time-series background is :

Harvey AC (1989) Forecasting, structural time series models and the Kalman filter. Cambridge University Press

David Jones

Reply to
David Jones

I think he means Digital Signal Processing (DSP)

beihai

Reply to
Beihai

PolyTech Forum website is not affiliated with any of the manufacturers or service providers discussed here. All logos and trade names are the property of their respective owners.