Recursive Bayesian estimation
You don't need to be Editor-In-Chief to add or edit content to WikiDoc. You can begin to add to or edit text on this WikiDoc page by clicking on the edit button at the top of this page. Next enter or edit the information that you would like to appear here. Once you are done editing, scroll down and click the Save page button at the bottom of the page.
| It has been suggested that this article or section be merged with Sequential_bayesian_filtering. (Discuss) |
Recursive Bayesian estimation is a general probabilistic approach for estimating an unknown probability density function recursively over time using incoming measurements and a mathematical process model.
Model
The true state is assumed to be an unobserved Markov process, and the measurements are the observed states of a Hidden Markov Model (HMM).
Because of the Markov assumption, the true state is conditionally independent of all earlier states given the immediately previous state.
Similarly the measurement at the kth timestep is dependent only upon the current state and is conditionally independent of all other states given the current state.
Using these assumptions the probability distribution over all states of the HMM can be written simply as:
However, when using the Kalman filter to estimate the state x, the probability distribution of interest is associated with the current states conditioned on the measurements up to the current timestep. (This is achieved by marginalising out the previous states and dividing by the probability of the measurement set.)
This leads to the predict and update steps of the Kalman filter written probabilistically. The probability distribution associated with the predicted state is product of the probability distribution associated with the transition from the (k - 1) th timestep to the kth and the probability distribution associated with the previous state, with the true state at (k - 1) integrated out.
The measurement set up to time t is
The probability distribution of updated is proportional to the product of the measurement likelihood and the predicted state.
The denominator
is a less significant normalisation term.
Applications
- Kalman filter, a recursive Bayesian filter for multivariate normal distributions
- Particle filter, a sequential Monte Carlo (SMC) based technique, which models the PDF using a set of discrete points
- Grid-based estimators, which subdivide the PDF into a discrete grid
External links
- On sequential Monte Carlo sampling methods for Bayesian filtering, Statistics and Computing (2000)
- A Tutorial on Particle Filters for On-line Non-linear/Non-Gaussian Bayesian Tracking, IEEE Transactions on Signal Processing (2001)
- Special Issue on Sequential State Estimation - Proceedings of the IEEE (Mar 2004)
Acknowledgement and Attribution Regarding Sources of Content
Some of the initial content on this page may be incorporated in part from copyleft sources in the public domain including wikis such as Wikipedia and AskDrWiki. Drug information for patients came from the The National Library of Medicine. Infectious disease information may have come from the Centers for Disease Control (CDC). Differential Diagnoses are drawn from clinicians as well as an amalgamation of 3 sources: 1.The Disease Database; 2. Kahan, Scott, Smith, Ellen G. In A Page: Signs and Symptoms. Malden, Massachusetts: Blackwell Publishing, 2004:3; 3. Sailer, Christian, Wasner, Susanne. Differential Diagnosis Pocket. Hermosa Beach, CA: Borm Bruckmeir Publishing LLC, 2002:7 .
