In computer science, a predictive state representation (PSR) is a way to model a state of controlled dynamical system from a history of actions taken and resulting observations. PSR captures the state of a system as a vector of predictions for future tests (experiments) that can be done on the system.[1] A test is a sequence of action-observation pairs and its prediction is the probability of the test's observation-sequence happening if the test's action-sequence were to be executed on the system. One of the advantage of using PSR is that the predictions are directly related to observable quantities. This is in contrast to other models of dynamical systems, such as partially observable Markov decision processes (POMDPs) where the state of the system is represented as a probability distribution over unobserved nominal states.[2]
YouTube Encyclopedic
-
1/3Views:12 81111 8739 486
-
Model Predictive Control 5 - Prediction with state space models
-
System Dynamics and Control: Module 27b - Choosing State Variables
-
Model Predictive Control 6 - Prediction with state space models continued
Transcription
References
- ^ James, Michael R.; Singh, Satinder (2004). "Learning and discovery of predictive state representations in dynamical systems with reset". Twenty-first international conference on Machine learning - ICML '04. p. 53. CiteSeerX 10.1.1.67.5179. doi:10.1145/1015330.1015359. ISBN 978-1-58113-838-2. S2CID 9111832.
- ^ Izadi, Masoumeh T.; Precup, Doina (9 August 2003). "A planning algorithm for predictive state representations". Proceedings of the 18th International Joint Conference on Artificial Intelligence. Ijcai'03: 1520–1521.
- Littman, Michael L.; Richard S. Sutton; Satinder Singh (2002). "Predictive Representations of State" (PDF). Advances in Neural Information Processing Systems 14 (NIPS). pp. 1555–1561.
- Singh, Satinder; Michael R. James; Matthew R. Rudary (2004). "Predictive State Representations: A New Theory for Modeling Dynamical Systems" (PDF). Uncertainty in Artificial Intelligence: Proceedings of the Twentieth Conference (UAI). pp. 512–519.
- Wiewiora, Eric Walter (2008), Modeling Probability Distributions with Predictive State Representations (PDF)
 | This artificial intelligence-related article is a stub. You can help Wikipedia by expanding it. |
This page was last edited on 20 October 2021, at 13:09