Sequential Inference for Latent Force Models

arXiv (Cornell University)Published 14 February 2012Open access

Jouni Hartikainen, Simo Särkkä

DOI10.48550/arxiv.1202.3730

Citations16

Abstract

Latent force models (LFMs) are hybrid models combining mechanistic principles with non-parametric components. In this article, we shall show how LFMs can be equivalently formulated and solved using the state variable approach. We shall also show how the Gaussian process prior used in LFMs can be equivalently formulated as a linear statespace model driven by a white noise process and how inference on the resulting model can be efficiently implemented using Kalman filter and smoother. Then we shall show how the recently proposed switching LFM can be reformulated using the state variable approach, and how we can construct a probabilistic model for the switches by formulating a similar switching LFM as a switching linear dynamic system (SLDS). We illustrate the performance of the proposed methodology in simulated scenarios and apply it to inferring the switching points in GPS data collected from car movement data in urban environment.

Keywords

Computer Science

Kalman Filtering: Theory and Practice Using MATLAB

2,140 Citations2001Mohinder S. Grewal, Angus P. Andrews

Kalman Filtering: Theory and Practice Using MATLAB, Fourth Edition is an ideal textbook in advanced undergraduate and beginning graduate courses in stochastic processes and Kalman filtering and appropriate for self-instruction or review by practicing engineers and scientists who want to learn more about this important topic.

Kalman filtering and smoothing solutions to temporal Gaussian process regression models

215 Citations2010Jouni Hartikainen, Simo Särkkä

This paper shows how temporal Gaussian process regression models in machine learning can be reformulated as linear-Gaussian state space models, which can be solved exactly with classical Kalman filtering theory, and produces an efficient non-parametric learning algorithm.

Sparse Convolved Gaussian Processes for Multi-output Regression

176 Citations2008Mauricio A. Álvarez, Neil D. Lawrence

Latent Force Models

117 Citations2009Mauricio A. Álvarez, David Luengo +1 more

It is shown how dierent, physically-inspired, kernel functions can be developed through sensible, simple, mechanistic assumptions about the underlying system through a hybrid approach using Gaussian processes and dierential equations to combine data driven modelling with a physical model of the system.

IEEE Transactions on Automatic ControlOn Gaussian Optimal Smoothing of Non-Linear State Space Models

109 Citations2010Simo Särkkä, Jouni Hartikainen

A new Gaussian approximation based framework for approximate optimal smoothing of non-linear stochastic state space models and accuracies of approximations, which are based on Taylor series expansion, unscented transformation, central differences and Gauss-Hermite quadrature are presented.

Expectation Correction for Smoothed Inference in Switching Linear Dynamical Systems

89 Citations2006David Barber

MPG.PuRe (Max Planck Society)Switched Latent Force Models for Movement Segmentation

35 Citations2010Mauricio A. Álvarez, Jan Peters +2 more

This paper introduces an extension of the basic latent force model, that switches between different latent functions and potentially different dynamical systems, that creates a versatile representation for robot movements that can capture discrete changes and non-linearities in the dynamics.

View PDF