Multimodal motion prediction and Interpretability in automotive scenes
Title: Multimodal motion prediction and Interpretability in automotive scenes
SNIC Project: Berzelius-2022-89
Project Type: LiU Berzelius
Principal Investigator: Joakim Johnander <>
Affiliation: Linköpings universitet
Duration: 2022-04-07 – 2022-11-01
Classification: 10207


A key in automotive applications is the ability to predict the future. This ability is necessary step for planning as it enables an autonomous vehicle to gauge the value of an action based on how the future evolves as the action is executed. This project focuses on predicting trajectories for other road users. One challenge is that the future is inherently stochastic. More specifically, these trajectories often exhibits multiple modes. As an example, consider a vehicle entering an intersection. The vehicle has multiple options and until the vehicle uses indicators or begins to turn, it cannot be known where it will exit the intersection. The aim of this project is to investigate how this uncertainty is best modelled in the context of a deep neural network making predictions about the future. The choice of modelling may have major effects on the stability during training and final performance. Furthermore, as a second direction, this research project aims to improve the explainability of the deep neural network. Predictions made in these scenarios are often highly explainable. For instance, consider the scenario of a pedestrian about to cross the road. Other vehicles tend to slow down and give way to the pedestrian. A neural network trained to predict future trajectories would likely capture this behaviour, however, it remains challenging to actually extract the explanation from the neural network. Such explanations are the secondary aim of this project. This project is part of the Eye for AI initiative. Two international researchers visiting Sweden for 6 months will be part of the project. The aim is one or two papers based on the results.