Image Denoising with Stochastic Differential Equations
Title: Image Denoising with Stochastic Differential Equations
DNr: Berzelius-2024-443
Project Type: LiU Berzelius
Principal Investigator: Ziwei Luo <ziwei.luo@it.uu.se>
Affiliation: Uppsala universitet
Duration: 2024-12-01 – 2025-06-01
Classification: 10207
Homepage: https://algolzw.github.io/
Keywords:

Abstract

The Wiener process is to add continuous Gaussian noises to a clean signal, which constructs the dispersion part of a Stochastic Differential Equation (SDE). In this project, we model the image noise-adding process as a conditional Wiener process where the noisy image is an intermediate state and the transition follows a simple SDE. Naturally, we can reverse the SDE to get the initial state image. Its drift function of the reverse-time SDE can be derived from the original forward SDE with an additional score function which can be approximated with a deep convolutional neural network (CNN). We would like to evaluate this approach on various of tasks like unconditional/conditional image generation, image restoration, and image translation. This project aims to breakthrough the current frameworks of image generation, leading to a better result in realistic image/signal restoration. This project has produced 5 top AI conference papers (at CVPR, ICML, ICLR, and NeurIPS) and all of these papers have acknowledged Berzelius, KAW, and NSC.