Title:	Research in retrieval augmented language modeling
DNr:	Berzelius-2022-3
Project Type:	LiU Berzelius
Principal Investigator:	Tobias Norlund <tobias.norlund@ai.se>
Affiliation:	Chalmers tekniska högskola
Duration:	2022-09-02 – 2023-04-01
Classification:	20206
Keywords:

Abstract

My PhD research topic is NLP and language modeling. I am currently pursuing a project in retrieval augmented language modeling, investigating methods for externalizing knowledge and memory that has the potential for several potential benefits, including interpretability, controlability as well as reduced cost of training by reducing model size.