Research in retrieval augmented language modeling
Title: |
Research in retrieval augmented language modeling |
DNr: |
Berzelius-2023-64 |
Project Type: |
LiU Berzelius |
Principal Investigator: |
Tobias Norlund <tobiasno@chalmers.se> |
Affiliation: |
Chalmers tekniska högskola |
Duration: |
2023-04-01 – 2023-10-01 |
Classification: |
20206 |
Keywords: |
|
Abstract
My PhD research topic is NLP and language modeling. I am currently pursuing a project in retrieval augmented language modeling, investigating methods for externalizing knowledge and memory that has the potential for several potential benefits, including interpretability, controlability as well as reduced cost of training by reducing model size.