DL4NLP: Deep Learning for Natural Language Processing
Title: DL4NLP: Deep Learning for Natural Language Processing
DNr: Berzelius-2022-202
Project Type: LiU Berzelius
Principal Investigator: Marco Kuhlmann <marco.kuhlmann@liu.se>
Affiliation: Linköpings universitet
Duration: 2022-10-01 – 2023-04-01
Classification: 10208
Homepage: https://www.ida.liu.se/divisions/aiics/nlp/
Keywords:

Abstract

The field of natural language processing (NLP) has enjoyed significant breakthroughs in the last few years with the development of deep neural language models such as BERT and GPT-3. When trained on large amounts of text data, these models are able to learn distributed representations of language meaning, which have been successfully used in a wide range of language understanding tasks. The NLP Group is currently working on three different research tasks related to deep neural language models: 1. interpreting pre-trained representations; 2. grounding these representations in non-linguistic modalities such as images and video; 3. connecting pre-trained representations to structured representations such as knowledge graphs.