DL4NLP: Deep Learning for Natural Language Processing
Title: |
DL4NLP: Deep Learning for Natural Language Processing |
DNr: |
Berzelius-2022-202 |
Project Type: |
LiU Berzelius |
Principal Investigator: |
Marco Kuhlmann <marco.kuhlmann@liu.se> |
Affiliation: |
Linköpings universitet |
Duration: |
2022-10-01 – 2023-04-01 |
Classification: |
10208 |
Homepage: |
https://www.ida.liu.se/divisions/aiics/nlp/ |
Keywords: |
|
Abstract
The field of natural language processing (NLP) has enjoyed significant breakthroughs in the last few years with the development of deep neural language models such as BERT and GPT-3. When trained on large amounts of text data, these models are able to learn distributed representations of language meaning, which have been successfully used in a wide range of language understanding tasks.
The NLP Group is currently working on three different research tasks related to deep neural language models: 1. interpreting pre-trained representations; 2. grounding these representations in non-linguistic modalities such as images and video; 3. connecting pre-trained representations to structured representations such as knowledge graphs.