Research Overview
Video explaining 5 years of research in the Spinoza-projects “Understanding Language
by Machines“, 2019
Video explaining NewsReader‘s Reading Machine — Example of one of CLTL’s projects Lecture
(in Dutch) Prof. dr. Piek Vossen at Paradiso Amsterdam: ‘To Communicate with an Imperfect
Robot — Get It?’ March 25, 2018
Our research not only targets Dutch and English as a language but also other languages in the world. An important project is the Global Wordnet Association and the building of the Global Wordnet Grid: this project aims at representing many vocabularies of languages as semantic networks or wordnets and combining them through a universal index of meaning. Building and studying this grid will tell us more about universalities and idiosyncrasies of languages and likewise about the roles and functions of words and expressions.
We see language as a reference system that connects people and systems to their perception of the world. Identity, reference and perspectives are central themes in our research and are studied in combination. In our research on conversational Robots, many of our ideas come together: http://makerobotstalk.nl In this project, we try to build robots that communicate with people in real-world situations taking perception of the contexts into account and shared common ground.
- General Information
- Topics focusing on Natural Language Processing
- Topics focusing on Linguistics and Language Resources
- Topics focusing on Knowledge Representation and Reasoning
- Topics focusing on Digital Humanities (and Social Sciences)
General
CLTL is the Computational Lexicology and Terminology Lab, headed by Piek Vossen. We study computational linguistics or natural language processing (NLP). We are interested in how language works and how we can analyse it using computers. We work on automatically getting knowledge from text. This is becoming more and more popular, as all the large technology companies (e.g. Google, IBM, Microsoft and Facebook) are investing in big data and language technology. At the same time, natural language processing is one of the core aspects of digital humanities research. We are collaborating with literature, history and social science researchers to explore the potential of NLP tools in their line of work, automatically analysing thousands of documents.Just imagine what you can do with all that data!
Computational Linguistics operates on the interface between computer science and linguistics. We have topics that require different levels of technical skill as well as different levels of linguistic knowledge. Feel free to come and have a chat if any of the topics below seem appealing to you.
Topics focusing on Natural Language Processing
How does automatic text analysis work? Which tools are available and what can they do? Do they deliver what they promise on new text? Can the results of the state-of-the-art be replicated? How can existing technology be improved?
We work on several technologies that can be adapted for a domain or Dutch, or simply tested and improved. Topics with NLP focus are mainly interesting for people with a strong technical background and programming skills, but it is also possible to study the outcome of tools and analyze what mistakes they make and why.
- Provide Dutch language support to TermSuite (http://termsuite.github.io/). Termsuite is an open source term extraction tool that is very useful if you want to extract keywords from a text. It supports multiple languages, but so far there is no support for Dutch yet. We do have all the resources that are necessary to add Dutch language support, but they need a little tweaking.
- Improve the state-of-the-art for Dutch language technology. At the 25th edition of the Computational Linguistics In the Netherlands (CLIN) conference, we ran the first shared task for Dutch, where several teams of computational linguists tried to see which tools are the best at annotating texts. Next year there will be another shared task. Could you win the competition?
- Event recognition and relations between events What happened? What caused this? Which events make up the story that is told in news or other data? Our group develops state-of-the-art software for event recognition and disambiguation. Possible topics include:
- Search for stories in a large structured database of events extracted from text.
- In what ways do different sources refer to the same event? What variations can be observed?
- Event extraction from large data repository: being able to identify what happened (and who are the participants) is not an easy task. Supervised methods have provided good results but also show limits. This project aims at investigating unsupervised methods for event extraction and classification (the types of events) using unsupervised or semi-supervised methods.
- Temporal Relation Processing: being able to anchor and order in time events (and their participants) is the first step developing more robust NLP systems for information extraction, question answering, and summarisation, among others. The goal of this project is to develop systems which are able to anchor and order events in time, thus providing the users with what is called a timeline of events. Different datasets are available both for single document and cross-document temporal processing, and in different domains (news and clinical data). Extensions to existing annotated data are encouraged as strategies to overcome current limits of current state-of-the art systems.
- Storyline Extraction: this project aims at extracting stories from large collections of news clustered per topic and spanning over a time period. The main research questions are: 1) are there patterns in which news stories about an event are reported? (e.g. is there a narrative pattern to report on natural disasters? is the way natural distress are reported different from man-made disasters?); 2) in which ways are events connected together so as to form a coherent story?; 3) given a collection of documents on a certain topic and spanning over a period of time, how can we identify the most important events or rank events with respect to their salience?
- Content Types Extraction: different types of information is expressed in a document. For instance, in a news article you can find both portions of the document reporting on things that happened (i.e. a narration) and opinions and comments (i.e. argumentations). The goal of this project is to develop systems which can detect the content types expressed in documents, such as novels (fictional and non-fictional), news articles, and other text genres, and then use this information to improve the performance of NLP for high-level semantic tasks (e.g. temporal relation extraction, sentiment analysis, entity typing, among others).
- Sentiment analysis What opinions do people have and how do they express them? How does this change from one domain (e.g. hotel reviews) to another (e.g. news articles)? See also the more detailed description under topics focusing on linguistics and language resources.
- (Domain-specific) Entity Linking Which entities (people, organisations, locations, etc.) are mentioned in text? Are they popular enough to be described in Wikipedia? If not, can we build a profile based on the information from text? What knowledge is needed to link these entities to their representation on Wikipedia (or other knowledge base) correctly? Does the type of knowledge vary per topic and time? How to acquire knowledge in a given domain, e.g. historical texts?
Topics focusing on Linguistics and Language Resources
How does language work and how can we model it in such a way that a computer can work with it? But also: what does computational linguistics have to offer to linguists (verifying theories through implementation or corpus study).
Topics in this area are interesting for both people with strong linguistic background as well as people who like to build interfaces and resources.
- Open Source Wordnet. we are building a wordnet database for Dutch that is open source and can be downloaded for free. A wordnet is a semantic network with all the words of a language connected through semantic relations. This database is derived from various sources. Each wordnet groups word meanings in different ways and the open source wordnet combines structures of both the English and the original Dutch wordnet. We need help from students to study the existing wordnet structures in English and Dutch and to evaluate the fit of the open source wordnet to both.
- A Dutch FrameNet: our group built the Referentie Bestand Nederlands (RBN). It has rich information about the combinatorics of words in particular meanings. For example “behandelen” can refer to social interaction or medical treatment. Only in the latter meaning we say “behandelen aan iets”. The combinatorics in RBN are represented in various ways. At this very moment, our group is building a Dutch Frame Net, in cooperation with Groningen University. We can think of many possibilities for theses on this project. One of them is finding out how the RBN-entries match the FrameNet structure that was developed for English at Berkeley and how well FrameNet can be mapped to our Dutch words and meanings.
- Sentiment analysis: we develop software to do automatic sentiment analysis of text in English, Dutch and German. Sentiment analysis is done at a topic level. That means, we extract the opinion holder, the opinion expression and the target of the opinion. This technology is tested in various domains: tourism, politics, product reviews, news. Deeper sentiment analysis can be used to find opinions and positions of individuals but also for groups of people. Students can work on various aspects:
- Annotation of opinionated text, how detailed can opinions be described consistently by humans and how well do computers learn from this annotation?
- Can sentiment and opinion analysis be used to obtain information on overall opinions and positions of groups in society or can it be used to track changes over time?
- Are sentiments expressed differently across genres and what is the impact of genre on sentiment analysis systems?
- What is the quality of current sentiment lexica? What can they do and where do they fail?
Topics focusing on Knowledge Representation and Reasoning
We have various projects where we mine text, extract information and represent this formally using RDF. This allows us to link information extracted from text to other resources and it allows end-users to query the data we extract. Research related to these topics involve ontology design and evaluation as well as evaluating and improving the results of our NLP analyses.
These topics are mainly interesting for students with some background in data representation. Topics with a higher or lower technical component can be found.
Research topics in this area include:
- Ontology design: what definitions are needed to represent relevant information? How well do the ontologies we currently use work? What can they do and what not?
- Data analysis of the output of NLP analyses:
- What patterns do you observe in the data? E.g. which events occur with the same entities? What stories can be found in the data?
- What is the quality of the extracted data? What are common errors? How can you track them?
Topics focusing on Digital Humanities (and Social Sciences)
There are many digitized resources that are relevant for researchers in the humanities. We have various projects where we apply NLP technologies to automatically analyze text. The output of these analyses can be used by historians, specialists in language and literature, philosophers, communication scientist, sociologists and many others.
Topics in this area can be of interest to students of various backgrounds: people with a strong background in computer science or linguistics and who are interested in other domains of the humanities or social sciences can work on a topic where they use their expertise to support researchers in these various fields. Students with a background in other fields of the humanities or social sciences who are interested in text analysis can work on a topic where they investigate what NLP has to offer them.
Here are a few examples of possible projects in this domain:
- Analyzing politics using N-grams. Build an N-gram viewer, similar to https://projects.fivethirtyeight.com/reddit-ngram/, for Dutch political debates. What are the trends in language used by politicians?
- Mining historical figures. In the BiographyNet project, we analyze biographical descriptions using NLP tools. We have approximately 80,000 biographies from various sources. Several research questions can be addressed from basic question (what properties do people who are included share?) up to highly complex (how does the perspective on specific people change over time?). Research can be conducted on the output of the tools, on improving the tools for the domain or specific sources as well as overall methodological questions.
- Identifying perspectives What opinions are expressed in text? How are specific events, people and organizations depicted? Can we identify biases in particular source (e.g. can we spot differences between left-wing and right-wing papers?). We have several projects that look into perspectives in text, notably Spinoza project ULM3 World views as a key to understanding language, AAA data science project QuPiD and the project Reading between the lines.
...
...
...
...