LIHLITH – Learning to Interact with Humans by Lifelong Interaction with Humans
Description
The LIHLITH project is a fundamental pilot research project which introduces a new lifelong learning framework for the interaction of humans and machines on specific domains. A Lifelong Learning system learns different tasks sequentially, over time, getting better at solving future related tasks based on past experience.
LIHLITH will focus on human-computer dialogue, where each dialogue experience is used by the system to learn to better interact, based on the success (or failure) of previous interactions. The key insight is that the dialogue will be designed to produce a reward, allowing the chatbot system to know whether the interaction was successful or not. The reward will be used to train the domain and dialogue management modules of the chatbot, improving the performance, and reducing the development cost, both on a single target domain but specially when moving to new domains.
The research will be evaluated on publicly available benchmarks to allow comparison with other approaches in the state of the art. When possible, systems will participate in international comparative/competitive evaluations such as WOCHAT or SemEval. LIHLITH project will also develop and deliver evaluation protocols and benchmarks to allow public comparison and reproducibility based on crowdsourcing.
The industrial partner will transfer the research into technology, applying the lessons learnt to the development of chatbots for customer support. LIHLITH will rely on recent advance in multiple research disciplines, including, natural language processing, knowledge induction, reinforcement learning, deep learning, and lifelong learning.
Key data
Projectlead
Project team
Project status
completed, 10/2017 - 12/2020
Institute/Centre
Institute of Computer Science (InIT)
Funding partner
EU and other international programmes
Project budget
218'340 CHF
Further documents and links
Publications
-
Spot The Bot : a robust and efficient framework for the evaluation of conversational dialogue systems
2020 Deriu, Jan Milan; Tuggener, Don; von Däniken, Pius; Campos, Jon Ander; Rodrigo, Alvaro; Belkacem, Thiziri; Soroa, Aitor; Agirre, Eneko; Cieliebak, Mark
-
Survey on evaluation methods for dialogue systems
2020 Deriu, Jan Milan; Rodrigo, Alvaro; Otegi, Arantxa; Echegoyen, Guillermo; Rosset, Sophie; Agirre, Eneko; Cieliebak, Mark
-
A methodology for creating question answering corpora using inverse data annotation
2020 Deriu, Jan Milan; Mlynchyk, Katsiaryna; Schläpfer, Philippe; Rodrigo, Alvaro; von Grünigen, Dirk; Kaiser, Nicolas; Stockinger, Kurt; Agirre, Eneko; Cieliebak, Mark
-
DoQA : accessing domain-specific FAQs via conversational QA
2020 Campos, Jon Ander; Otegi, Arantxa; Soroa, Aitor; Deriu, Jan Milan; Cieliebak, Mark; Agirre, Eneko
-
LIHLITH : improving communication skills of robots through lifelong learning
2018 Agirre, Eneko; Marchand, Sarah; Rosset, Sophie; Peñas, Anselmo; Cieliebak, Mark