Delete search term

To content

Main navigation

Zurich University
of Applied Sciences

Service navigation

Intent detection in citizen-based damage reporting systems

Description

Images do not only carry visual information about their content but also an intent, namely the one of person who shared it. Disruption images, uploaded by citizens in urban reporting systems, constitute a fantastic lab to develop algorithms able to detect the different message users want to deliver. Citizen-based reporting systems, e.g. FixMyStreet / ZürichWieNeu, rely on private citizens to report urban incidents/damages which require an intervention by the city administration. Most of these systems give the users the possibility to upload a picture together with a textual description of the incident.

The peculiarity of the images uploaded is that they don't necessarily want to depict specific objects or situations, but they are rather aimed to the communication of an underlying problem. In this sense, these images can be considered bearing an intent. Intent-detection is still a fairly new application field for deep learning, usually however limited to textual data.

The goal of this project is to develop a deep learning algorithm to perform multi-modal intent detection, combining images and problem descriptions provided by users. This could serve as a first well-defined use case to develop and test an approach, which could be generally expanded to other visual-rich contexts.

Key data

Projectlead

Project status

completed, 06/2022 - 12/2022

Institute/Centre

Institute of Business Information Technology (IWI)

Funding partner

ZHAW digital

Project budget

19'824 CHF

Privacy Settings

Here we show you which services may run on our website. You decide for yourself which services we may use. You can find more information in our privacy notice.

Our website needs these cookies so that everything works properly. These cookies are created automatically when you are active on the site – for example, when you change privacy settings or fill in forms. You can block these cookies in your browser or set it to warn you about them, but some parts of the website will then no longer display correctly. These cookies do not store any of your personal data.

These services allow us to see how our website is used, but we do not know who you are. By activating these services, you help us make the website better for everyone.