Human-Centered Computing
The Human-Centered Computing (HCC) research group at InIT focuses on innovative natural interaction concepts between users and digital information. These interactions are increasingly mobile and multimodal and include new modalities such as gestures, voice input and output as well as mixed reality interactions in addition to the classic interaction options. As today's users place high demands on the usability and user experience of mobile applications and services in particular, these must be developed in a user-centered and participatory manner from the outset and continuously evaluated with users in terms of usability. When developing interaction concepts, it is also important to ensure that the interaction is accessible for as many users as possible, including those with disabilities or older people.
Immersive Technologies
In Mobile Computing and Visual Computing we explore the latest interaction modalities (speech, gestures, augmented reality, virtual reality) on the one hand and deal with the user-centered development of innovative mobile applications and services with special requirements on the other hand. The sensor technology and interaction possibilities of today's and future mobile devices are used to achieve an optimal user experience.
Speech and sound (sonification) are important modalities of Natural User Interfaces, especially for applications with limited screen interaction (like smartwatches or hands-free AR). Deep-learning-based speech recognition has made tremendous progress in recent years, and promising applications are now possible, such as live-captioning of videos or conversational assistants.
The "AR Cloud" concept addresses web-based persistent enrichment of indoor and outdoor spaces. We develop collaborative AR/VR applications to make the content of the "Metaverse" actively designable for users and smartly experienceable thanks to "Scene Understanding".
Current Research Projects and Topics
In the Innosuisse flagship project "Data-driven transformation of surgical education for proficiency-based performance", a completely new concept for the practical training of surgeons is being developed, based on innovative virtual and augmented reality simulators.
ICT-Accessibility
ICT accessibility focuses on the research and development of ICT-based solutions to reduce barriers for people with disabilities and older people, whether through barrier-free user interfaces, barrier-free access to digital information or barrier-free mobility. In doing so, we are increasingly using AI-based approaches.
-
Saeidimesineh, Reyhane; Adibi, Peyman; Karshenas, Hossein; Darvishy, Alireza,
2023.
Parallel encoder-decoder framework for image captioning.
Knowledge-Based Systems.
282(111056).
Available from: https://doi.org/10.1016/j.knosys.2023.111056
-
Fathi, Kiavash; Darvishy, Alireza; van de Venn, Hans Wernher,
2023.
Similarity and location-based real-time loop closure : SNAPS for SLAM in unexplored-environments[paper].
In:
2023 IEEE International Conference on Omni-layer Intelligent Systems (COINS).
IEEE International Conference on omni-layer intelligent Systems (COINS), Berlin, Germany and online, 23-35 July 2023.
IEEE.
pp. 7.
Available from: https://doi.org/10.1109/COINS57856.2023.10189300
-
Mandujano-Cornejo, Vittorino; Montoya-Zegarra, Javier A.,
2022.
Polyp2Seg : improved polyp segmentation with vision transformer[paper].
In:
Yang, Guang; Aviles-Rivero, Angelica; Roberts, Michael; Schönlieb, Carola-Bibiane, eds.,
Medical Image Understanding and Analysis.
26th Annual Conference on Medical Image Understanding and Analysis (MIUA), Cambridge, United Kingdom, 27-29 July 2022.
Cham:
Springer.
pp. 519-534.
Available from: https://doi.org/10.1007/978-3-031-12053-4_39
-
Schmitt-Koopmann, Felix M.; Huang, Elaine M.; Darvishy, Alireza,
2022.
Accessible PDFs : applying artificial intelligence for automated remediation of STEM PDFs[paper].
In:
Froehlich, Jon; Shinohara, Kristen; Ludi, Stephanie, eds.,
ASSETS '22 Proceedings.
24th International ACM SIGACCESS Conference on Computers and Accessibility, Athens, Greece, 23-26 October 2022.
Association for Computing Machinery.
pp. 90.
Available from: https://doi.org/10.1145/3517428.3550407
-
Darvishy, Alireza; Hutter, Hans-Peter; Seifert, Alexander,
2022.
Age-appropriate digital channels.
Wiesbaden:
Springer.
SpringerBriefs in Applied Sciences and Technology.
ISBN 978-3-658-38445-6.
Available from: https://doi.org/10.1007/978-3-658-38446-3