Human-Centered Computing
We Design Human Interaction with Information
The research group Human-Centered Computing (HCC) focuses on innovative natural interaction concepts between users and digital information. These interactions are increasingly mobile and multimodal and include new modalities such as gestures, speech input and output, and mixed reality interactions in addition to the classical interaction possibilities. Since today's users place high demands on the usability and user experience of mobile applications and services in particular, these must be developed in a user-centered and participatory manner from the very beginning and continuously evaluated with users in terms of usability.
When developing interaction concepts, it is also important to consider that the interaction is barrier-free for as many users as possible, including those with impairments or elderly people.
Research Areas
Mobile and Visual Computing
In Mobile Computing and Visual Computing we explore the latest interaction modalities (speech, gestures, augmented reality, virtual reality) on the one hand and deal with the user-centered development of innovative mobile applications and services with special requirements on the other hand. The sensor technology and interaction possibilities of today's and future mobile devices are used to achieve an optimal user experience.
Speech and sound (sonification) are important modalities of Natural User Interfaces, especially for applications with limited screen interaction (like smartwatches or hands-free AR). Deep-learning-based speech recognition has made tremendous progress in recent years, and promising applications are now possible, such as live-captioning of videos or conversational assistants.
The "AR Cloud" concept addresses web-based persistent enrichment of indoor and outdoor spaces. We develop collaborative AR/VR applications to make the content of the "Metaverse" actively designable for users and smartly experienceable thanks to "Scene Understanding".
Current research projects and topics
In the Innosuisse flagship project "Data-driven transformation of surgical education for proficiency-based performance", a completely new concept for the practical training of surgeons is being developed, based on innovative virtual and augmented reality simulators.
ICT-Accessibility

ICT-Accessibility focuses on the research and development of ICT-based solutions to reduce barriers for people with disabilities and older people, whether through barrier-free user interfaces, barrier-free access to digital information or barrier-free mobility. In doing so, we are increasingly using AI-based approaches.
Current research projects and topics
In the project "Accessible Scientific PDFs for all", which is jointly funded by the Swiss National Science Foundation and Innosuisse, we are researching how scientific PDF documents can be made accessible so that the scientific research literature can also be made accessible to people with visual impairments. This involves researching innovative deep-learning-based approaches to recognize formulas in PDFs and convert them into a readable and navigable form.
In addition, we are researching in various projects in the area of "Accessible Mobility" how people with mobility impairments can easily find accessible routes from a starting point to a destination and be guided safely along this route on the way.
In two projects funded by swissuniversities, we are looking at how to make studying accessible for people with impairments through the use of digital technologies. In collaboration with universities, we conduct joint PhDs in the field of accessibility.
We also like to evaluate websites and mobile apps for accessibility and develop tools and plugins to make digital documents accessible.
Projects
-
FRIMI App
-
DeepScore: Digital Music Stand with Musical Understanding via Active Sheet Technology
_Management AbstractPlaying and enjoying music is amongst the most rewarding recreational activities of humankind for individuals as well as in group settings. Visiting concerts or sending one’s kids to music lessons - thus being enabled to discuss and co-shape the musical part of our culture - are hence important ...
-
SIDAC2
The aim of the SIDAC2 project is an integrated system for the valuation and management of existing real estate. The SIDAC2 project team was made up of ZHAW researchers from the Institute for Facility Management (IFM), the Institute for Administration and Management (IVM) and the Institute for Applied Information ...
Publications
-
Büchi, Matthias,
2020.
Speech recognition component for search-oriented conversational artificial intelligence.
Winterthur:
ZHAW Zürcher Hochschule für Angewandte Wissenschaften.
-
Hutter, Hans-Peter; Darvishy, Alireza,
2019.
Accessible tourism around Lake Constance [paper].
In:
Promberger, Kurt; Piazolo, Felix; Kempter, Guido, eds.,
Innovative solutions for an ageing society : proceedings of SMARTER LIVES meets uDay 19.
SMARTER LIVES meet uDay, Bozen, Italy, 28 May 2019.
Lengerich:
Pabst Science Publishers.
pp. 93-97.
-
Hutter, Hans-Peter; Darvishy, Alireza,
2019.
Barrierefreier Tourismus im Bodenseeraum [poster].
In:
Friedrich, Petra; Fuchs, Dominik, eds.,
6. Ambient Medicine® Forum „Assistive Technik für selbstbestimmtes Wohnen“ (Band 6) : 19. - 20. Februar 2019, Tagungsband.
6. Ambient Medicine Forum, Kempten, Deutschland, 19.-20. Februar 2019.
Göttingen:
Cuvillier.
pp. 165-170.
Schriftenreihe der Hochschule Kempten ; 6.
-
Darvishy, Alireza; Hutter, Hans-Peter; Frei, Jasmin,
2019.
Making mobile map applications accessible for visually impaired people [paper].
In:
Ahram, Tareq; Taiar, Redha; Colson, Serge; Choplin, Arnaud, eds.,
Human Interaction and Emerging Technologies : Proceedings of the 1st International Conference on Human Interaction and Emerging Technologies (IHIET 2019), August 22-24, 2019, Nice, France.
International Conference on Human Interaction and Emerging Technologies, Nice, France, 22-24 August 2019.
Cham:
Springer.
pp. 396-400.
Advances in Intelligent Systems and Computing ; 1018.
Available from: https://doi.org/10.1007/978-3-030-25629-6_61
-
Ackermann, Philipp; Stockinger, Kurt,
2019.
Narrative visualization of open data
.
In:
Applied data science : lessons learned for the data-driven business.
Cham:
Springer.
pp. 251-264.
Available from: https://doi.org/10.1007/978-3-030-11821-1_14