Emerging AI and computing technologies
Oasis
At a glance
- Project leader : Prof. Yulia Sandamirskaya
- Project team : Loïc Azzalini, Dr. Stefan Glüge
- Project budget : EUR 150'000
- Project status : ongoing
- Funding partner : Third party (CLOUD&HEAT Technologies GmbH / WAIYS)
- Project partner : CLOUD&HEAT Technologies GmbH / WAIYS
- Contact person : Yulia Sandamirskaya
Description
In the Oasis project, we demonstrate how neuromorphic tehcnology -- Intel's research chip Loihi 2’s -- can be used for assistive humanoid robot used in a smart city environment. Neuromorphic hardware and software support development of applications featuring low-latency real-time sensorprocessing that enables autonomous scene awareness, and, optionally, motor response, while operating on a power budget of less than 10W.
The ZHAW team will use the Loihi 2 system and Lava software libraries to develop modular capabilities that can be combined and invoked by higher layers of processing to implement engaging user interactions and games. For example, such capabilities may include: Detection and tracking of human hands, evaluation of human hand gestures with the goal of triggering robot's responses, or even online coordination of actions between the robot and a human. The real-time processing capability of Loihi 2 allows us to make interaction with the robot more engaging and natural for the user.