Emerging AI and computing technologies (Oasis)

Description

In the Oasis project, we demonstrate how neuromorphic technology -- Intel's research chip Loihi 2’s -- can be used for assistive humanoid robot used in a smart city environment. Neuromorphic hardware and software support development of applications featuring low-latency real-time sensory processing that enables autonomous scene awareness, and, optionally, motor response, while operating on a power budget of less than 10W. The ZHAW team will use the Loihi 2 system and Lava software libraries to develop modular capabilities that can be combined and invoked by higher layers of processing to implement engaging user interactions and games. For example, such capabilities may include: Detection and tracking of human hands, evaluation of human hand gestures with the goal of triggering robot's responses, or even online coordination of actions between the robot and a human. The real-time processing capability of Loihi 2 allows us to make interaction with the robot more engaging and natural for the user.