System on Chip Design
System on Chip (SoC) vereint Mikroprozessoren, funktionsspezifische Peripherie- oder Codec-Bausteine sowie meistens auch frei programmierbare Logik (FPGA) auf einem gemeinsamen Silizium-Chip. Damit lassen sich äusserst leistungsfähige, flexible und zudem kostengünstige Systeme mit schneller Datenverarbeitung und Datenübertragung herstellen. Das InES fokussiert in diesem Schwerpunkt auf das Zusammenspiel von Hardware und Software innerhalb von SoCs, insbesondere auf die Architektur, den Entwurf und die Programmierung von SoCs mit frei programmierbarer Logik.

Programmierbare Logik hat heutzutage weitgehend applikationsspezifische integrierte Schaltungen sowie Gate Arrays ersetzt. Grund dafür sind die geringen «Non-recurring Expenses» und die Möglichkeit, Hardware und Software im Feld zu aktualisieren.
Wegen der hohen Umsatzzahlen konnten die führenden Hersteller von programmierbarer Logik ausgedehnte Forschung betreiben und ihre Produkte ausbauen. So sind neben zahlreicher, in Makrozellen konfigurierbarer IPs, so genannte Softcore-Prozessoren und viele fest eingebaute Hochleistungsfunktionen standardmässig integriert. Beispiele sind GBit-Chip-zu-Chip-Kommunikation, Dual-Core-RISC-Prozessoren und Speichercontroller. Die Architekturen und Entwicklungswerkzeuge dazu werden immer anspruchsvoller. Somit werden Ingenieure, die FPGA-Schaltungen formal entwerfen und verifizieren können, zu Spezialisten. Das InES forscht an netzwerkorientierten Geräten, bei denen der Einsatz von FPGAs ein zentraler Bestandteil ist. Typische InES-Projekte, bei denen FPGAs eingesetzt werden, sind ein redundantes Kommunikationssystem entlang Bahngleisen, Audio/Video Switching über Wide Area Networks und Bildwiedergabe in medizinischen Geräten.
Embedded High Performance Multimedia Blog
-
BLOG
Linux Driver for the LT6911UXC HDMI to MIPI CSI-2 Converter
The ZHAW Institute of Embedded Systems (InES), High Performance Multimedia Group, developed a 4k video for Linux driver for the Lontium LT6911UXC HDMI to MIPI CSI-2 converter IC.The driver was written ...
gelk
-
BLOG
Secure Boot Concept for the Zynq Ultrascale+ MPSoC
The complexity of today’s multiprocessor System-on-Chip (MPSoC) can lead to major security risks in embedded designs, as the available security functions are often not or insufficiently utilized. ...
gelk
-
BLOG
Linux Driver for TI DS90UB95x FPD-Link III serializer and deserializer
The Institute of Embedded Systems at ZHAW developed a driver for the deserializer DS90UB954 and serializer DS90UB953 from Texas Instruments. The driver was tested on the RaspberryPi 4, NVIDIA Nano ...
gelk
-
BLOG
Power over Coax FPD-Link III Link Streaming Adapter for Raspberry PI CSI-Interface
The Institute of Embedded Systems at ZHAW has developed an open source adapter which allows streaming of a CSI-2 Camera interface to a Raspberry Pi. This allows connecting cameras with CSI interface ...
gelk
-
BLOG
Deep Learning for Classifying Food Waste
Amin MazloumianHans-Joachim GelkeMatthias Rosenthal Institute of Embedded Systems Zurich University of Applied Sciences Zurich, Switzerland amin.mazloumian@zhaw.ch One third of food produced in ...
gelk
-
BLOG
Artificial Intelligence on Microcontrollers
Using artificial intelligence algorithms, specifically neural networks on microcontrollers offers several possibilities but reveals challenges: limited memory, low computing power and no operating ...
rosn
-
BLOG
ZNNN the Framework to Port Neural Networks to FPGA
BY TOBIAS WELTI AND HANS-JOACHIM GELKE Due to their hardware architecture, Field Programmable Gate Arrays (FPGAs) are optimally suited for the execution of machine learning algorithms. These ...
gelk
-
BLOG
Interfacing FPD-Link III to a x86-PC via PCI Express
FPD-Link III tp PCIe Interface A computer with a GPU combined with an FPGA is a powerful tool for high speed video processing. An FPGA can preprocess multiple video streams in realtime and then ...
gelk
-
BLOG
Direct communication between FPGA and GPU using Frame Based DMA (FDMA)
By Philipp Huber, Hans-Joachim Gelke, Matthias Rosenthal GPUs with their immense parallelization are best fitted for real-time video and signal processing. However, in a real-time system, the ...
gelk
-
BLOG
IntEdgPerf: A new AI benchmark for embedded processors
IntEdgPerf is a new benchmark for running machine learning algorithms on embedded devices. It was developed at the Institute of Embedded Systems (InES) at the Zürich University of Applied Sciences. ...
rosn
-
BLOG
Machine learning on Cortex-M4 using Keras and ARM-CMSIS-NN
We have developed a simple software to show how a custom keras model can be automatically translated into c-code. The generated c-code can, in combination with the ARM-CMSIS-NN functions, be used to ...
rosn
-
BLOG
HDMI2CSI now running on 28.2.1
The HDMI2CSI board for capturing 4K HDMI was ported to the latest release of L4T (28.2.1) including the bug fix in the Nvidia VI (see forum: [1], [2]). Major differences where adapted from L4T 28.1 to ...
rosn
-
BLOG
Multi-Channel I2S-Audio to MIPI-Camera Serial Interface (CSI) Converter FPGA-IP
The NVIDA Tegra Processors TX1/TX2 with their powerful GPUs are ideal for use in professional audio mixing consoles or audio video equipment. However, if multiple audio channels are required, the ...
gelk
-
BLOG
Boost your GStreamer pipeline with the GPU plugin
Embedded devices like the Nvidia Tegra X1/2 offer tremendous video processing capabilities. But often there are bottlenecks hindering you from taking advantage of their full potential. One solution to ...
rosn
-
BLOG
Open Source drivers for HDMI2CSI module updated to support TX1 and TX2
The HDMI2CSI board for capturing 4K HDMI now supports both TX1 and TX2. Video capturing is fully supported for resolutions up to 2160p30 on Input A and 1080p60 on Input B. Driver development will ...
rosn
-
BLOG
Redundant 4k Video Streaming via Several LTE Connections
The InES HPMM research group presents a concept for a mobile and redundant 4K video streaming over LTE networks. It combines powerful 4K video capturing and processing capabilities of dedicated ...
gelk
-
BLOG
MIPI CSI/DSI Interface for General Purpose Data Acquisition
Modern SoC devices offer high performance for data analysis and processing. In order to transfer accordingly high data rates, the choices for high speed general purpose interfaces are limited. The ...
rosn
-
BLOG
Low Latency, Highly Reliable Wireless Video Transmission to iPad
Institute of Embedded Systems, a research institute of Zurich University of Applied Sciences generated a reference design for a low latency, highly reliable wireless video transmission from a battery ...
gelk
-
BLOG
Audio Video Regression Test System
For our test driven way of development we build up a regression test system for our high performance video and audio transmission. The system is used to schedule and run tests and monitor the results ...
rosn
-
BLOG
HDMI Real-Time Analyzer and Tester
The High-Performance Multimedia Group has developed an HDMI Real-Time Analyzer and Tester which allows logging and real-time modifications of the HDMI stream between source and sink. Applications: ...
rosn