Practical hardware demonstration of a multi-sensor goal-oriented semantic signal processing and communications network

Abstract

Recent advancements in machine learning, particularly real-time extraction of rich semantic information, reshape signal processing techniques and related hardware architectures. To address the highly challenging requirements of next-generation signal processing applications in networked platforms, we investigate low-power hardware implementation alternatives for a multi-sensor, goal-oriented semantic communications network. Specifically, we focus on cost-effective Raspberry Pis in a multi-sensor semantic video communication application, showcasing adaptability from traditional CPU/GPU configurations. Additionally, we provide a preliminary investigation on implementing semantic extraction tasks through in-memory computation using memristor arrays to further emphasize the potential future of low-power low-cost semantic signal processing. Hardware demonstrations using Raspberry Pi 4Bs and simulations with in-memory computation architectures offer promising hardware architectures with cost-effective and low-power sensor alternatives to the next-generation semantic signal processing applications and semantic communication systems.