Browsing by Subject "Sensor fusion"

Filter results by typing the first few letters
Now showing 1 - 3 of 3
  • Thumbnail Image
    ItemOpen Access
    Federated learning and distributed inference over wireless channels
    (2023-11) Tegin, Büşra
    In an era marked by massive connectivity and a growing number of connected devices, we have gained unprecedented access to a wealth of information, enhancing the reliability and precision of intelligent systems and enabling the de-velopment of learning algorithms that are more capable than ever. However, this proliferation of data also introduces new challenges for centralized learning algorithms for the training and inference processes of these intelligent systems due to increased traffic loads and the necessity of substantial computational resources. Consequently, the introduction of federated learning (FL) and distributed inference systems has become essential. Both FL and distributed inference necessitate communication within the network, specifically, the transmission of model updates and intermediate features. This has led to a significant emphasis on their utilization over wireless channels, underscoring the pivotal role of wireless communications in this context. In pursuit of a practical implementation of federated learning over wireless fading channels, we direct our focus towards cost-effective solutions, accounting for hardware-induced distortions. We consider a blind transmitter scenario, wherein distributed workers operate without access to channel state information (CSI). Meanwhile, the parameter server (PS) employs multiple antennas to align received signals. To mitigate the increased power consumption and hardware cost, we leverage complex-valued, low-resolution digital-to-analog converters (DACs) at the transmitter and analog-to-digital converters (ADCs) at the PS. Through a combination of theoretical analysis and numerical demonstrations, we establish that federated learning systems can effectively operate over fading channels, even in the presence of low-resolution ADCs and DACs. As another aspect of practical implementation, we investigate federated learning with over-the-air aggregation over time-varying wireless channels. In this scenario, workers transmit their local gradients over channels that undergo time variations, stemming from factors such as worker or PS mobility and other transmission medium fluctuations. These channel variations introduce inter-carrier interference (ICI), which can notably degrade the system performance, particularly in cases of rapidly varying channels. We examine the effects of the channel time variations on FL with over-the-air aggregation, and show that the resulting undesired interference terms have only limited destructive effects, which do not prevent the convergence of the distributed learning algorithm. Focusing on the distributed inference concept, we also consider a multi-sensor wireless inference system. In this configuration, several sensors with constrained computational capacities observe common phenomena and engage in collaborative inference efforts alongside a central device. Given the inherent limitations on the computational capabilities of the sensors, the features extracted from the front part of the network are transmitted to an edge device, which necessitates sensor fusion for the intermediate features. We propose Lp-norm inspired and LogSumExp approximations for the maximum operation as a sensor fusion method, resulting in the acquisition of transformation-invariant features that also enable bandwidth-efficient feature transmission. As a further enhancement of the proposed method, we introduce a learnable sensor fusion technique inspired by the Lp-norm. This technique incorporates a trainable parameter, providing the flexibility to customize the sensor fusion according to the unique network and sensor distribution characteristics. We show that by encompassing a spectrum of behaviors, this approach enhances the adaptability of the system and contributes to its overall performance improvement.
  • Thumbnail Image
    ItemOpen Access
    Hand gesture based remote control system using infrared sensors and a camera
    (Institute of Electrical and Electronics Engineers, 2014) Erden, F.; Çetin, A.
    In this paper, a multimodal hand gesture detection and recognition system using differential Pyroelectric Infrared (PIR) sensors and a regular camera is described. Any movement within the viewing range of the differential PIR sensors are first detected by the sensors and then checked if it is due to a hand gesture or not by video analysis. If the movement is due to a hand, one-dimensional continuous-time signals extracted from the PIR sensors are used to classify/recognize the hand movements in real-time. Classification of different hand gestures by using the differential PIR sensors is carried out by a new winner-takeall (WTA) hash based recognition method. Jaccard distance is used to compare the WTA hash codes extracted from 1-D differential infrared sensor signals. It is experimentally shown that the multimodal system achieves higher recognition rates than the system based on only the on/off decisions of the analog circuitry of the PIR sensors.
  • Thumbnail Image
    ItemOpen Access
    iki diferansiyel PIR algılayıcı ve bir kamera yardımıyla el hareketlerinin sınıflandırılması
    (IEEE, 2014-04) Erden, Fatih; Bingol, A. S.; Çetin, A. Enis
    Bu makalede, iki diferansiyel kızılberisi algılayıcı (PIR) ve bir kamera kullanılarak geliştirilen el jestleri algılama ve sınıflandırma sistemi tanıtılmaktadır. İzlenen alanda diferansiyel PIR algılayıcı dizisi ile hareket varlığı araştırılır. Bir hareket algılanması durumunda kamera yardımıyla söz konusu hareketin el olup olmadığına, el ise çok modlu sistem verilerinin birlikte değerlendirilmesiyle hareketin hangi tanımlı sınıfa ait olduğuna karar verilir. Kamera ile el jestleri algılama ve hareketleri sınıflandırma aşamasında ten algılama ve dışbükey zarf-gedik hesaplama yöntemleri kullanılır. Farklı el hareketlerinin PIR algılayıcı verileri yardımıyla sınıflandırılması Winner-Take-All (WTA) imza metoduyla gerçekleştirilir. Bu makalenin temel katkısı, WTA imza kodlarının tek boyutlu sinyallerin sınıflandırılmasında kullanılabileceğini ve çoklu algılayıcı tümleştirmesiyle jestleri tanıma sonuçlarının geliştirilebileceğini göstermektir.