• About
  • Policies
  • What is open access
  • Library
  • Contact
Advanced search
      View Item 
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Electrical and Electronics Engineering
      • View Item
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Electrical and Electronics Engineering
      • View Item
      JavaScript is disabled for your browser. Some features of this site may not work without it.

      A hybrid framework for sequential data prediction with end-to-end optimization

      Thumbnail
      View / Download
      1.2 Mb
      Author(s)
      Aydin, M.E.
      Kozat, Suleyman S.
      Date
      2022-08-08
      Source Title
      Digital Signal Processing
      Print ISSN
      1051-2004
      Electronic ISSN
      1095-4333
      Publisher
      Elsevier
      Volume
      129
      Pages
      1 - 12
      Language
      English
      Type
      Article
      Item Usage Stats
      9
      views
      3
      downloads
      Abstract
      We investigate nonlinear prediction in an online setting and introduce a hybrid model that effectively mitigates, via an end-to-end architecture, the need for hand-designed features and manual model selection issues of conventional nonlinear prediction/regression methods. In particular, we use recursive structures to extract features from sequential signals, while preserving the state information, i.e., the history, and boosted decision trees to produce the final output. The connection is in an end-to-end fashion and we jointly optimize the whole architecture using stochastic gradient descent, for which we also provide the backward pass update equations. In particular, we employ a recurrent neural network (LSTM) for adaptive feature extraction from sequential data and a gradient boosting machinery (soft GBDT) for effective supervised regression. Our framework is generic so that one can use other deep learning architectures for feature extraction (such as RNNs and GRUs) and machine learning algorithms for decision making as long as they are differentiable. We demonstrate the learning behavior of our algorithm on synthetic data and the significant performance improvements over the conventional methods over various real life datasets. Furthermore, we openly share the source code of the proposed method to facilitate further research. © 2022 Elsevier Inc.
      Keywords
      End-to-end learning
      Feature extraction
      Long short-term memory (LSTM)
      Online learning
      Prediction
      Soft gradient boosting decision tree (sGBDT)
      Permalink
      http://hdl.handle.net/11693/111542
      Published Version (Please cite this version)
      https://dx.doi.org/10.1016/j.dsp.2022.103687
      Collections
      • Department of Electrical and Electronics Engineering 4011
      Show full item record

      Browse

      All of BUIRCommunities & CollectionsTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCoursesThis CollectionTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCourses

      My Account

      Login

      Statistics

      View Usage StatisticsView Google Analytics Statistics

      Bilkent University

      If you have trouble accessing this page and need to request an alternate format, contact the site administrator. Phone: (312) 290 2976
      © Bilkent University - Library IT

      Contact Us | Send Feedback | Off-Campus Access | Admin | Privacy