Joint optimization of linear and nonlinear models for sequential regression
buir.contributor.author | Fazla, Arda | |
buir.contributor.author | Aydin, Mustafa E. | |
buir.contributor.author | Kozat, Süleyman S. | |
buir.contributor.orcid | Fazla, Arda|0000-0001-6763-7266 | |
buir.contributor.orcid | Kozat, Süleyman S.|0000-0002-6488-3848 | |
dc.citation.epage | 103802-11 | en_US |
dc.citation.spage | 103802-1 | en_US |
dc.citation.volumeNumber | 132 | en_US |
dc.contributor.author | Fazla, Arda | |
dc.contributor.author | Aydin, Mustafa E. | |
dc.contributor.author | Kozat, Süleyman S. | |
dc.date.accessioned | 2023-02-16T12:29:02Z | |
dc.date.available | 2023-02-16T12:29:02Z | |
dc.date.issued | 2022-12 | |
dc.department | Department of Electrical and Electronics Engineering | en_US |
dc.description.abstract | We investigate nonlinear regression and introduce a novel approach based on the joint optimization of linear and nonlinear models. In order to capture both the nonlinear and linear characteristics in sequential data, we model the underlying data as a combination of linear and nonlinear models, where we optimize the models jointly to minimize the final regression error. As the nonlinear model, we employ a differentiable version of the boosted decision trees. As the linear model, we use the well-known SARIMAX model. Our approach is generic so that any differentiable nonlinear or linear model can be readily employed provided that they are differentiable. By this joint optimization, we alleviate the well-known underfitting and overfitting problems in modeling sequential data. Through our experiments on synthetic and real-life data, we demonstrate significant improvements over individual components as well as the combination/mixture methods in the literature. | en_US |
dc.description.provenance | Submitted by Bilge Kat (bilgekat@bilkent.edu.tr) on 2023-02-16T12:29:02Z No. of bitstreams: 1 Joint_optimization_of_linear_and_nonlinear_models_for_sequential_regression.pdf: 1596378 bytes, checksum: ceb6276a925476f39e5e00abc72a28cb (MD5) | en |
dc.description.provenance | Made available in DSpace on 2023-02-16T12:29:02Z (GMT). No. of bitstreams: 1 Joint_optimization_of_linear_and_nonlinear_models_for_sequential_regression.pdf: 1596378 bytes, checksum: ceb6276a925476f39e5e00abc72a28cb (MD5) Previous issue date: 2022-12 | en |
dc.identifier.doi | 10.1016/j.dsp.2022.103802 | en_US |
dc.identifier.eissn | 1095-4333 | |
dc.identifier.issn | 1051-2004 | |
dc.identifier.uri | http://hdl.handle.net/11693/111460 | |
dc.language.iso | English | en_US |
dc.publisher | Academic Press | en_US |
dc.relation.isversionof | https://dx.doi.org/10.1016/j.dsp.2022.103802 | en_US |
dc.source.title | Digital Signal Processing | en_US |
dc.subject | Online learning | en_US |
dc.subject | Regression | en_US |
dc.subject | Seasonal auto-regressive integrated moving average with eXogenous factors (SARIMAX) | en_US |
dc.subject | Soft gradient boosting decision tree (Soft GBDT) | en_US |
dc.subject | Stochastic gradient descent (SGD) | en_US |
dc.title | Joint optimization of linear and nonlinear models for sequential regression | en_US |
dc.type | Article | en_US |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Joint_optimization_of_linear_and_nonlinear_models_for_sequential_regression.pdf
- Size:
- 1.52 MB
- Format:
- Adobe Portable Document Format
- Description:
License bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- license.txt
- Size:
- 1.69 KB
- Format:
- Item-specific license agreed upon to submission
- Description: