Efficient implementation of Newton-raphson methods for sequential data prediction
| dc.citation.epage | 2791 | en_US |
| dc.citation.issueNumber | 12 | en_US |
| dc.citation.spage | 2786 | en_US |
| dc.citation.volumeNumber | 29 | en_US |
| dc.contributor.author | Civek, B. C. | en_US |
| dc.contributor.author | Kozat, S. S. | en_US |
| dc.date.accessioned | 2018-04-12T11:02:58Z | |
| dc.date.available | 2018-04-12T11:02:58Z | |
| dc.date.issued | 2017 | en_US |
| dc.department | Department of Electrical and Electronics Engineering | en_US |
| dc.description.abstract | We investigate the problem of sequential linear data prediction for real life big data applications. The second order algorithms, i.e., Newton-Raphson Methods, asymptotically achieve the performance of the 'best' possible linear data predictor much faster compared to the first order algorithms, e.g., Online Gradient Descent. However, implementation of these second order methods results in a computational complexity in the order of $O(M2)$ for an $M$ dimensional feature vector, where the first order methods offer complexity in the order of $O(M)$. Because of this extremely high computational need, their usage in real life big data applications is prohibited. To this end, in order to enjoy the outstanding performance of the second order methods, we introduce a highly efficient implementation where the computational complexity of these methods is reduced from $O(M2)$ to $O(M)$. The presented algorithm provides the well-known merits of the second order methods while offering a computational complexity similar to the first order methods. We do not rely on any statistical assumptions, hence, both regular and fast implementations achieve the same performance in terms of mean square error. We demonstrate the efficiency of our algorithm on several sequential big datasets. We also illustrate the numerical stability of the presented algorithm. © 1989-2012 IEEE. | en_US |
| dc.description.provenance | Made available in DSpace on 2018-04-12T11:02:58Z (GMT). No. of bitstreams: 1 bilkent-research-paper.pdf: 179475 bytes, checksum: ea0bedeb05ac9ccfb983c327e155f0c2 (MD5) Previous issue date: 2017 | en |
| dc.identifier.doi | 10.1109/TKDE.2017.2754380 | en_US |
| dc.identifier.issn | 1041-4347 | |
| dc.identifier.uri | http://hdl.handle.net/11693/37105 | |
| dc.language.iso | English | en_US |
| dc.publisher | IEEE Computer Society | en_US |
| dc.relation.isversionof | http://dx.doi.org/10.1109/TKDE.2017.2754380 | en_US |
| dc.source.title | IEEE Transactions on Knowledge and Data Engineering | en_US |
| dc.subject | Big data | en_US |
| dc.subject | Highly efficient | en_US |
| dc.subject | Newton-Raphson | en_US |
| dc.subject | Sequential data prediction | en_US |
| dc.title | Efficient implementation of Newton-raphson methods for sequential data prediction | en_US |
| dc.type | Article | en_US |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Efficient Implementation of Newton-Raphson Methods for Sequential Data Prediction.pdf
- Size:
- 478.49 KB
- Format:
- Adobe Portable Document Format
- Description:
- Full printable version