Big-data streaming applications scheduling based on staged multi-armed bandits
dc.citation.epage | 3605 | en_US |
dc.citation.issueNumber | 12 | en_US |
dc.citation.spage | 3591 | en_US |
dc.citation.volumeNumber | 65 | en_US |
dc.contributor.author | Kanoun, K. | en_US |
dc.contributor.author | Tekin, C. | en_US |
dc.contributor.author | Atienza, D. | en_US |
dc.contributor.author | Van Der Schaar, M. | en_US |
dc.date.accessioned | 2018-04-12T10:42:41Z | |
dc.date.available | 2018-04-12T10:42:41Z | |
dc.date.issued | 2016 | en_US |
dc.department | Department of Electrical and Electronics Engineering | en_US |
dc.description.abstract | Several techniques have been recently proposed to adapt Big-Data streaming applications to existing many core platforms. Among these techniques, online reinforcement learning methods have been proposed that learn how to adapt at run-time the throughput and resources allocated to the various streaming tasks depending on dynamically changing data stream characteristics and the desired applications performance (e.g., accuracy). However, most of state-of-the-art techniques consider only one single stream input in its application model input and assume that the system knows the amount of resources to allocate to each task to achieve a desired performance. To address these limitations, in this paper we propose a new systematic and efficient methodology and associated algorithms for online learning and energy-efficient scheduling of Big-Data streaming applications with multiple streams on many core systems with resource constraints. We formalize the problem of multi-stream scheduling as a staged decision problem in which the performance obtained for various resource allocations is unknown. The proposed scheduling methodology uses a novel class of online adaptive learning techniques which we refer to as staged multi-armed bandits (S-MAB). Our scheduler is able to learn online which processing method to assign to each stream and how to allocate its resources over time in order to maximize the performance on the fly, at run-time, without having access to any offline information. The proposed scheduler, applied on a face detection streaming application and without using any offline information, is able to achieve similar performance compared to an optimal semi-online solution that has full knowledge of the input stream where the differences in throughput, observed quality, resource usage and energy efficiency are less than 1, 0.3, 0.2 and 4 percent respectively. | en_US |
dc.description.provenance | Made available in DSpace on 2018-04-12T10:42:41Z (GMT). No. of bitstreams: 1 bilkent-research-paper.pdf: 179475 bytes, checksum: ea0bedeb05ac9ccfb983c327e155f0c2 (MD5) Previous issue date: 2016 | en |
dc.identifier.doi | 10.1109/TC.2016.2550454 | en_US |
dc.identifier.issn | 0018-9340 | |
dc.identifier.uri | http://hdl.handle.net/11693/36508 | |
dc.language.iso | English | en_US |
dc.publisher | Institute of Electrical and Electronics Engineers | en_US |
dc.relation.isversionof | http://dx.doi.org/10.1109/TC.2016.2550454 | en_US |
dc.source.title | IEEE Transactions on Computers | en_US |
dc.subject | data mining | en_US |
dc.subject | machine learning | en_US |
dc.subject | many-core platforms | en_US |
dc.subject | multiple streams processing | en_US |
dc.subject | Scheduling | en_US |
dc.subject | Artificial intelligence | en_US |
dc.subject | Computer architecture | en_US |
dc.subject | Data reduction | en_US |
dc.subject | E-learning | en_US |
dc.subject | Embedded systems | en_US |
dc.subject | Energy efficiency | en_US |
dc.subject | Face recognition | en_US |
dc.subject | Learning systems | en_US |
dc.subject | Online systems | en_US |
dc.subject | Processing | en_US |
dc.subject | Reinforcement learning | en_US |
dc.subject | Concept drifts | en_US |
dc.subject | Energy-Efficient Scheduling | en_US |
dc.subject | Many core | en_US |
dc.subject | Multiple streams | en_US |
dc.subject | Reinforcement learning method | en_US |
dc.subject | Resource Constraint | en_US |
dc.subject | State-of-the-art techniques | en_US |
dc.subject | Streaming applications | en_US |
dc.subject | Big data | en_US |
dc.title | Big-data streaming applications scheduling based on staged multi-armed bandits | en_US |
dc.type | Article | en_US |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Big-Data Streaming Applications Scheduling Based on Staged Multi-Armed Bandits.pdf
- Size:
- 2.34 MB
- Format:
- Adobe Portable Document Format
- Description:
- Full printable version