Discriminative fine-grained mixing for adaptive compression of data streams
IEEE Transactions on Computers
Institute of Electrical and Electronics Engineers
2228 - 2244
Item Usage Stats
MetadataShow full item record
This paper introduces an adaptive compression algorithm for transfer of data streams across operators in stream processing systems. The algorithm is adaptive in the sense that it can adjust the amount of compression applied based on the bandwidth, CPU, and workload availability. It is discriminative in the sense that it can judiciously apply partial compression by selecting a subset of attributes that can provide good reduction in the used bandwidth at a low cost. The algorithm relies on the significant differences that exist among stream attributes with respect to their relative sizes, compression ratios, compression costs, and their amenability to application of custom compressors. As part of this study, we present a modeling of uniform and discriminative mixing, and provide various greedy algorithms and associated metrics to locate an effective setting when model parameters are available at run-time. Furthermore, we provide online and adaptive algorithms for real-world systems in which system parameters that can be measured at run-time are limited. We present a detailed experimental study that illustrates the superiority of discriminative mixing over uniform mixing. © 2013 IEEE.
Data communication systems
Real time systems
Permalink (Please cite this version)http://hdl.handle.net/11693/25425
Showing items related by title, author, creator and subject.
A compression method based on compressive sampling for 3-D laser range scans of indoor environments Dobrucali O.; Barshan, B. (2010)When 3-D models of environments need to be transmitted or stored, they should be compressed efficiently to increase the capacity of the communication channel or the storage medium. We propose a novel compression technique ...
Şaykol, E.; Sinop, A. K.; Güdükbay U.; Ulusoy, Ö.; Çetin, A. E. (IEEE, 2004)There is an accelerating demand to access the visual content of documents stored in historical and cultural archives. Availability of electronic imaging tools and effective image processing techniques makes it feasible to ...
Dobrucali, O.; Barshan, B. (Oxford University Press, 2013)Three-dimensional models of environments can be very useful and are commonly employed in areas such as robotics, art and architecture, facility management, water management, environmental/industrial/urban planning and ...