Profiler and compiler assisted adaptive I/O prefetching for shared storage caches

Date
2008-10
Advisor
Supervisor
Co-Advisor
Co-Supervisor
Instructor
Source Title
Parallel Architectures and Compilation Techniques - Conference Proceedings, PACT
Print ISSN
Electronic ISSN
Publisher
ACM
Volume
Issue
Pages
112 - 121
Language
English
Type
Conference Paper
Journal Title
Journal ISSN
Volume Title
Series
Abstract

I/O prefetching has been employed in the past as one of the mech- anisms to hide large disk latencies. However, I/O prefetching in parallel applications is problematic when multiple CPUs share the same set of disks due to the possibility that prefetches from different CPUs can interact on shared memory caches in the I/O nodes in complex and unpredictable ways. In this paper, we (i) quantify the impact of compiler-directed I/O prefetching - developed originally in the context of sequential execution - on shared caches at I/O nodes. The experimental data collected shows that while I/O prefetching brings benefits, its effectiveness reduces significantly as the number of CPUs is increased; (ii) identify inter-CPU misses due to harmful prefetches as one of the main sources for this re- duction in performance with the increased number of CPUs; and (iii) propose and experimentally evaluate a profiler and compiler assisted adaptive I/O prefetching scheme targeting shared storage caches. The proposed scheme obtains inter-thread data sharing information using profiling and, based on the captured data sharing patterns, divides the threads into clusters and assigns a separate (customized) I/O prefetcher thread for each cluster. In our approach, the compiler generates the I/O prefetching threads automatically. We implemented this new I/O prefetching scheme using a compiler and the PVFS file system running on Linux, and the empirical data collected clearly underline the importance of adapting I/O prefetching based on program phases. Specifically, our pro- posed scheme improves performance, on average, by 19.9%, 11.9% and http://dx.doi.org/10.3% over the cases without I/O prefetching, with independent I/O prefetching (each CPU is performing compiler-directed I/O prefetching independently), and with one CPU prefetching (one CPU is reserved for prefetching on behalf of others), respectively, when 8 CPUs are used. Copyright 2008 ACM.

Course
Other identifiers
Book Title
Keywords
Adaptive, Compiler, Prefetching, Profiler, Shared Storage Cache, Cache memory, Decoding, Disks (structural components), Parallel architectures, Program compilers
Citation
Published Version (Please cite this version)