Work

Improving data cache performance by pre-executing instructions under a cache miss

Year: 1997
Type: conference-paper
Abstract: In this paper we propose and evaluate a technique that improves first level data cache performance by pre-executing future instructions under a data cache miss.We show that these preexecuted instructions can generate highly accurate data prefetches, particularly when the first level cache is small.The technique is referred to as runahead processing.The hardware required to implement runahead is modest, because, when a miss occurs, it makes use of an otherwise idle resource, the execution logic.The principal hardware cost is an extra register file.To measure the impact of runahead, we simulated a processor executing five integer Spec95 benchmarks.Our results show that runahead was able to significantly reduce data cache CPI for four of the five benchmarks.We also compared runahead to a simple form of prefetching, sequential prefetching, which would seem to be suitable for scientific benchmarks.We confirm this by enlarging the scope of our experiments to include a scientific benchmark.However, we show that runahead was also able to outperform sequential prefetching on the scientific benchmark.We also conduct studies that demonstrate that runahead can generate many useful prefetches for lines that show little spatial locality with the misses that initiate runahead episodes.Finally, we discuss some further enhancements of our baseline nmahead prefetching scheme.Permission to make digital/hard copics ofall or pal-1 ofthis matel-ial for PWsonnl or ctnssroom use is granted without f'ee provided that the copies are not made or distl-ihuted for prolit or commrrcinl ;td\rnntage.the copyright notice.the title ofthe publicntiou and its date nppe;lr, and notice is give11 ht copyright is hy permissions ofthe ACM, Inc. 'ro copy othel+sc, to rqmhlish, to post on servers or to redistribute to lists.requires specific pemlission and/or fee /(X 97 Vienna Austria
Language: English
Open Access status: bronze
OpenAlex ID: W4232096869
FWCI: 0.267
Cites: 18
Cited by: 258
Related to: 9