An access pattern based adaptive mapping function for GPGPU scratchpad memory

IEICE Electronics Express

Hongbing Pan¹  Jun Lin¹  Feng Han¹  Jin Sha¹  Kun Wang¹  Fan Feng¹  Li Li¹ 

[1] School of Electronic Science and Engineering, Nanjing University

关键词: GPGPU;    scratchpad memory;    adaptive mapping function;    bank conflict reduction;   

DOI  :  10.1587/elex.14.20170373

学科分类：电子、光学、磁材料

来源: Denshi Jouhou Tsuushin Gakkai

【 摘 要 】

As modern GPUs integrate massive processing elements and limited memories on-chip, the efficiency of using their scratchpad memories becomes important for performance and energy. To meet bandwidth requirement of simultaneously accessing of a thread array, multi-bank design, dividing a scratchpad memory into equally-sized memory modules, are widely used. However, the complex access patterns in real-world applications can cause the bank conflicts which comes from different threads accessing the same bank at the same time, and the conflicts hinder the performance sharply. A mapping function is a method that redistributes the accesses according to access addresses. To reduce bank conflicts some scratchpad memory mapping functions are exploited, such as XOR based hash functions and configurable functions. In this paper, we propose an adaptive mapping function, which can dynamically select a suitable mapping function for applications based on the statistics of first block executing. The experimental results show that 94.8 percent bank conflicts reduced and 1.235× performance improved for 17 benchmarks on GPGPU-sim, a Fermi-like simulator.

【 授权许可】

CC BY