DIET-PIM: Dynamic Importance-based Early Termination for Energy-Efficient Processing-in-Memory Accelerator
Part Of
APCCAS and PrimeAsia 2024 - 2024 IEEE 20th Asia Pacific Conference on Circuits and Systems and IEEE Asia Pacific Conference on Postgraduate Research in Microelectronics Electronics, Proceeding
Start Page
30
End Page
34
ISBN
979-835037877-1
Date Issued
2024-11-07
Author(s)
DOI
10.1109/APCCAS62602.2024.10808543
Abstract
Processing-In-Memory (PIM) has notably boosted the energy efficiency of Convolutional Neural Networks (CNN) inference. However, frequent access to power-hungry analog-to-digital converters (ADCs) remains challenging, hindering overall energy efficiency. Although ongoing research focuses on exploiting sparsity to address this problem, the ADC overhead has not been sufficiently reduced due to static inference. This paper proposes a dynamic importance-based early termination technique for PIM (DIET-PIM). Specifically, DIET-PIM optimizes CNN inference at runtime by identifying regions in the features that contribute less to the classification result and skipping the computation on a subset of the input values for these ineffective regions. Evaluation results show that DIET-PIM reduces ADC accesses and improves overall energy efficiency by 3.13 ×-5.79 × compared with baseline PIM-based accelerator.
Event(s)
20th IEEE Asia Pacific Conference on Circuits and Systems and IEEE Asia Pacific Conference on Postgraduate Research in Microelectronics Electronics, APCCAS and PrimeAsia 2024
SDGs
Publisher
IEEE
Type
conference paper