Year: 2024
Type: dissertation
Abstract: Embedded non-volatile memory (eNVM)-based in-memory computing (IMC) architectures have garnered significant interest due to their high memory density and non-volatility in realizing efficient implementations of deep neural networks (DNNs).Their high density enables on-chip storage of DNN models, thereby reducing the energy and latency costs associated with data movement.Additionally, their non-volatile nature supports efficient activitydriven duty-cycled operations.However, these benefits have not been realized in real-life eNVM-based IMC integrated chip (IC) prototypes, which significantly lag behind SRAM-based IMCs and digital accelerators in terms of energy efficiency and compute density.This lag is primarily due to the presence of large read-out circuits required to achieve high bank-level accuracy.Moreover, the fundamental energy-accuracy trade-offs of eNVM-based IMCs are not well understood, as most research focuses on achieving high networklevel accuracy, which masks bank-level accuracy due to the error tolerance of DNNs and the use of noise-aware training.This dissertation aims to evaluate the intrinsic energy-accuracy trade-offs of eNVM-based IMCs and develop techniques to enhance bank-level accuracy.First, we introduce a comprehensive benchmarking methodology for IMCs that quantifies the significant lag in energy efficiency and compute density of eNVM-based IMCs compared to SRAM-based IMCs and digital accelerators.Second, to understand this lag, which arises from the low bank-level accuracy of resistive IMCs, we use the compute signal-to-noise-plus-distortion ratio (SNDR) to measure accuracy and identify its dependence on device, circuit, and architectural parameters.This is achieved by developing a chip-verified behavioral model, which reveals that the maximum achievable SNDR is limited by pre-analog-to-digital-converter (ADC) analog non-idealities.Additionally, we find that increasing the device-level conductance contrast improves the maximum achievable SNDR only up to a certain point, beyond Embarking on a Ph.D. is a monumental task and a life-changing experience that transforms an individual into a critical thinker, problem solver, and excellent communicator.Six years ago, I began my Ph.D. under the guidance of Prof. Naresh Shanbhag with the aspiration of mastering these skills.As I finalize my dissertation, I am proud to say that I have undergone a profound transformation, acquiring these abilities through an immensely challenging yet rewarding journey.Words cannot adequately express my gratitude to Prof. Shanbhag for offering me this opportunity and for his unwavering guidance and support throughout the process.His mentorship has been instrumental in honing my thinking, writing, and communication skills, always pushing me to strive for excellence.
Author: Roy, Saion Kumar
Institution: University of Illinois Urbana-Champaign
Language: English
Subfield: Electrical and Electronic Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7220805580
