Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
gradient checkpointing
Description:
A neural-network training memory optimization that saves selected intermediate activations and recomputes others during backpropagation.
Related topics:
Topic Modeling (19%),
Parallel Computing and Optimization Techniques (14%),
Advanced Neural Network Applications (9%)
OpenAlex ID:
keywords/gradient-checkpointing
A Full-Image Full-Resolution End-to-End-Trainable CNN Framework for Image Forgery Detection
2020
·
Francesco Marra
, Diego Gragnaniello
, et al.
·
IEEE Access
·
159
PDF
Combined Scaling for Zero-shot Transfer Learning
2021
·
Pham, Hieu
, Dai, Zihang
, et al.
·
arXiv (Cornell University)
·
157
PDF
Combined scaling for zero-shot transfer learning
2023
·
Hieu Pham
, Zihang Dai
, et al.
·
Neurocomputing
·
144
Low-Memory Neural Network Training: A Technical Report
2019
·
Sohoni, Nimit S.
, Aberger, Christopher R.
, et al.
·
arXiv (Cornell University)
·
118
PDF
DITTO: Diffusion Inference-Time T-Optimization for Music Generation
2024
·
Novack, Zachary
, McAuley, Julian
, et al.
·
arXiv (Cornell University)
·
105
PDF
Memory-efficient DNN training on mobile devices
2022
·
In Gim
, JeongGil Ko
·
International Conference on Mobile Systems, Applications, and Services
·
86
DISTFLASHATTN: Distributed Memory-efficient Attention for Long-context LLMs Training
2023
·
Li, Dacheng
, Shao, Rulin
, et al.
·
arXiv (Cornell University)
·
49
PDF
Optimal Gradient Checkpoint Search for Arbitrary Computation Graphs
2021
·
Jianwei Feng
, Dong Huang
·
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
·
48
PDF
A Study of Optimizations for Fine-tuning Large Language Models
2024
·
Singh, Arjun
, Pandey, Nikhil
, et al.
·
arXiv (Cornell University)
·
29
PDF
Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models
2023
·
Liu, Yuliang
, Li, Shenggui
, et al.
·
arXiv (Cornell University)
·
20
PDF
Scalable Architectures for Training Large Language Models under Resource Constraints
2024
·
Popescu, Lea
, Horvath, Marta
, et al.
·
Journal of Generative Intelligence E: 3117-6429 P: 3117-6437
·
19
PDF
Doc2Dict: Information Extraction as Text Generation
2021
·
Townsend, Benjamin
, Ito-Fisher, Eamon
, et al.
·
arXiv (Cornell University)
·
16
PDF
Combining Balancing Dataset and SentenceTransformers to Improve Short Answer Grading Performance
2024
·
Maresha Caroline Wijanto
, Hwan-Seung Yong
·
Applied Sciences
·
13
PDF
Preparation of Fractal-Inspired Computational Architectures for Advanced Large Language Model Analysis
2025
·
Mittal, Yash
, Ignatov, Dmitry
, et al.
·
arXiv (Cornell University)
·
12
PDF
End-to-End Long Document Summarization using Gradient Caching
2025
·
Rohit Saxena
, Hao Tang
, et al.
·
Transactions of the Association for Computational Linguistics
·
12
PDF
Unsupervised Discovery of Interpretable Directions in h-space of Pre-trained Diffusion Models
2023
·
Zhang, Zijian
, Liu, Luping
, et al.
·
arXiv (Cornell University)
·
11
PDF
FetusMap: Fetal Pose Estimation in 3D Ultrasound
2019
·
Xin Yang
, Wenlong Shi
, et al.
·
Lecture notes in computer science
·
11
PDF
Memory efficient model based deep learning reconstructions for high spatial resolution 3D non-cartesian acquisitions
2023
·
Zachary Miller
, Ali Pirasteh
, et al.
·
Physics in Medicine and Biology
·
10
PDF
GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction
2022
·
Ozturkler, Batu
, Sahiner, Arda
, et al.
·
arXiv (Cornell University)
·
10
PDF
Reducing the Memory Cost of Training Convolutional Neural Networks by CPU Offloading
2019
·
Tristan Hascoet
, Weihao Zhuang
, et al.
·
Journal of Software Engineering and Applications
·
9
PDF
CMFormer: Non-line-of-sight imaging with a memory-efficient MetaFormer network
2025
·
Shihao Zhang
, Shaohui Jin
, et al.
·
Optics and Lasers in Engineering
·
7
Understanding Multi-Dimensional Efficiency of Fine-Tuning Large Language Models Using SpeedUp, MemoryUp, and EnergyUp
2024
·
Dayuan Chen
, Noe Soto
, et al.
·
IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum
·
7
TA-SSM net: tri-directional attention and structured state-space model for enhanced MRI-Based diagnosis of Alzheimer’s disease and mild cognitive impairment
2025
·
Sichen Bao
, Fengbo Zheng
, et al.
·
BMC Medical Imaging
·
6
PDF
Optimal LLM Execution Strategies for Llama 3.1 Language Models Across Diverse Hardware Configurations: A Comprehensive Guide
2024
·
Pınar Ersoy
, Mustafa Erşahin
·
Computational Intelligence and Machine Learning
·
6
PDF
Self-Supervised Denoising of Seismic Data Using a True 3D Global Attention Convolutional Network
2026
·
Matin Mahzad
, Amirreza Mehrabi
, et al.
·
Arabian Journal for Science and Engineering
·
5
Show more works
View as search
Works count:
134
Citation count:
1,438
Year
Topic
Type