Year: 2026
Type: dissertation
Abstract: Since most neural network approximation techniques are limited to inference, we work to adapt it for practical usage during training, establishing options for training on weaker edge devices. We build on previous work to expand upon perforated convolution as a neural network approximation technique as well as adapt it for use during training. We speed up convolutional layers by skipping their evaluation and gradient calculation in some spatial positions, then interpolating the missing values. We analyze the effect of using perforated convolution during training. We show that on weak edge devices, using perforated convolution training with segmentation networks such as AgriAdapt U-Net reduces memory usage by up to 30% with up to 5x speedup, with a significant reduction in training energy usage.
Author: Ciglarič, Timotej
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7127778221
Cites:
Cited by:
Related to: