Year: 2023
Type: conference-paper
Abstract: We present two methods based on Barlow Twins, a self-supervised method, to improve training with smaller batches.The first method randomly drops features from the output before computing the loss to reduce the variance.The second method introduces a queue of outputs from previous batches to improve the loss estimate during training.The first method, with a batch size of 64, achieves an accuracy of 64.1%, the second method, with a batch size of 64 and 192 queued outputs, achieves an accuracy of 65.4%, while the original method, with a batch size of 256, achieves an accuracy of 66.0%.
Language: Portuguese
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
OpenAlex ID: W4387942922
