Moment kernels: a simple and scalable approach for equivariance to rotations and reflections in deep convolutional networks
Year: 2025
Type: preprint
Abstract: Translation equivariance is a central reason convolutional neural networks have been successful in computer vision. Other symmetries, such as rotations and reflections, are similarly important in fields such as biomedical image analysis, but equivariant methods for these symmetries remain less widely adopted, especially in 3D. Existing approaches often rely on group convolutions, harmonic bases, irreducible representations, or specialized libraries, which can obscure the explicit form of admissible kernels for practitioners. We introduce moment kernels, a simple Cartesian parameterization of convolution kernels equivariant to orthogonal transformations, $O(d)$, between tensor-valued feature fields. We prove that every such $O(d)$-equivariant kernel can be represented as a sum of radial functions of $|x|$ multiplied by products of coordinate components $x^i$ and Kronecker deltas. This gives a complete, dimension-agnostic kernel family complementary to harmonic-basis approaches and implementable using standard convolution modules. We implement a discrete version of moment-kernel networks and evaluate on biomedical tasks with different transformation laws: invariant 2D image classification and equivariant 3D affine-transform regression for brain MRI. Across these tasks, moment kernels improve worst-case orientation consistency and remain trainable in 3D, while avoiding the orientation-channel expansion required by group convolutions, which reaches 48 orientations for 90-degree rotations and reflections in 3D. The resulting models provide exact consistency under grid-preserving rotations and reflections, and remain practical for standard CNN workflows.
Source: arXiv (Cornell University)
Institution: University of California, Los Angeles
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funders: Foundation for the National Institutes of Health, Alzheimer's Association, Bristol-Myers Squibb, Eli Lilly and Company, Pfizer, Biogen, F. Hoffmann-La Roche, Meso Scale Diagnostics, Alzheimer's Disease Neuroimaging Initiative, BioClinica, Novartis Pharmaceuticals Corporation, Northern California Institute for Research and Education, Eisai, Servier, H. Lundbeck A/S, IXICO, National Institutes of Health, Genentech, Canadian Institutes of Health Research, National Institute of Neurological Disorders and Stroke
OpenAlex ID: W4416046384
Cites:
Cited by:
Related to: