Work

SGK Empirical Validation: Search for Optimal Application Domains

Year: 2026

Type: article

Abstract: The SGK-Attention mechanism with ReLU causes network degeneracy in this specific architecture (ViT on MNIST). However, this does not invalidate the theoretical framework (SGK v1.2) — it indicates that this particular implementation is not optimal for this task.

Source: Zenodo (CERN European Organization for Nuclear Research)

DOI: 10.5281/zenodo.21078743

Author: Pietrzela, Adrian

Language: English

Topic: Advanced Neural Network Applications

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

OpenAlex ID: W7166675684

FWCI:

Cites:

Cited by:

Related to: