Work

From Adinkras to GPT-2: Testing an Adinkra-Inspired Low-Rank Hypothesis

Year: 2026
Type: preprint
Abstract: This paper reports a descriptive pilot testing whether a low-rank representation fitted to pairwise causal interactions in GPT-2 Small can predict triple interactions. Adinkras supplied the intellectual motivation; neither supersymmetry nor an Adinkra algebra was tested. The pilot comprised 384 donor conditions over 128 prompts and eight name-pair clusters, evaluated using six selected attention heads and six independently selected control heads. For each condition, a rank-one predictor used 15 pair interactions and one calibration triple to predict the remaining 19 triple interactions. Under single-cell calibration, the predictor did not demonstrate an average predictive advantage over zero. For the primary heads and ordinary readout, cluster-balanced mean normalized held-out error was 0.794926, compared with 0.783085 for zero prediction. The predictor improved on zero in 190 of 384 conditions and four of eight name-pair clusters. These findings do not establish statistical equivalence. Exploratory diagnostics showed modest directional alignment, but a spectral initialization ablation achieved a slightly higher median cosine. Residual recurrence was also observed, without consistent primary-head superiority over controls. Unequal realized intervention doses limit circuit-specific interpretations. Oracle scaling calculations use held-out information, including possible sign reversal, and are reported only as diagnostic lower bounds on loss. The accompanying reproduction package includes the manuscript, archived analysis outputs, all 10,752 baseline rows, numerical tables, figures, source identities, and a checksum-verifying CPU analysis script. It supports reproduction of reported aggregates from archived outputs; it does not contain the complete original per-case derivative archive. This is a bounded negative pilot result for the tested predictive procedure. The 240 reserved conditions remain unopened, and no reserved-set confirmation is claimed.
Author: Joshua Duran
Language: English
Open Access status: green
OpenAlex ID: W7234764213
Cites:
Cited by:
Related to: 10