Work

Generalized Training for Neural Network Learnability: a Spectral Methods Approach

Year: 2023
Type: preprint
Abstract: Hybrid optical neural networks (HONNs) offload some electronic computation to optical preprocessors to achieve low-power and fast training and inference phases in machine learning tasks. Our contribution to the development of HONNs is a spectral-methods paradigm for building synthetic training data for machine-learned models. Here, our synthetic training image data does not resemble the image test data. As a result, the neural network focuses on learning specific features parameterized by the synthetic training data. Within this paradigm, a dataset's singular value decomposition entropy indicates {\it learnability}, i.e., how rapidly a model converges. Subsequently, we train a neural network model to rapidly learn specific features for further downstream analyses.
Language: English
Open Access status: green
OpenAlex ID: W4367000337
Cites:
Cited by: 1
Related to: 10