Year: 2022
Type: dissertation
Abstract: A common problem encountered when training neural networks is that of overfitting, where a trained model makes high-quality predictions on training data but fails to generalize well to unseen samples.There exist many generic techniques for avoiding overfitting, called regularization, such as weight regularization, dropout, and noise injection.In this work, we explore domain and problem-specific techniques for data augmentation and pretraining, two other forms of regularization.For many tasks, one of the major challenges to avoiding overfitting is the relatively small amount of task-specific labeled data available.Data augmentation seeks to alleviate this problem by artificially creating more data that can be used during training.Although the generated data is not real, it has been shown empirically to improve model performance when used during the training process.Model pretraining is another technique that seeks to take advantage of a large amount of unlabeled data from the target domain that can be used to learn useful features.After pretraining, the model can be fine-tuned for the under-resourced task.The problems we explore in this work are Automatic Speech Recognition (ASR) of dysarthric speech, estimation of respiratory rate from breathing audio, and prediction of COVID-19 status from speech, breathing and cough audio.All three of these problems are relatively under-resourced compared to many other current deep learning problems and can uniquely benefit from task-specific regularization techniques.We explore the ability of voice conversion for use as an effective method to augment an existing dataset of dysarthric speech (UA Speech).After training a voice conversion system to transform healthy speech such that it sounds like dysarthric speech, we generate a large amount of artificial dysarthric speech data from healthy speech.We also propose a data augmentation technique for periodic data that permutes frequency channels that can be I am grateful for the funding of my education and research from C3.ai Digital
Author: Harvill, John
Institution: University of Illinois Urbana-Champaign
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7220767620
