Work

A smart toy system to educate children with autism: A comparison of tree-structured programming and machine learning models for an IoT device

Year: 2024
Type: dissertation
Abstract: In this study, we examine the question of individualized versus average learning using a toy that allows children with mild autism to play color-matching games and math games.The toy was first configured with a decision tree that was the same for the first group of 16 participants.The toy was then reconfigured to use a machine learning (ML) system that customized the experience for each member of the second group of 16 participants.The toy was equipped with a number of sensors that were used by both groups to support the decision as to whether the student should get the next question that was easier, the same level, or harder than the previous question.The sensors included force sensors on the buttons, an accelerometer in the circuit board, and an internal clock to track duration.The other features were captured using cloud service for the Internet of Things (IoT) broker MQTT, which captures performance, difficulty level, and "frustration score," which is the basis for one of the software's predictions.The broker also controls the LED's used for the math and color sequence game.One purpose of the individualized levels of difficulty is to help maintain engagement.It is among the most critical aspects of understanding how people learn.Engaging in a subject is the first step toward learning because it can motivate, stimulate, and instigate a cycle of observing and applying the results of new knowledge and applying it again.It is the precursor to when learning is about to happen or currently taking place.If a student's level of engagement is lost, so is the possibility of learning.This is often due to the targeted level of the information not hitting the audience when they need it.It is hard to struggle through if the information is too dense or complex.Too easy of a task becomes mundane and uninteresting.Learning a subject is often abandoned unless there is something to regain their interest and willingness to return to the subject.These scenarios become even more frustrating if you have autism.Autism spectrum disorder is a mixed array of challenges that are not the same in every individual and to a greater or lesser degree between people.A teaching aid that adjusts to each child's learning level is at the center of this study, and it attempts to capture the information needed to make these adjustments and improve the learning experience for children with autism.This study aims to determine if an educational toy can predict when levels of engagement are such that learning is probable or if it is necessary to re-engage the learner by making the problem less complex, for example.Understanding engagement from a psychological perspective often takes the form of a mental model to construct what is available to a student through perception stimuli, internal motivation, and the ability to assess the problem and other cognitive triggers.Evaluation of the model's mix of complex cognitive triggers only provides the potential for successful learning but does not measure the outcome to see if learning occurred.In this study, an intelligent toy captures physical and cognitive manifestations and Research Question 1: Can we capture patterns of learning using machine learning to understand and mitigate the problems surrounding personalized learning environments to provide a customized educational tool?This question presupposes that there are definite patterns that can be trained and predicted to accommodate individuals.The patterns inform a reasonable prediction as to whether a student is ready for a more difficult, equally difficult, or less difficult question than the previous one provided.Research Question 2: How does the tree-structure's pre-prediction approach compare with machine learning prediction of question difficulty?Research Question 3: From the features selected (duration, pressure, motion, difficulty, and performance,) are these useful data points to use?Research Question: 4 How well can ML predict suitable changes to game level difficulty?(i.e Toy Performance)Research Question: 5 Can ML improve performance scores over tree structured programming?To address this set of questions, I have designed and constructed three experimental prototypes: a paper prototype, a predetermined prediction prototype called the tree-structured prototype -based on the structure encoded in the programming -and a smart toy that uses machine learning to make predictions about the difficulty of the next question to ask.Right Answer: 16 Wrong Answer: 3*** Non-attempts; 1 Can You Explain How to Play? Yes Was it accurate?Yes Correctly ID Change: Yes Changed Back: Yes Turn it on and off, press button 3 sec.
Language: English
Open Access status: green
OpenAlex ID: W7220792660
Cites: 159
Cited by: 1
Related to: 10