Year: 2016
Type: dissertation
Abstract: Nothing in life is to be feared, it is only to be understood. Now is the time to understand more, \nso that we may fear less. \nMarie Curie \nDebates about how best to test people from different contexts and backgrounds \ncontinue to hold the spotlight of testing and assessment. In an effort to contribute to \nthe debates, the purpose of the study was to develop and evaluate the viability and \nutility of nonverbal figural reasoning ability items that were developed based on \ninspirations from African cultural artefacts such as African material prints, art, \ndecorations, beadwork, paintings, et cetera. The research was conducted in two \nphases, with phase 1 focused on the development of the new items, while phase 2 \nwas used to evaluate the new items. The aims of the study were to develop items \ninspired by African art and cultural artefacts in order to measure general nonverbal \nfigural reasoning ability; to evaluate the viability of the items in terms of their \nappropriateness in representing the African art and cultural artefacts, specifically to \ndetermine the face and content validity of the items from a cultural perspective; and \nto evaluate the utility of the items in terms of their psychometric properties. \nThese elements were investigated using the exploratory sequential mixed method \nresearch design with quantitative embedded in phase 2. For sampling purposes, the \nsequential mixed method sampling design and non-probability sampling strategies \nwere used, specifically the purposive and convenience sampling methods. The data \ncollection methods that were used included interviews with a cultural expert and \ncolour-blind person, open-ended questionnaires completed by school learners and \ntest administration to a group of 946 participants undergoing a sponsored basic \ncareer-related training and guidance programme. Content analysis was used for the \nqualitative data while statistical analysis mainly based on the Rasch model was \nutilised for quantitative data. \nThe results of phase 1 were positive and provided support for further development of \nthe new items, and based on this feedback, 200 new items were developed. This \nfinal pool of items was then used for phase 2 – the evaluation of the new items. The \nv \nstatistical analysis of the new items indicated acceptable psychometric properties of \nthe general reasoning (“g” or fluid ability) construct. The item difficulty values (pvalues) \nfor the new items were determined using classical test theory (CTT) analysis \nand ranged from 0.06 (most difficult item) to 0.91 (easiest item). Rasch analysis \nshowed that the new items were unidimensional and that they were adequately \ntargeted to the level of ability of the participants, although there were elements that \nwould need to be improved. The reliability of the new items was determined using \nthe Cronbach alpha reliability coefficient (α) and the person separation index (PSI), \nand both methods indicated similar indices of internal consistency (α = 0.97; PSI = \n0.96). Gender-related differential item functioning (DIF) was investigated, and the \nmajority of the new items did not indicate any significant differences between the \ngender groups. Construct validity was determined from the relationship between the \nnew items and the Learning Potential Computerised Adaptive Test (LPCAT), which \nuses traditional item formats to measure fluid ability. The correlation results for the \ntotal score of the new items and the pre- and post-tests were 0.616 and 0.712 \nrespectively. The new items were thus confirmed to be measuring fluid ability using \nnonverbal figural reasoning ability items. Overall, the results were satisfactory in \nindicating the viability and utility of the new items. \nThe main limitation of the research was that because the sample was not \nrepresentative of the South African population, there were limited for generalisation. \nThis led to a further limitation, namely that it was not possible to conduct important \nanalysis on DIF for various other subgroups. Further research has been \nrecommended to build on this initiative.
Author: Nomvuyo Nomfusi Bekwa
Language: English
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W2786541376