Yıl 2017, Cilt 8, Sayı 4, Sayfalar 391 - 403 2017-12-28

The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model

Miao GAO [1] , M. David MILLER [2] , Ren LIU [3]

117 135

This simulation study investigated the impact of Q-matrix misspecification and model misuse on examinees’ classification accuracy within the generalized deterministic input, noisy “and” gate (G-DINA) model framework under various conditions. The data was generated in the saturated G-DINA model. Along with the generating model, two reduced models were used to fit the data: the additive CDM (A-CDM) and DINA model. The manipulated conditions included: number of respondents, attribute correlations and test length. Two types of classification accuracy were examined: the overall classification accuracy and the class-specific classification accuracy. Results showed that the Q-matrix misspecification influenced classification accuracy more ominously than model misuse. The proportion of examinees classified correctly for each latent class was related to the types of Q-matrix misspecification. More test items had greater positive impact on classification accuracy than more respondents taking the test.

This simulation study explored the impact of Q-matrix misspecification and model misuse on examinees’ classification accuracy within the generalized deterministic input, noisy “and” gate (G-DINA) model framework under the different conditions. The data was generated by saturated G-DINA model. Along with the generating model, two reduced models were used to fit the data: the additive CDM (A-CDM) and DINA model. The manipulated conditions included number of respondents, attribute correlations and test length. Two types of classification accuracy were examined: the overall classification accuracy and the class-specific classification accuracy. Results showed that the Q-matrix misspecification influenced classification accuracy more ominously than model misuse. The proportion of examinees classified correctly for each latent class was related to the types of Q-matrix misspecification. More test items had greater positive impact on classification accuracy than more respondents taking the test.

  • Henson, R., Roussos, L., Douglas, J., & He, X. (2008). Cognitive diagnostic attribute-level discrimination indices. Applied Psychological Measurement, 32(4), 275-288.
Konular Sosyal ve Beşeri Bilimler
Yayımlanma Tarihi Kış
Dergi Bölümü Makaleler
Yazarlar

Orcid: 0000-0001-6842-5468
Yazar: Miao GAO
Kurum: Nanjing Normal University
Ülke: China


Orcid: 0000-0002-3506-1167
Yazar: M. David MILLER
Kurum: University of Florida
Ülke: United States


Orcid: 0000-0002-6708-4996
Yazar: Ren LIU
Kurum: University of Florida
Ülke: United States


Bibtex @araştırma makalesi { epod332712, journal = {Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi}, issn = {1309-6575}, eissn = {1309-6575}, address = {Eğitimde ve Psikolojide Ölçme ve Değerlendirme Derneği}, year = {2017}, volume = {8}, pages = {391 - 403}, doi = {10.21031/epod.332712}, title = {The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model}, key = {cite}, author = {LIU, Ren and GAO, Miao and MILLER, M. David} }
APA GAO, M , MILLER, M , LIU, R . (2017). The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model. Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi, 8 (4), 391-403. DOI: 10.21031/epod.332712
MLA GAO, M , MILLER, M , LIU, R . "The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model". Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi 8 (2017): 391-403 <http://dergipark.gov.tr/epod/issue/33228/332712>
Chicago GAO, M , MILLER, M , LIU, R . "The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model". Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi 8 (2017): 391-403
RIS TY - JOUR T1 - The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model AU - Miao GAO , M. David MILLER , Ren LIU Y1 - 2017 PY - 2017 N1 - doi: 10.21031/epod.332712 DO - 10.21031/epod.332712 T2 - Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi JF - Journal JO - JOR SP - 391 EP - 403 VL - 8 IS - 4 SN - 1309-6575-1309-6575 M3 - doi: 10.21031/epod.332712 UR - http://dx.doi.org/10.21031/epod.332712 Y2 - 2017 ER -
EndNote %0 Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model %A Miao GAO , M. David MILLER , Ren LIU %T The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model %D 2017 %J Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi %P 1309-6575-1309-6575 %V 8 %N 4 %R doi: 10.21031/epod.332712 %U 10.21031/epod.332712
ISNAD GAO, Miao , MILLER, M. David , LIU, Ren . "The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA Model". Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi 8 / 4 (Aralık 2017): 391-403. http://dx.doi.org/10.21031/epod.332712