Measurement error is an inherent and unavoidable component of nonsampling error in surveys, and its estimation is essential for assessing the quality of survey results. This paper investigates two agreement criteria, Cohen’s Kappa and Gwet’s AC1, for quantifying measurement error in binary survey data. A theoretical comparison is first presented to highlight the conceptual differences between the two coefficients. This is followed by a simulation study in which true binary values are generated under varying prevalence levels, and observed responses are obtained through controlled misclassification mechanisms characterized by specified levels of observed agreement. The performance and empirical variances of both agreement measures are evaluated and the results demonstrate that Gwet’s AC1 provides more stable agreement estimates and variance behavior than Cohen’s Kappa, particularly under conditions of extreme prevalence.
alimohammadi, R. (2025). Estimation of measurement error in binary data in surveys. Journal of Statistical Modelling: Theory and Applications, 6(1), 185-192. doi: 10.22034/jsmta.2026.23540.1189
MLA
alimohammadi, R. . "Estimation of measurement error in binary data in surveys", Journal of Statistical Modelling: Theory and Applications, 6, 1, 2025, 185-192. doi: 10.22034/jsmta.2026.23540.1189
HARVARD
alimohammadi, R. (2025). 'Estimation of measurement error in binary data in surveys', Journal of Statistical Modelling: Theory and Applications, 6(1), pp. 185-192. doi: 10.22034/jsmta.2026.23540.1189
CHICAGO
R. alimohammadi, "Estimation of measurement error in binary data in surveys," Journal of Statistical Modelling: Theory and Applications, 6 1 (2025): 185-192, doi: 10.22034/jsmta.2026.23540.1189
VANCOUVER
alimohammadi, R. Estimation of measurement error in binary data in surveys. Journal of Statistical Modelling: Theory and Applications, 2025; 6(1): 185-192. doi: 10.22034/jsmta.2026.23540.1189
)