Validating Quantitative Measurement Using Qualitative Data: Combining Rasch Scaling and Latent Semantic Analysis in Psychiatry

2014 Joint IMEKO TC1-TC7-TC13 Symposium: Measurement Science Behind Safety and Security

Lange, Rense^1,2

Integrated Knowledge Systems, Inc., 107 Carefree Drive, Chatham

IL

62629, United States^1

ISLA, Rua Cabo Borges, 55, Vila Nova de Gaia

4430-646, Portugal^2

关键词: Data sample;    High-dimensional;    Intensity levels;    Latent Semantic Analysis;    Qualitative data;    Quantitative measurement;    Quantitative measures;    Semantic Space;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/588/1/012028/pdf
DOI  :  10.1088/1742-6596/588/1/012028

来源: IOP

【 摘 要 】

An extension of concurrent validity is proposed that uses qualitative data for the purpose of validating quantitative measures. The approach relies on Latent Semantic Analysis (LSA) which places verbal (written) statements in a high dimensional semantic space. Using data from a medical / psychiatric domain as a case study-Near Death Experiences, or NDE-we established concurrent validity by connecting NDErs qualitative (written) experiential accounts with their locations on a Rasch scalable measure of NDE intensity. Concurrent validity received strong empirical support since the variance in the Rasch measures could be predicted reliably from the coordinates of their accounts in the LSA derived semantic space (R20.33). These coordinates also predicted NDErs age with considerable precision (R20.25). Both estimates are probably artificially low due to the small available data samples (n 588). It appears that Rasch scalability of NDE intensity is a prerequisite for these findings, as each intensity level is associated (at least probabilistically) with a well- defined pattern of item endorsements.