On Trial: the Compatibility of Measurement in the Physical and Social Sciences

2016 Joint IMEKO TC1-TC7-TC13 Symposium: Metrology Across the Sciences: Wishful Thinking?

Cano, S.J.^1 ; Vosk, T.^2 ; Pendrill, L.R.^3 ; Stenner, A.J.^4,5

Modus Outcomes, Spirella Building, Letchworth Garden City

SG6 4ET, United Kingdom^1

8105 NE 140th Pl, Kirkland

WA

98034, United States^2

SP Technical Research Institute of Sweden, Metrology, Box 857, Borås

SE-50115, Sweden^3

MetaMetrics, Inc., 1000 Park Forty Plaza Drive, Durham

NC, United States^4

University of North Carolina, Chapel Hill

NC

27713, United States^5

关键词: Counts-as;    Empirical data;    Measurement system;    Performance metrices;    Physical science;    Social measurement;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/772/1/012025/pdf
DOI  :  10.1088/1742-6596/772/1/012025

来源: IOP

【 摘 要 】

In this paper, we put social measurement on trial: providing two perspectives arguing why measurement in the social and in the physical sciences are incompatible and counter with two perspectives supporting compatibility. For the case 'against', we first argue that there is a lack of definition in the social sciences. Thus, while measurement in the physical sciences is supported by empirical evidence, calibrated instruments, and predictive theory that work together to test the quantitative nature of properties, measurement in the social sciences, in the main, rests on a vague, discretionary definition of measurement that places hardly any restrictions on empirical data, does not require calibrated instruments, and rarely articulates predictive theories. The second argument for the case 'against' introduces the problem associated with psychometrics, including different approaches, methodologies, criteria for success and failure, and considerations as to what counts as measurement. Making the first case 'for', we highlight practical principles for improved social measurement including units, laws, theory, and metrology. The second argument 'for' introduces the exemplar of the Lexile Framework for reading that exploits metrological principles and parallels the paths taken by, for example, thermometry. We conclude by proposing a way forward potentially applicable to both physical and social measurement, in which inferences are modelled in terms of a measurement system, where specifically the output of the instrument in response to probing the object ('entity') is a performance metric, i.e. how well the set-up performs the assessment.