Assessing the test-retest reliability of the social value orientation slider measure

Project info

Work package
  • Theory
Sustainability threat
  • External Shocks
Challenge
  • Network co-evolution

Study info

Description of Study
Decades of research show that (i) social value orientation (SVO) is related to important behavioral outcomes such as cooperation and charitable giving, and (ii) individuals differ in terms of SVO. A prominent scale to measure SVO is the social value orientation slider measure (SVOSM). The central premise is that SVOSM captures a stable trait. But it is unknown how reliable the SVOSM is over repeated measurements more than one week apart. To fill this knowledge gap, we followed a sample of N = 495 over 6 months with monthly SVO measurements. We find that continuous SVO scores are similarly distributed (Anderson-Darling k-sample p = 0.57) and highly correlated (r ≥ 0.66) across waves. The intra-class correlation coefficient of 0.78 attests to a high test-retest reliability. Using multilevel modeling and multiple visualizations, we furthermore find that one’s prior SVO score is highly indicative of SVO in future waves, suggesting that the slider measure consistently captures one’s SVO. Our analyses validate the slider measure as a reliable SVO scale.
Study research question
To what degree are social value orientations stable and reliable over time?
Collection provenance
  • Collected during project
  • -
Collection methods
  • Questionaire
  • Longitudinal survey
Personal data
Yes
External Source
Source description
Subset of the LISS sample
File formats
  • .RData
  • .R
  • .PDF
  • .eps
Data types
  • Structured
Languages
  • Dutch
Coverage start
Coverage end
01/01/2021
30/06/2021
Spatial coverage
Netherlands
Collection period start
01/01/2021
Collection period end
30/06/2021

Variables

Unit
Unit description
Sample size
Sampling method
Individuals
Panel members of the LISS panel
495
Random sampling
Hypothesis
Theory
SVOs are reliable over time
SVO theory
Variable type
Variable name
Variable description
Dependent variable
stability of SVO
Whether a respondent changed (1) or not (0) in SVO
Independent variable
SVO category
Whether a respondent orientates prosocial, altruistic, individualistic, competitive
Other
SVO continuous score
Score of a respondent on SVO
Independent variable
Wave
Each data collection wave, 1-6
Independent variable
SVO dichotomous type
Respondents are either classified as prosocial or proself
Discipline-specific operationalizations
Conflict of interest
None

Data packages

Test-Retesting the Social Value Orientation Slider Measure

Description
We analyze six monthly waves to assess the test-retest reliability of the Social Value Orientation Slider Measure (SVOSM). Several analyses are conducted showing how the SVOSM is stable and reliable over a 6-month period.
Accessibility
Restricted Access
Repository
OSF
User license
MIT License
Retention period
10

Publications

Assessing the test-retest reliability of the social value orientation slider measure

de Matos Fernandes, Carlos A., Bakker, Dieko M., and Dijkstra, Jacob. (2022). Assessing the test-retest reliability of the social value orientation slider measure. Judgment and Decision Making, 17(1), 31-49, http://journal.sjdm.org/21/211119/jdm211119.pdf.

Documents

Filename
Description
Date
2022-02-09 10:11:58

Ethics

Ethical assessment
Yes
Ethical committee
Ethical Committee of the Department of Sociology at the University of Groningen