Table 2 Psychometric analyses used to help inform item selection (Stage 3)
Analysis | Benchmarking criteria used to determine acceptable performance |
|---|---|
Descriptives | |
Floor and ceiling effects | >5% and <40% of responses in the floor/ceiling response category |
Non-applicable/missing responses | <20% of responses are non-applicable, <5% of responses are missing (paper surveys only) |
Mokken scale analysisa | |
Coefficients of homogeneity (H) | H≥0.30 [34] |
Local independence (conditional association) | Item does not significantly violate local independence assumption [34] |
Monotonicity | Item does not significantly violate monotonicity (critical value ≥80) [35] |
IRT partial credit modelb | |
Item fit (infit and outfit) | Mean squares between 0.6 and 1.4 [36] |
Item category thresholds | Item category threshold parameters are ordered [37] |
Differential item functioning (DIF)c | Non-significant DIF (α<0.01) in logistic regression with IRT θ estimates as the conditioning variable, and McFadden R2<0.02 [38] |
Classical test theory | |
Confirmatory factor analysis, with a one-factor baseline and three-factor hypothesised model (physical, psychological, social)d | |
Cronbach’s αe | Cronbach’s α ≥0.7 [40] |
Item correlations | |
Polychoric intercorrelations between itemse | Intercorrelations between items <0.7, indicating non-redundancy [41] |
Spearman correlations between items and the hypoglycaemia-related QoL VAS (4 weeks)e | Non-trivial correlation (rs≥0.2) [42] |
Spearman correlations between items and HypoA-Q question 1 (i.e. number of hypos in the previous week)e | Non-trivial correlation (rs≥0.2) [42] |