Credibility of subgroup analyses by socioeconomic status in public health intervention evaluations

an underappreciated problem?

Greig Inglis, Daryll Archibald, Lawrence Doi, Yvonne Laird, Stephen Malden, Louise Marryat, John McAteer, Jan Pringle, John Frank*

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

There is increasing interest amongst researchers and policy makers in identifying the effect of public health interventions on health inequalities by socioeconomic status (SES). This issue is typically addressed in evaluation studies through subgroup analyses, where researchers test whether the effect of an intervention differs according to the socioeconomic status of participants. The credibility of such analyses is therefore crucial when making judgements about how an intervention is likely to affect health inequalities, although this issue appears to be rarely considered within public health. The aim of this study was therefore to assess the credibility of subgroup analyses in published evaluations of public health interventions. An established set of 10 credibility criteria for subgroup analyses was applied to a purposively sampled set of 21 evaluation studies, the majority of which focussed on healthy eating interventions, which reported differential intervention effects by SES. While the majority of these studies were found to be otherwise of relatively high quality methodologically, only 8 of the 21 studies met at least 6 of the 10 credibility criteria for subgroup analysis. These findings suggest that the credibility of subgroup analyses conducted within evaluations of public health interventions’ impact on health inequalities may be an underappreciated problem.
Original languageEnglish
Pages (from-to)245-251
Number of pages7
JournalSSM - Population Health
Volume6
Early online date19 Oct 2018
DOIs
Publication statusPublished - 31 Dec 2018
Externally publishedYes

Fingerprint

Social Class
Public Health
Health
Research Personnel
Administrative Personnel

Keywords

  • Equity and public health interventions
  • Health inequalities
  • Health inequities
  • Policy impact by socioeconomic status

Cite this

Inglis, Greig ; Archibald, Daryll ; Doi, Lawrence ; Laird, Yvonne ; Malden, Stephen ; Marryat, Louise ; McAteer, John ; Pringle, Jan ; Frank, John. / Credibility of subgroup analyses by socioeconomic status in public health intervention evaluations : an underappreciated problem?. In: SSM - Population Health. 2018 ; Vol. 6. pp. 245-251.
@article{80550e0d17bc4d3e8efb735edcc933dd,
title = "Credibility of subgroup analyses by socioeconomic status in public health intervention evaluations: an underappreciated problem?",
abstract = "There is increasing interest amongst researchers and policy makers in identifying the effect of public health interventions on health inequalities by socioeconomic status (SES). This issue is typically addressed in evaluation studies through subgroup analyses, where researchers test whether the effect of an intervention differs according to the socioeconomic status of participants. The credibility of such analyses is therefore crucial when making judgements about how an intervention is likely to affect health inequalities, although this issue appears to be rarely considered within public health. The aim of this study was therefore to assess the credibility of subgroup analyses in published evaluations of public health interventions. An established set of 10 credibility criteria for subgroup analyses was applied to a purposively sampled set of 21 evaluation studies, the majority of which focussed on healthy eating interventions, which reported differential intervention effects by SES. While the majority of these studies were found to be otherwise of relatively high quality methodologically, only 8 of the 21 studies met at least 6 of the 10 credibility criteria for subgroup analysis. These findings suggest that the credibility of subgroup analyses conducted within evaluations of public health interventions’ impact on health inequalities may be an underappreciated problem.",
keywords = "Equity and public health interventions, Health inequalities, Health inequities, Policy impact by socioeconomic status",
author = "Greig Inglis and Daryll Archibald and Lawrence Doi and Yvonne Laird and Stephen Malden and Louise Marryat and John McAteer and Jan Pringle and John Frank",
year = "2018",
month = "12",
day = "31",
doi = "10.1016/j.ssmph.2018.09.010",
language = "English",
volume = "6",
pages = "245--251",
journal = "SSM - Population Health",
issn = "2352-8273",
publisher = "Elsevier B.V.",

}

Credibility of subgroup analyses by socioeconomic status in public health intervention evaluations : an underappreciated problem? / Inglis, Greig; Archibald, Daryll; Doi, Lawrence; Laird, Yvonne; Malden, Stephen; Marryat, Louise; McAteer, John; Pringle, Jan; Frank, John.

In: SSM - Population Health, Vol. 6, 31.12.2018, p. 245-251.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Credibility of subgroup analyses by socioeconomic status in public health intervention evaluations

T2 - an underappreciated problem?

AU - Inglis, Greig

AU - Archibald, Daryll

AU - Doi, Lawrence

AU - Laird, Yvonne

AU - Malden, Stephen

AU - Marryat, Louise

AU - McAteer, John

AU - Pringle, Jan

AU - Frank, John

PY - 2018/12/31

Y1 - 2018/12/31

N2 - There is increasing interest amongst researchers and policy makers in identifying the effect of public health interventions on health inequalities by socioeconomic status (SES). This issue is typically addressed in evaluation studies through subgroup analyses, where researchers test whether the effect of an intervention differs according to the socioeconomic status of participants. The credibility of such analyses is therefore crucial when making judgements about how an intervention is likely to affect health inequalities, although this issue appears to be rarely considered within public health. The aim of this study was therefore to assess the credibility of subgroup analyses in published evaluations of public health interventions. An established set of 10 credibility criteria for subgroup analyses was applied to a purposively sampled set of 21 evaluation studies, the majority of which focussed on healthy eating interventions, which reported differential intervention effects by SES. While the majority of these studies were found to be otherwise of relatively high quality methodologically, only 8 of the 21 studies met at least 6 of the 10 credibility criteria for subgroup analysis. These findings suggest that the credibility of subgroup analyses conducted within evaluations of public health interventions’ impact on health inequalities may be an underappreciated problem.

AB - There is increasing interest amongst researchers and policy makers in identifying the effect of public health interventions on health inequalities by socioeconomic status (SES). This issue is typically addressed in evaluation studies through subgroup analyses, where researchers test whether the effect of an intervention differs according to the socioeconomic status of participants. The credibility of such analyses is therefore crucial when making judgements about how an intervention is likely to affect health inequalities, although this issue appears to be rarely considered within public health. The aim of this study was therefore to assess the credibility of subgroup analyses in published evaluations of public health interventions. An established set of 10 credibility criteria for subgroup analyses was applied to a purposively sampled set of 21 evaluation studies, the majority of which focussed on healthy eating interventions, which reported differential intervention effects by SES. While the majority of these studies were found to be otherwise of relatively high quality methodologically, only 8 of the 21 studies met at least 6 of the 10 credibility criteria for subgroup analysis. These findings suggest that the credibility of subgroup analyses conducted within evaluations of public health interventions’ impact on health inequalities may be an underappreciated problem.

KW - Equity and public health interventions

KW - Health inequalities

KW - Health inequities

KW - Policy impact by socioeconomic status

U2 - 10.1016/j.ssmph.2018.09.010

DO - 10.1016/j.ssmph.2018.09.010

M3 - Article

VL - 6

SP - 245

EP - 251

JO - SSM - Population Health

JF - SSM - Population Health

SN - 2352-8273

ER -