| Dimensions | Items |
|---|---|
|
Reach Reach refers to the absolute number, proportion, and representativeness of individuals who are willing to participate in a given initiative, intervention, or program |
|
| Exclusion Criteria (percentage and characteristics) | 1) How many potential participants were approached? |
| 2) How many participants were deemed ineligible to participate? | |
| 3) Of the participants meeting selection criteria, how many participants actually participated? | |
| Percentage on the Valid Denominator | 4) Was the percentage of all eligible invited participants who accepted participation reported? If not, can the percentage be calculated? |
| Characteristics of Participants Compared With Nonparticipants | 5) Were the characteristics of those subjects choosing to participate and those unwilling to participate described? If yes, what was the representativeness of those who participated versus those who did not? Comparisons can be made with either nonparticipants or available resource data. |
|
Effectiveness Effectiveness refers to the impact of an intervention on important outcomes, including potential negative effects, quality of life, and economic outcomes. |
|
| Measure of the Effect Size | 6) Were effect sizes for significant outcomes provided or can they be calculated? |
| Measure of Quality of Life or Potential Negative Outcome | 7) Were there any qualitative or quantitative measures of quality of life or potential negative outcome? |
| Measure of Robustness Across Subgroups | 8) Were any within-groups analyses conducted that allowed researchers to draw conclusions about how different subpopulations responded to an arm of the design? |
|
Adoption Adoption refers to the absolute number, proportion, and representativeness of settings and intervention agents (people who deliver the program) who are willing to initiate a program. |
|
| Setting Exclusion (percentage and reasons) | 9) How many settings in a given population were actually qualified to host the intervention? |
| 10) Among the settings that were approached about hosting the intervention, how many settings were interested in participating? | |
| 11) How many settings were not appropriate for the study? | |
| 12) How many settings met criteria and chose to participate? | |
| Percentage of Settings Approached (Valid Denominator) | 13) What percentage of the total number of available settings actually participated? |
| Characteristics of Participating Settings Compared With Nonparticipating Settings | 14) Were the characteristics of those settings choosing to participate and those unwilling to participate described? If yes, what was the representativeness of those that participated versus those that did not? Comparisons can be made with either nonparticipating settings or available resource data. |
|
Implementation At the setting level, implementation refers to the intervention agents' fidelity to the various elements of an intervention's protocol, including consistency of delivery as intended and the time and cost of the intervention. At the individual level, implementation refers to clients' use of the intervention strategies. |
|
|
Percent of Perfect Delivery
(Implementation Fidelity) |
15) Were there measures (preferably statistical but also observational) indicating that Agent A and Agent B delivered the same amount/type of intervention? |
| 16) Were the methods of intervention delivery described? | |
| 17) Were there any measures of the actual number of intervention pieces that were delivered (e.g., an average or percentage)? | |
| Adaptation | 18) Was the intervention changed or modified in any way during the course of the study? |
| Cost of Intervention | 19) Was any information provided on the total time commitment required to implement the intervention? |
| 20) Was any information provided on the type of staff needed to implement the intervention? | |
| 21) Was any information provided on the cost of the intervention? Was information provided on the actual or estimated cost difference between the intervention and the control condition? | |
| 22) Was any cost-effectiveness or cost-benefit analysis done to determine the economic soundness of the intervention? | |
Updated: 09/04/2013