CrimeSolutions uses rigorous research to inform practitioners and policy makers about what works in criminal justice, juvenile justice, and crime victim services. Because we set a high-bar for the scientific rigor of the evaluations we use to do this, many evaluations do not meet our criteria and we are unable to rate the evaluated program.
For the programs listed below, our reviewers determined that the available evidence was insufficient for a rating to be assigned. Programs are included in the list because of the insufficient research evidence about the program, not because of any known weaknesses in the programs themselves.
Along with each program listed are the references to the evaluation or evaluations that were reviewed and an indicator of why each study was rejected. See Reasons for Rejecting Studies.
Reasons for Rejecting Studies
Inadequate Design Quality: studies do not provide enough information or have significant limitation in the study design (for example, small sample size, threats to internal validity, high attrition rates, etc.) such that it is not possible to establish a causal relationship to the justice-related outcomes.
Limited or Inconsistent Outcome Evidence: studies are well-designed (although there may be some limitations) but showed inconsistent or mixed results such that it is not possible to determine the overall impact of the program on justice-related outcomes.
Lacked Sufficient Info on Program Fidelity: studies are rigorous and well-designed and generally show no significant effects on justice-related outcomes, but sufficient information was not provided on fidelity or adherence to the program model such that it is not possible to determine if the program was delivered as designed.
Override Option: the override option is available to study reviewers, and can be used when the reviewers feel that no confidence can be placed in the results. Reviewers must provide details for their reasoning. Examples of reasons the study reviewers may use the override option include (1) anomalous findings that contradict the intent of the program and suggest the possibility of confounding causal variables, and (2) utilization of inappropriate statistical analysis to examine the outcome data. The override option results in an automatic rejection of a study.
Updated as of 9/13/2022