How to Use the Information You Find

Description

We created CrimeSolutions to help criminal justice, juvenile justice, and crime victim service professionals better understand crime and identify program and practice solutions that address the unique needs of their communities. Here you will find tips for practitioners, policy makers, and researchers to use this information to advance justice. The tips are organized under five headings:

Improving Program Effectiveness

CrimeSolutions helps justice professionals who are not social scientists improve the effectiveness of programs. The systematic, independent review process and evidence ratings are intended to give practitioners access to social science evidence that is otherwise difficult to obtain, and serve as a basis for gauging the quality of evidence. In short, CrimeSolutions strives to help practitioners answer the questions Has it worked, and in what context?

Justice practitioners at all levels may benefit from reviewing the CrimeSolutions program profiles related to their work, even if they are not in a position to make decisions about replicating programs. Our profiles show which programs have produced positive results and which have not. This information can be shared within agencies and organizations and facilitate conversations with colleagues and superiors to explore ways to modify existing practices to better align them with evidence-based programs.

Find rated programs.

Programs rated as "Effective" and "Promising" on CrimeSolutions have produced positive results in the past. Replicating programs that have been shown to work, and that fit a community's needs, can save valuable time and resources compared to implementing untested programs that may not address the same problems as effectively. The best way to get similar positive results from evidence-based programs is to replicate them with fidelity to the original design.

Each program on CrimeSolutions includes summary information and additional resources to help you replicate the program. You should view CrimeSolutions as a starting point where you may be able to find resources such as dedicated websites, publications, implementation manuals, training materials, live training, and certifications.

Developing New Strategies

Full replication of evidence-based programs is ideal, but may not always be possible because well-tested programs do not exist for all circumstances and populations. Even some programs identified as "Promising" or "Effective" do not have detailed training materials that specify all the ways to implement them. That does not mean that you have to start from scratch when it comes to research evidence. The practice information on CrimeSolutions can help you understand the types of outcomes that have been achieved (or not achieved) by a general strategy or program type. The practice profiles point toward the specific programs that have been evaluated. The broad practice information can guide you to which types of interventions to consider.

If you are developing or enhancing a strategy for which there is not an evidence-based program, familiarize yourself with the practices on CrimeSolutions and the related programs listed on the practice profiles. In the absence of evidence-based programs, this broader information can help identify the types of programs that are more and less likely to work on the problems you are facing.

Find rated practices.

Rather than build a new program from scratch, practitioners may choose to use tested programs as a foundation and make as few adjustments as possible to increase the chances that the modified program will succeed. Such modifications can be very helpful to others in the field when they are carefully documented and paired with rigorous evaluation. In these cases, adaptation and innovation help generate new evidence about programs' and practices' effectiveness.

We recommend you review the NIJ Journal article Plan for Program Evaluation from the Start.

Funding Decisions

If you are in a position to influence funding, CrimeSolutions can help you make informed decisions.

Investing in programs and practices with demonstrated track records makes sense regardless of whether funding comes from public or private sources. Similarly, it makes sense to carefully review and possibly discontinue programs and practices when evidence shows they have failed to produce their intended results. "Effective" programs and practices are particularly suitable for replication, especially when they come with strong training materials. However, policymakers with funding responsibilities should take care not to oversimplify their task: CrimeSolutions may be used as one factor in determining worthy and unworthy investments, but only as one factor among many.

We encourage policy makers who find resources like CrimeSolutions useful to recognize the innovative practitioners who are striving to solve problems every day and the social scientists who help produce the evidence. These innovators require ongoing support so they can develop new evidence-based programs and practices. Funders can contribute to the growing body of evidence-based programs by pairing funding for innovative and untested approaches with rigorous evaluation.

Informing Training

CrimeSolutions aims to create demand for programs and practices with proven results. The profiles on this site provide basic information and resources, but these may not be enough for practitioners to fully learn and replicate.

Training and technical assistance providers can provide benefits to the field by developing materials such as logic models, implementation guides, and manuals for evidence-based programs. Online, open-access materials, and training are particularly beneficial to practitioners in public agencies and organizations who often work in tight budget environments.

Informing Research

Social scientists play an essential role in identifying evidence to inform practitioners and policy makers about what is, and is not, effective.

CrimeSolutions evidence standards are described in the program and practice scoring instruments, and may be useful points of reference during the program evaluation design phase. We developed the evidence standards for CrimeSolutions in consultation with a wide range of social scientists in the justice field. We encourage program evaluators to implement the strongest designs possible for producing causal evidence.

Many programs we have deemed "Promising" are widely used in the field, and improving the body of evidence on these programs is particularly helpful. Social scientists highly committed to helping practitioners identify and use evidence-based programs can make a valuable scientific contribution by replicating a prior evaluation using stronger methods.

Find promsing programs.

We use rigorous research to inform you about what works in criminal justice, juvenile justice and crime victim services. We set a high bar for the scientific quality of the evidence used to assign ratings. Much of the evidence that we identify is screened out before going to review or upon review is determined to be inconclusive and we are unable to assign a rating.

Review the following lists:

  • Screened out programs - programs for which the associated evaluations were screened out during the initial review. 
  • Inconclusive programs - programs for which our reviewers determined that the available evidence was insufficient for a rating to be assigned.
  • Screened out practices - practices for which the associated meta-analyses were screened out during the initial review. 
  • Inconclusive practices - practices for which our reviewers determined that the available evidence was insufficient for a rating to be assigned.

General Tips for Users

The extent and quality of effective evidence varies considerably across topic areas within criminal justice, juvenile justice, and crime victim services. The availability of evidence in a topic area is not based on the importance or the extent of activity in that area, but is more likely to be based on factors related to the capacity to conduct social science evaluation in that area. The presence or absence of evidence in a particular topic area does not indicate whether activities in that topic area are more or less effective than those in another.

Although CrimeSolutions continues to review evidence and add profiles for programs and practices, there remains social science evidence within criminal justice, juvenile justice, and crime victim services that CrimeSolutions has not yet reviewed. Users of this resource should not view CrimeSolutions as a complete body of social science evidence within justice systems. A list of programs that have been reviewed, but not rated can be found here. We also allow repeals of a given rating.

A program or practice is considered "evidence-based" if it has been found to produce its intended results based on rigorous social science evaluation. Many other notable lines of activity associated with terms like "data-driven" or "research-based" may sound the same, but programs and practices that have not been subjected to rigorous evaluation cannot be called evidence-based. Become an educated consumer and user of these terms to help advance the cause of truly evidence-based programs and practices.

Date Created: June 26, 2020