Levels of Evidence for Cancer Screening and Prevention Studies (PDQ®): Screening - Health Professional Information [NCI]
This information is produced and provided by the National Cancer Institute (NCI). The information in this topic may have changed since it was written. For the most current information, contact the National Cancer Institute via the Internet web site at http://cancer.gov or call 1-800-4-CANCER
Levels of Evidence: Cancer Screening and Prevention Studies
The PDQ Screening and Prevention Editorial Board summarizes its understanding of the level of the evidence for the magnitude of the effect (including absolute and relative risks) for both the benefits and the harms of implementing cancer screening and prevention interventions. The Editorial Board uses the term "Level of Evidence" to refer to the certainty of its estimate of the health effects of implementing the intervention in question.
Varying levels of evidence support each PDQ screening or prevention summary. Evidence that indicates, within a narrow range, the direction and magnitude of the effect on health outcomes is termed "solid" evidence. Evidence that allows an estimate of the direction and magnitude of the health outcomes within a broader range, but still allows a reasonably certain estimate, is termed "fair." Evidence that allows either no estimate at all or only an estimate that is very broad is termed "inadequate".
The highest Level of Evidence ("solid") is that obtained from several well-designed and well-conducted randomized controlled trials (RCTs) in generalizable settings with generalizable populations that report evidence about both benefits and harms. It is, however, not always practical to conduct such trials to address every question within the field of screening and prevention. Thus, the PDQ Editorial Board does consider "fair" evidence in estimating the benefits and harms of an intervention in the general population. When the evidence for the benefits and/or harms of an intervention is "inadequate," the Board states this finding.
The PDQ Editorial Board evaluates evidence in 2 steps. The first step is to describe the evidence within 5 domains (see below); the second is to judge the overall "level" of evidence as "solid," "fair," or "inadequate." The Board conducts the same process separately for potential benefits and potential harms of each intervention. The PDQ Editorial Board does not explicitly assess the "net benefit" (i.e., benefits minus harms) of interventions, nor does it make recommendations.
The question at issue for the Board is to determine the direction and magnitude of important health effects from introducing the intervention into the general population. This is a question of effectiveness rather than of efficacy only, and the Board seeks evidence about effectiveness as well as efficacy. When only efficacy evidence is available, the Board must judge the additional uncertainty involved with estimating the actual health impact of widespread implementation.
Evaluation of Evidence
The two steps in evaluating evidence are described below.
|1.||DESCRIPTION OF THE EVIDENCE (The PDQ Editorial Board uses the same process for benefits and harms; the "evidence" referred to is the evidence relevant for answering the question of the magnitude of the health effects of widespread implementation.)
|2.||ASSESSMENT OF THE EVIDENCE
|1.||Harris RP, Helfand M, Woolf SH, et al.: Current methods of the US Preventive Services Task Force: a review of the process. Am J Prev Med 20 (3 Suppl): 21-35, 2001.|
Notes on Quality Assessment
|1.||SEMANTICS: One can think of the "level" of a body of evidence as the certainty of the assessment allowed from the evidence. This may also be considered as the "quality" of the evidence to address a specific question. Because the word "quality" can have other meanings (e.g., the extent to which individual studies meet given criteria), the Editorial Board prefers the word "level."|
|2.||CERTAINTY: Certainty can be considered in several ways, one of which is to use the heuristic of the "confidence interval." This "confidence interval" does not come from a statistical calculation, but is instead a "conceptual confidence interval" (CCI) representing the Editorial Board's assessment of the range of values for direction and magnitude of the effect of the intervention that is consistent with the overall evidence. This CCI is seeking to answer an effectiveness question (not simply an efficacy question). The question at issue is:
What would the health effects be if the intervention were widely implemented in routine practice? Even well-conducted RCTs may not provide "good" evidence if they are not conducted in generalizable populations, using generalizable tests and treatments. The CCI for evidence based on RCTs conducted in highly selected populations might be wide rather than narrow ("fair" as opposed to "good") unless there are reasons to believe the effects would be the same in the general population.
|3.||BENEFITS: Potential benefits include mortality reduction (and should note whether disease-specific or overall), improved quality of life, improved function, and reduced need for invasive procedures or interventions. If mortality reduction from an RCT is disease-specific with no trend toward overall mortality reduction, then the Editorial Board might consider the contribution of this disease-specific reduction to overall mortality to be less certain. As the question at issue is an all-cause mortality question, the CCI for a study of only disease-specific reduction without other indications of overall reduction may be considered wider than if there were indications of overall mortality reduction.|
|4.||HARMS: Harms may be considered in 3 categories:
|5.||EXTRAPOLATION: Estimates of the presence and magnitude of either benefits or harms may come from extrapolation from indirect evidence; the degree of extrapolation determines the CCI for each estimate. For example, evidence shows that screening for ovarian cancer results in many false-positive tests (due to the low prevalence of the disease) for which the workup is an invasive procedure. Other evidence could provide an estimate of the effects of the invasive workup, including not only complications but also the discomfort, anxiety, and time of reduced usual activity. The evidence, then, for the harms of screening is indirect (i.e., not from an RCT of screening) but would still provide at least "fair" evidence of harms (i.e., intermediate width CCI).|
|6.||JUDGMENT: Judgment is involved at several steps in this process, including the assessment of "quality" (internal validity), consistency/coherence, external validity, and the overall "level" of evidence. It is important in each case that the rationale and conclusion be as explicit and transparent as possible. The reasoning behind the judgment of the overall Level of Evidence should be stated clearly.|
Get More Information From NCI
For more information, U.S. residents may call the National Cancer Institute's (NCI's) Cancer Information Service toll-free at 1-800-4-CANCER (1-800-422-6237) Monday through Friday from 9:00 a.m. to 4:30 p.m. A trained Cancer Information Specialist is available to answer your questions.
The NCI's LiveHelp® online chat service provides Internet users with the ability to chat online with an Information Specialist. The service is available from 9:00 a.m. to 11:00 p.m. Eastern time, Monday through Friday. Information Specialists can help Internet users find information on NCI Web sites and answer questions about cancer.
WRITE TO US
For more information from the NCI, please write to this address:
|NCI Public Inquiries Office|
|6116 Executive Boulevard, MSC8322|
|Bethesda, MD 20892-8322|
SEARCH THE NCI WEB SITE
The NCI Web site provides online access to information on cancer, clinical trials, and other Web sites and organizations that offer support and resources for cancer patients and their families. For a quick search, use the search box in the upper right corner of each Web page. The results for a wide range of search terms will include a list of "Best Bets," editorially chosen Web pages that are most closely related to the search term entered.
There are also many other places to get materials and information about cancer treatment and services. Hospitals in your area may have information about local and regional agencies that have information on finances, getting to and from treatment, receiving care at home, and dealing with problems related to cancer treatment.
The NCI has booklets and other materials for patients, health professionals, and the public. These publications discuss types of cancer, methods of cancer treatment, coping with cancer, and clinical trials. Some publications provide information on tests for cancer, cancer causes and prevention, cancer statistics, and NCI research activities. NCI materials on these and other topics may be ordered online or printed directly from the NCI Publications Locator. These materials can also be ordered by telephone from the Cancer Information Service toll-free at 1-800-4-CANCER (1-800-422-6237).
Changes to This Summary (10 / 19 / 2009)
The PDQ cancer information summaries are reviewed regularly and updated as new information becomes available. This section describes the latest changes made to this summary as of the date above.
Editorial changes were made to this section.
Questions or Comments About This Summary
If you have questions or comments about this summary, please send them to Cancer.gov through the Web site's Contact Form. We can respond only to email messages written in English.
- PDQ® - NCI's Comprehensive Cancer Database.
Full description of the NCI PDQ database.
ADDITIONAL PDQ SUMMARIES
- PDQ® Cancer Information Summaries: Adult Treatment
Treatment options for adult cancers.
- PDQ® Cancer Information Summaries: Pediatric Treatment
Treatment options for childhood cancers.
- PDQ® Cancer Information Summaries: Supportive and Palliative Care
Side effects of cancer treatment, management of cancer-related complications and pain, and psychosocial concerns.
- PDQ® Cancer Information Summaries: Screening/Detection (Testing for Cancer)
Tests or procedures that detect specific types of cancer.
- PDQ® Cancer Information Summaries: Prevention
Risk factors and methods to increase chances of preventing specific types of cancer.
- PDQ® Cancer Information Summaries: Genetics
Genetics of specific cancers and inherited cancer syndromes, and ethical, legal, and social concerns.
- PDQ® Cancer Information Summaries: Complementary and Alternative Medicine
Information about complementary and alternative forms of treatment for patients with cancer.
This information is intended mainly for use by doctors and other health care professionals. If you have questions about this topic, you can ask your doctor, or call the Cancer Information Service at 1-800-4-CANCER (1-800-422-6237).
Date Last Modified: 2009-10-19