Centers for Disease Control and Prevention
Centers for Disease Control and Prevention
Centers for Disease Control and Prevention CDC Home Search CDC CDC Health Topics A-Z    
Office of Genomics and Disease Prevention  
Office of Genomics and Disease Prevention


Evaluating Human Genome Epidemiology Studies

Genetic Test Evaluation:
Information Needs of Clinicians, Policy-Makers and the Public

Print Version

Wylie Burke1, David Atkins2, Marta Gwinn3, Alan Guttmacher4, James Haddow5, Joseph Lau6, Glenn Palomaki5, Nancy Press7, C. Sue Richards8, Louise Wideroff9, Georgia L. Wiesner10

1 Epidemiology Group, Department of Medicine & Therapeutics, University of Aberdeen, Scotland
2 Sunrise Medical Laboratory, Hauppauge, New York
3 University of Texas Health Science Center at Houston, Houston, TX
4 Office of Genetics & Disease Prevention, Centers for Disease Control & Prevention, Atlanta, GA
5 Graduate School of Public Health, Department of Epidemiology, Pittsburgh, PA
6 National Heart, Lung and Blood Institute, Bethesda, MD
7 Division of Cancer Epidemiology and Genetics, National Cancer Institute, Bethesda, MD
8 Division of Clinical Care Research, New England Medical Center, Boston, MA
9 Epidemiology Program Office, Centers for Disease Control & Prevention, Atlanta, GA
10 Ospedale Policlinico IRCCS, Milano, Italy

This paper represents consensus from the CDC-NIH Human Genome Epidemiology Workshop, January, 2001.


Introduction

Understanding the genetics of human health typically begins with the identification of genetic variants associated with specific diseases. Epidemiological studies play a key role in identifying these associations. Assigning causality can be difficult, however, because of the multifactorial nature of most diseases. Even when a genetic mutation conferring increased risk is present, health outcomes may be influenced by a variety of environmental exposures, behaviors and other genes, and interaction between some or all etiologic factors may occur. The analytic complexity posed by multifactorial disease is the subject of the two other papers in this series (1,2). The present paper considers the information needs that arise when a genetic risk is sufficiently established that its assessment is considered in clinical or public health practice – that is, the point at which information about a gene-disease association becomes the basis for a genetic test.

All of the issues discussed by Little et al. (1)and Hunter et al (2), concerning the interpretation of gene-disease associations, and gene-gene and gene-environment interactions, remain relevant at this transition point, because they influence the interpretation of test results. However, a new issue arises when a genetic test is considered for clinical or public health use: whether the test provides a health benefit.

Because benefit can be evaluated only in the context of specific health outcomes, the starting point for considering the use of a genetic test is a well-defined clinical problem, for which the test is expected to improve care. The test may help direct work-up or management of a clinical problem, identify candidates for specific interventions, or provide diagnostic or prognostic information. In particular, genetic testing is expected to provide unparalleled new opportunities for the prevention of disease and adverse drug reactions, through the identification of people with genetic susceptibilities (3,4).

Over the next decade a growing number of genetic tests will be marketed to clinicians, as a result of expanding genetic knowledge. Many of these new tests will use DNA-based technology, but any laboratory test used primarily to identify an inherited condition is considered a genetic test (5). More than eight hundred genetic tests are currently available or in research development (GeneTests-GeneClinics; www.geneclinics.org). Although most currently available tests are for rare diseases, tests to identify inherited risk for common diseases such as breast and colorectal cancer, thromboembolism, Alzheimer Disease, and coronary heart disease have been developed.

As new genetic tests become available, policy makers, clinicians, and the public will need to make decisions about test use. New tests are likely to vary in their predictive value, their potential to direct prevention or treatment efforts, and their personal and social consequences. Therefore, the task of determining the appropriate use for a given test will require careful consideration of a variety of factors. In developing practice guidelines, different professional organizations, agencies and health care systems will utilize a range of methodologies to evaluate evidence and reach final decisions about the indications for test use
(6-8). Guidelines procedures also vary in their consideration of costs and other social issues, in part because of differences in health care priorities and resources in different health care settings. However, all practice guidelines procedures require clear and accurate information about the test under consideration. In addition, the appropriate implementation of most practice guidelines involves clinical judgment and consideration of patient preferences; thus clinicians and patients also need accessible and accurate information about genetic test properties. To aid policy makers, clinicians and the public in the prudent use of new genetic tests, we propose a standardized approach to reporting the data defining test properties. Our discussion of the issues to be addressed in the reporting process is illustrated by examples of genetic tests with high and low predictive value.


PKU: High expectations for improved prevention

Newborn screening for phenylketonuria (PKU) represents a model for the use of genetic testing for disease prevention. This public health genetics program identifies newborns with PKU, a rare genetic condition in which failure to metabolize dietary phenylalanine leads to severe mental retardation. When affected newborns are provided with a phenylalanine-restricted, tyrosine-supplemented d, mental retardation can be prevented. To a large extent, the current enthusiasm for genetic testing derives from the belief that similar benefits may occur with the use of predictive genetic tests for a wide array of other diseases. 

The success of newborn screening for PKU can be attributed to four factors: a reliable and accurate screening process; a readily identifiable population for screening; an effective treatment for those who test positive; and timely initiation of treatment (9).The current PKU screening protocol, which includes follow-up testing for confirmation after an initial elevated phenylalanine level, leads to highly sensitive and specific identification of children with PKU.  However, initial screening efforts did not have this level of accuracy.  In the initial phases of PKU screening, some children with moderate phenylalanine elevations were classified as affected and suffered adverse consequences from a phenylalanine restricted diet (10).

Further, although the phenylalanine restricted diet is effective in preventing mental retardation, it is not without burdens.  Children must be taught to avoid many common foods and to adhere to a diet that is not palatable to most people.  Social burdens are involved; a child with PKU must be taught to avoid the hamburgers and ice cream that may be offered at a friend’s house and to handle the inevitable explanations.  Education and follow-up are needed to enhance compliance, with special attention to the transition to self-management that occurs in adolescence.  In addition, subsidized programs for disadvantaged families are necessary to ensure that the diet is available to all newborns who test positive. 

Finally, it was not until newborn screening for PKU had been instituted that an additional complication of PKU was identified: microcephaly in children of mothers affected with PKU whose phenylalanine levels were elevated during pregnancy. This outcome led to recognition of the need for tight dietary control before and during pregnancy in women with PKU.  Similarly, on-going follow-up has demonstrated that all patients with PKU benefit from continued dietary control in adulthood, illustrating the long-term social consequences of this disorder.

These experiences emphasize that data on a broad range of issues is relevant to the evaluation of a genetic test.  These include not only the expected clinical measures – the reliability of the laboratory measurement, the predictive value of the test and the effectiveness of medical interventions - but also social issues such as access to care and the personal and familial implications of testing and interventions.  The PKU experience also underscores the need for on-going data collection after a test is introduced, to identify unanticipated consequences of the testing process.


Genetic tests with limited predictive value:  Factor V Leiden and venous thromboembolism
Can the PKU experience be replicated with other genetic tests?  It is unlikely that genetic tests for common disorders will have the predictive value of PKU testing or lead to interventions that are as definitive.  This is because most common disorders are multifactorial:  many different genetic variants may contribute to risk, in conjunction with environmental risk factors.  As a result, genetic variants associated with common diseases usually indicate increased risk rather than certainty of future disease, and the interaction of genetic and non-genetic factors is often important in determining the risk status of a particular individual.  In addition, the experience to date suggests that genetic tests associated with an increased risk for common diseases may be offered for clinical use well before outcome studies are available to determine the benefits of interventions for those with genetic susceptibility (11,12).

Factor V Leiden, the DNA-based test most commonly ordered in the US, offers an example to illustrate these issues.  This genetic trait is a variant of the factor V gene, which codes for a protein involved in clot formation.  It is present in approximately 5% of European Americans, 2% of Hispanic Americans, and 1% of African and Asian Americans (13).  Many studies, done predominantly in populations of European descent, have now documented its association with an increased risk of venous thromboembolism (VT), often in the setting of other circumstances that affect risk, including pregnancy, use of oral contraceptives and surgery (13-17).  Estimates of the increased risk for VT among carriers of factor V Leiden vary from 2- to 8-fold (17-18). 

Factor V Leiden is one of several genetic factors that contribute to risk for VT, (17) and interactions between genetic and non-genetic risk factors for VT are well-established (17-19)  For example, individuals carrying both factor V Leiden and the 202210A variant in the prothrombin gene have a substantially higher risk of VT than carriers of either trait alone (18,20,21). In more than half of a series of families with antithrombin III deficiency, another genetic risk factor, the high risk of VT was due to the additional presence of factor V Leiden or the prothrombin variant (22). Thus, when VT occurs in the presence of factor V Leiden it often – perhaps always - represents the effect of interactions with one or more other genetic and non-genetic risk factors (17). Studies of the annual incidence of VT events in people with factor V Leiden suggest that the cumulative risk is in the range of 10% to 25% (14,19,21). 

Although factor V Leiden is well established as a risk factor, its implications for clinical management are far from clear.  Several rationales for factor V Leiden screening have been proposed.   Carriers of the variant might benefit from avoiding oral contraception (15,21)or post-menopausal estrogen (24). Anticoagulant prophylaxis might reduce the risk of VT when transient risk factors such as surgery, pregnancy or prolonged bed rest, occur (17,21,23). However, these interventions all pose potential risks as well as benefits, and none has been systematically studied in people with factor V Leiden. 

These various possibilities demonstrate the importance of focusing on a defined clinical problem and setting when determining the evidence needed to assess test use.  Studies assessing different test purposes require different testing protocols, study populations and outcome measures.  For example, an assessment of the use of factor V Leiden testing prior to oral contraceptive use would require a population of women receiving contraceptives, and would need to evaluate both contraceptive-related thrombotic risk and the outcome of alternative methods of contraception.  Conversely, the assessment of testing to determine the appropriate thrombosis prophylaxis prior to surgery would rely on the measurement of post-operative outcomes in surgical patients using specified prophylaxis protocols.  Each study would require appropriate control populations and measurement of other factors associated with risk of VT.  Without such studies the clinical utility of testing for factor V Leiden is called into question.


Developing standardized approaches to presenting evidence
Both the PKU and factor V Leiden examples demonstrate the importance of presenting data about genetic tests in formats that allow the specific clinical outcomes of tests to be evaluated.  Data to assess genetic tests for this purpose need to address three general categories of test performance:(5)

  1. Analytic Validity

    The term analytic validity refers to the accuracy with which a particular genetic characteristic (for example, a DNA sequence variant) can be identified in a given laboratory test.  One way to report analytic validity is in terms of the test’s sensitivity and specificity for the genetic variant in question.  Most genetic variants can be tested by a variety of protocols, and a number of technical issues arise in evaluating analytic validity.  These include the assay chosen, the reliability of the assay, the degree to which reliability varies from laboratory to laboratory, and the complexity of test interpretation.  Thus, an oligonucleotide probe for a single nucleotide sequence variant is a simpler test than a linkage analysis.  In the latter, accuracy of the test is based on the accuracy with which samples and medical history are collected from family members, as well as on technical aspects of the testing process in the laboratory.

    Often, few published data are available concerning the analytic validity of a test, and it may be difficult to judge whether different studies of the same genetic trait used comparable laboratory methods.  For example, some studies of factor V Leiden utilize a DNA-based assay while others utilize a functional assay, with differences in sensitivity and specificity. An adequate description of the analytic validity of a test requires systematic collection of data for this purpose, using defined populations with known genotypes (Table 1).  Proficiency testing, such as that performed under the auspices of the American College of Medical Genetics and the College of American Pathologists (ACMG/CAP), provides one source of objective data on analytic validity, but proficiency testing usually involves small numbers and few studies of normal genotypes.  The scarcity of published studies on analytic validity is an important limitation in the available evidence about genetic tests.

  2. Clinical Validity

    The term clinical validity describes the accuracy with which a test predicts a particular clinical outcome.  When a test is used diagnostically, clinical validity measures the association of the test with the disorder.  When a test is used to identify genetic susceptibility, clinical validity measures the accuracy with which it predicts a future clinical outcome.  This test property corresponds to the gene-disease association measured in epidemiological studies (1). A useful way to present clinical validity data for clinicians is in terms of the positive and negative predictive value of the test for the occurrence of disease within a defined population. 

    Clinical validity is often uncertain for new genetic tests.  Estimates may be based on studies in limited and potentially biased populations.  Uncertainty about clinical validity is an important consideration for policy-makers, clinicians and patients, particularly when they are deciding whether the risk information provided by the test provides a sufficient rationale for the use of interventions with putative but unproven benefits. 

    Mutations associated with disease susceptibility are often first defined in “high risk” families, characterized by multiple affected family members, and these studies may over-estimate risk.  The BRCA1 and BRCA2 genes, for example, were first identified in families selected for the presence of breast cancer under age 60 or ovarian cancer in four or more family members (25).  The lifetime risk of breast cancer is estimated to be about 85% in mutation carriers from these high risk families. But studies using less selected populations have estimated the lifetime risk associated with BRCA1/2 mutations to be 36%-56% (26-29). These observations suggest that high risk families represent the severe end of a spectrum of risk associated with BRCA1/2 mutations and that other factors, both genetic and non-genetic, may modify risk (30).  Thus, variation in clinical validity may be due to complex gene-gene and gene-environment interactions, (2) with the result that the predictive value of many genetic tests may remain imprecise even when all appropriate studies have been completed.

    Important variables in evaluating evidence about clinical validity include the size and selection criteria for the study population, the type of test used (and its analytic validity), study design, and clinical and other end points measured (Table 1).  Careful definition of the measures used to define the clinical outcome is needed.  Studies will provide more convincing results when they also include measurement of non-genetic factors that contribute to the clinical outcome.  Key methodological considerations include the comparability of case and control populations (where a case/control design is used), whether the interpretation of end-points was blinded and whether negative results were verified.

    Many genetic variants affect more than one clinical outcome; for example, Factor V Leiden is associated with both VT and pregnancy loss (31), and some genetic variants increase risk for two or more different cancers (25).Multiple disease end-points need to be considered when studying such variants; clinical validity may be high for one end-point and low for another.

  3. Clinical Utility

    Clinical utility refers to the likelihood that the test will lead to an improved health outcome.  Measurement of this characteristic requires evaluation of outcomes associated with testing and clinical interventions.  Central questions are the effectiveness of interventions available for people who test positive and the social consequences of testing for people with positive and negative test results.  Standardized approaches are available to assess the quality of evidence concerning interventions (32).

    As with information about clinical validity, knowledge about optimal prevention strategies is accumulated incrementally.  As is usual with emerging technology, people most genetically susceptible are initially offered interventions based on clinical reasoning or extrapolation from data in other populations – for example, early initiation of mammography screening in women with BRCA1/2 mutations.  The risks and benefits of these interventions can be understood only after systematic observation, in the form of well-designed controlled trials, cohort or case-control studies.  Because most genetic risk factors, even for common diseases, occur in a small percentage of the population – e.g., the 1%-5% prevalence of Factor V Leiden - , sample sizes of genetically susceptible subjects are often small.  Definitive understanding of clinical utility may be dependent on reliable methods for the pooled analysis of different studies.

    Important variables in evaluating evidence about clinical utility are the size and selection criteria for the study population, the type of laboratory assay and intervention used, and the study design (Table 1).  The health benefit proposed for a test will determine some of the outcome measures; others are determined by hypotheses concerning the harms of the testing process.  As with clinical validity studies, the comparability of the cases and controls is an important issue, when a case/control design is used.  If an experimental design is used, elements of the study methodology – for example, randomization strategy - are important. The methods for measuring clinical and other end-points should be specified, as well as whether negative results were verified. 

    Because genetic variants may affect multiple different clinical end-points, a test that has high clinical utility for one end-point may also provide extraneous information of little utility for another.  For example, a person with a mutation predisposing to hereditary nonpolyposis colorectal cancer (HNPCC) faces a high lifetime risk of colorectal cancer and is likely to benefit from early initiation of regular colonoscopy, as a means to reduce colorectal cancer mortality (33). However, HNPCC is also associated with increased risk for endometrial, ureteral tract and upper gastrointestinal cancers; methods of screening for endometrial cancer are of unproven efficacy, and no preventive care is available for the other cancers associated with HNPCC (34).
  4. Ethical, legal and social implications of genetic tests

    Genetic tests have ethical, legal and social implications.  A study that is limited to medical outcomes – e.g., whether or not a particular clinical diagnosis is present or a particular outcome of treatment occurs - will be inadequate to evaluate the full implications of testing.  Some social factors, such as access to testing and treatment and their cost, are critical determinants of medical outcomes.  Others may determine the potential for a testing program to cause harm. 

    Unfortunately, the outcomes that have generated the greatest concern about genetic testing, such as insurance or employment discrimination, stigmatization, and long-term psychological harms from testing, (35-37) are difficult to study.  Separate studies designed to provide adequate measurements of these outcomes may be necessary.  For example, a United Kingdom survey evaluated reports of insurance discrimination among families with a wide range of genetic disorders (38). Similarly, evaluation of coasts and of inequities in access to genetic services may require studies designed to examine this issue. 

    Understanding the factors that determine interest in predictive testing is also important.  The clinical utility and personal value attached to knowledge about genetic risk may vary by age or other personal characteristics.  For example, the implications of a positive test for a BRCA1 or BRCA2 mutation differ considerably for a woman who has not yet had children compared to one who has, because oophorectomy is an important prevention option for such women.  In addition, some testing decisions may be motivated by the desire to help children; a woman with cancer may be more interested in BRCA1/2 testing if she has daughters who might benefit from the information.

    The appropriate application of genetic testing requires information about the costs and effects of different pre-test and post-test counseling procedures, and about post-test behaviors.  Knowledge about genetic risk does not necessarily lead to risk-reducing behaviors and could, contrariwise, produce a fatalistic attitude that reduces motivation (39). These concerns point to the importance of studying the meaning assigned to genetic information, e.g., whether test recipients or health care providers view genetic test results differently from the results of other medical tests.  For example, the media often represent genetics as deterministic, (40) but whether this misunderstanding affects the interpretation of genetic test results is not known.  Some experimental study designs can incorporate these empiric questions, but long-term follow-up may be needed to ensure an adequate understanding of the personal and social outcomes of the testing process. 

    Genetic Test Reports:  Making sense of the evidence

    Accurate reporting of the properties of genetic tests, using standardized methodologies, serves an important clinical purpose.  Reports summarizing what is known and not known about a genetic test allow policy makers, health care providers and patients to evaluate new testing opportunities with the assurance that their decisions about test use will be based on the available evidence.  In-depth summaries of evidence can also guide future research. 

    The first step in this process is to encourage authors to present methods and results in standardized ways, as outlined in Table 1 and in the methodological papers in this series. (1,2)  Brief summaries following a succinct and systematic format similar in concept to a structured abstract would provide information about the current status of genetic tests.  Because knowledge about tests will change over time, these status reports would ideally be dated and revised on a periodic basis. 

    Two other more detailed types of reports can provide the necessary background for the brief summaries and offer additional support to policy makers, clinicians and researchers. One is the structured review, providing a systematic evaluation of evidence on the analytic validity, clinical validity, and clinical utility of a test, including consideration of ethical, legal and social implications of testing.  The second is the construction of evidence tables that provide ready access to information about the individual studies on which summaries or structured reviews are based.  An example of an evidence table is shown in Table 2.  A reporting format of this kind clarifies both the strengths and the weaknesses of available data, allows studies to be compared, and makes gaps in knowledge apparent.  In the hypothetical screening study shown in Table 2, for example, the evidence table makes the weaknesses of the study apparent (e.g., intervention/control status determined by patient preference; lack of assessment of analytic validity or quality of life; lack of confirmation of negative screening results) and suggests that screening in this example increases hospitalizations but does not reduce mortality over a 5-year follow-up period. In addition to providing a realistic picture of what is known about a genetic test, an evidence table identifies additional research needs and facilitates the selection of studies for pooled analyses.  This format can also be readily up-dated by the addition of new studies to the table.

    The “Screening Brief” featured in the Journal of Medical Screening represents an example of a brief summary format that could be applied to genetic tests, and the human genetic epidemiology (HuGE) reviews that are now a regular feature in the American Journal of Epidemiology represent an example of a structured review.  Evidence tables may be used in the development of these reports, but are not generally published or otherwise made available. The Internet may provide a mechanism for dissemination of this reporting format – perhaps through web sites already providing genetic information such as HuGE Net (www.cdc.gov/genomics/hugenet), the CancerNet PDQ summaries on cancer genetics (www.nci.nih.gov/cancer_information/list.aspx?viewid=0e256153-4717-447c-9cbb-c0c2028d6c50), and GeneTests-GeneClinics reviews (www.geneclinics.org).  Professional organizations could play a role in the development of all these information resources.  Evidence tables, in particular, provide support for the development of practice guidelines. 

    These strategies for reporting information about genetic tests should not be viewed as replacements for clinical practice guidelines.  The latter address the use of a genetic test in a particular health care setting, and must take into account the value of testing for the population being served, its cost and acceptability in this setting, and its priority relative to other health care services.  Tests suitable in some settings may not be suitable in others.  While procedures beyond the test reporting outlined here are needed to address these issues, objective information concerning the current state of knowledge about a test is an essential component of this process.


Summary
New techniques to organize and disseminate evidence about genetic tests are an important step in support of the rational and prudent use of this new technology. To be effective, evaluation methods must be as complete and unbiased as possible.  Clinicians, guidelines panels and other policy-makers must consider genetic tests in light of alternative approaches to care; that is, the health benefits and other outcomes of a genetic test must be evaluated compared to the outcomes that could be obtained in the absence of genetic testing.  To make this comparison, adequate evidence concerning the analytic validity, clinical validity and clinical utility of genetic tests is needed, including appropriate control populations and, ideally, measurement of social outcomes. 

This ambitious research agenda is unlikely to be achieved rapidly or completely for most genetic tests.  Even when all appropriate research is completed, the predictive value of many genetic tests may remain imprecise and the clinical utility may be variable.  As a result, methods to disseminate information about genetic tests represent an important strategy for ensuring appropriate test use.  Following criteria for the objective assessment of test properties, reports should be structured to enable policy makers, clinicians and the public to identify quickly what is known and not known about analytic validity, clinical validity and clinical utility, so that uncertainties can be taken into account when genetic tests are considered for use.

Table 1: Presenting Data About Genetic Tests

Type of Study Parameters to Be Assessed*
All Studies Problem addressed by study

What clinical problem is being assessed? What is the setting in which the genetic test is being used?

Study population

How were subjects selected?  Is information provided concerning age, gender, racial or ethnic origin? Do subjects consist of index cases only, or include multiple family members?

If a control population is included, was it selected from the same population as the cases; were matching criteria used?  What inclusion and exclusion criteria were specified?

Laboratory assay

What was the source of samples? What variant was measured? What laboratory method was used?

Analytic Validity

Reference standards

Did study include samples with known genotypes, with and without the variant being assayed? What was the source of reference standards? What criteria were used to define genotypes?

Laboratory performance

How was reproducibility of assay assessed?  Was reliability of assay assessed in a routine clinical laboratory setting?

Clinical Validity Study design

Were data collected prospectively or retrospectively?  Did study include measurement of potential modifying factors? 

Clinical and other end points

What case definition was used?  What end points were measured? Was interpretation of end-points blinded? Were negative results verified?

Clinical Utility Intervention

What interventions were used?  What were the criteria for use of the intervention?

Study design

Were data collected prospectively or retrospectively?  Was an experimental study design used?  If so, was a randomization method used? Was intervention blinded?

Clinical and other end points

What outcomes were measured? Was interpretation of end-points blinded? Were negative results verified?


Table 2:  Evidence Table for a Hypothetical Study of Clinical Utility

Study Population Genetic Test Methodology Study design Intervention End points measured Results
Citation Selection method for intervention group and controls; size Laboratory assay used; analytic validity if known Key features of y design All intervention procedures Clinical and other end points Summary of main outcomes of study
Hypothetical Example

Cases: Sequential patients with diagnosis X who accept intervention Y (N=80)

Controls: Patients refusing intervention Y (N=43)

Oligonucelotide probe of mutation in Gene Z.  No formal assessment of analytic validity

Non-random assignment to case/control group.

Non-blinded intervention.

Annual in-person follow-up for 5 years

New radiological screening procedure studdesigned for early detection of cancer in patients with diagnosis X.  Positive findings confirmed by biopsy and treated with surgery & chemotherapy

Number of positive screens and biopsies in cases

Number of cancer diagnoses & cancer stage in cases and controls Hospitalizations Deaths

No measurement of quality of life

More cancer (15% vs 7%), earlier stage of diagnosis & more hospitalizations in cases than controls

25% of cases had a false positive screen (X-ray positive/biopsy negative)

Deaths the same in both groups.


References

  1. Little(et al) J. Am J Epidemiol.
  2. Hunter(et al) D. Am J Epidemiol.
  3. Collins FS. Shattuck lecture--Medical and societal consequences of the Human Genome Project. N Engl J Med 1999; 341:28-37.
  4. Roses AD. Pharmacogenetics and the practice of medicine. Nature 2000; 405:857-65.
  5. Holtzman NA, Watson MS. Promoting safe and effective genetic testing in the United States. Final report of the Task Force on Genetic Testing. J Child Fam Nurs 1999; 2:388-90.
  6. Institute of Medicine CoCPG. Guidelines for Clinical Practice:  from Development to Use. National Academy Press, Washington, DC 1992.
  7. Woolf SH. Evidence-based medicine and practice guidelines: an overview. Cancer Control 2000; 7:362-
  8. Miller J, Petrie J. Development of practice guidelines. Lancet 2000; 355:82-3.
  9. Pass K. Lessons learned from newborn screening for phenylketonuria. In: MJ K, W B, Thomson E, eds. Genetics and Public Health. New York: Oxford University Press, 2000:385-404.
  10. Paul D. The history of newborn phenylketonuria screening in the United States. In: Holtzman NA, Watson MS, eds. Promoting safe and effective use of genetic testing in the United States: final report of the task force on genetic testing. Baltimore: Johns Hopkins University Press, 1998:137-160.
  11. Laken SJ, Petersen GM, Gruber SB, et al. Familial colorectal cancer in Ashkenazim due to a hypermutable tract in APC. Nat Genet 1997; 17:79-83.
  12. Burke W, Daly M, Garber J, et al. Recommendations for follow-up care of individuals with an inherited predisposition to cancer II.BRCA1 and BRCA2. JAMA 1997a; 277:997-1003.
  13. Ridker PM, Miletich JP, Hennekens CH, Buring JE. Ethnic distribution of factor V Leiden in 4047 men and women. Implications for venous thromboembolism screening. Jama 1997; 277:1305-7.
  14. Middeldorp S, Henkens CM, Koopman MM, et al. The incidence of venous thromboembolism in family members of patients with factor V Leiden mutation and venous thrombosis. Ann Intern Med 1998; 128:15-20.
  15. Bloemenkamp KW, Rosendaal FR, Helmerhorst FM, Buller HR, Vandenbroucke JP. Enhancement by factor V Leiden mutation of risk of deep-vein thrombosis associated with oral contraceptives containing a third-generation progestagen. Lancet 1995; 346:1593-6.
  16. Vandenbroucke JP, Koster T, Briet E, Reitsma PH, Bertina RM, Rosendaal FR. Increased risk of venous thrombosis in oral-contraceptive users who are carriers of factor V Leiden mutation. Lancet 1994; 344:1453-7.
  17. Rosendaal FR. Venous thrombosis: a multicausal disease. Lancet 1999; 353:1167-73.
  18. Meyer G, Emmerich J, Helley D, et al. Factors V leiden and II 20210A in patients with symptomatic pulmonary embolism and deep vein thrombosis. Am J Med 2001; 110:12-5.
  19. Simioni P, Sanson BJ, Prandoni P, et al. Incidence of venous thromboembolism in families with inherited thrombophilia. Thromb Haemost 1999; 81:198-202.
  20. De Stefano V, Martinelli I, Mannucci PM, et al. The risk of recurrent deep venous thrombosis among heterozygous carriers of both factor V Leiden and the G20210A prothrombin mutation. N Engl J Med 1999; 341:801-6.
  21. Martinelli I, Bucciarelli P, Margaglione M, De Stefano V, Castaman G, Mannucci PM. The risk of venous thromboembolism in family members with mutations in the genes of factor V or prothrombin or both. Br J Haematol 2000; 111:1223-9.
  22. van Boven HH, Vandenbroucke JP, Briet E, Rosendaal FR. Gene-gene and gene-environment interactions determine risk of thrombosis in families with inherited antithrombin deficiency. Blood 1999; 94:2590-4.
  23. Grody WW, Griffin JH, Taylor AK, Korf BR, Heit JA. American College of Medical Genetics consensus statement on factor V Leiden mutation testing. Genet Med 2001; 3:139-48.
  24. Rosendaal FR. Factor V Leiden and hormone replacement therapy, CDC Factor V Leiden Workshop, Atlanta, GA, April 2, 2001, 2001.
  25. Ford D, Easton DF, Bishop DT, Narod SA, Goldgar DE. Risks of cancer in BRCA1-mutation carriers. Breast Cancer Linkage Consortium. Lancet 1994; 343:692-5.
  26. Fodor FH, Weston A, Bleiweiss IJ, et al. Frequency and carrier risk associated with common BRCA1 and BRCA2 mutations in Ashkenazi Jewish breast cancer patients. Am J Hum Genet 1998; 63:45-51.
  27. Struewing JP, Hartge P, Wacholder S, et al. The risk of cancer associated with specific mutations of BRCA1 and BRCA2 among Ashkenazi Jews. N Engl J Med 1997; 336:1401-1408.
  28. Thorlacius S, Struewing JP, Hartge P, et al. Population-based study of risk of breast cancer in carriers of BRCA2 mutation. Lancet 1998; 352:1337-9.
  29. Hopper JL, Southey MC, Dite GS, et al. Population-based estimate of the average age-specific cumulative risk of breast cancer for a defined set of protein-truncating mutations in BRCA1 and BRCA2. Australian Breast Cancer Family Study. Cancer Epidemiol Biomarkers Prev 1999; 8:741-7.
  30. Burke W, Press NA, Pinsky LE. BRCA1 and BRCA2: a small part of the puzzle. J Natl Cancer Inst 1999; 91:904-5.
  31. Kupferminc MJ, Eldor A, Steinman N, et al. Increased frequency of genetic thrombophilia in women with complications of pregnancy. N Engl J Med 1999; 340:9-13.
  32. US Preventive Services Task Force. Guide to clinical preventive services. Baltimore: Williams & Wilkins, 1996
  33. Renkonen-Sinisalo L, Aarnio M, Mecklin JP, Jarvinen HJ. Surveillance improves survival of colorectal cancer in patients with hereditary nonpolyposis colorectal cancer. Cancer Detect Prev 2000; 24:137-42.
  34. Burke W, Petersen G, Lynch P, et al. Recommendations for follow-up care of individuals with an inherited predisposition to cancer I. Hereditary Nonpolyposis Colon Cancer. JAMA 1997b; 277:915-919.
  35. Rothenberg KH. Genetic information and health insurance: state legislative approaches. J Law Med Ethics 1995; 23:312-9.
  36. Billings PR, Kohn MA, de Cuevas M, Beckwith J, Alper JS, Natowicz MR. Discrimination as a consequence of genetic testing. Am J Hum Genet 1992; 50:476-82.
  37. Lapham EV, Kozma C, Weiss JO. Genetic Discrimination:  perspectives of consumers. Science 1996; 274:621-624.
  38. Low L, King S, Wilkie T. Genetic discrimination in life insurance: empirical evidence from a cross sectional survey of genetic support groups in the United Kingdom. BMJ 1998; 317:1632-5.
  39. Marteau TM, Lerman C. Genetic risk and behavioural change. Bmj 2001; 322:1056-9.
  40. Khoury MJ, Thrasher JF, Burke W, Gettig EA, Fridinger F, Jackson R. Challenges in communicating genetics: A public health approach. Genetics IN Medicine 2000; 2:198-202.
Last Updated August 04, 2004