home | about CERHR | news | CERHR chemicals | CERHR reports & monographs
common concerns & exposures | nominate | search site | links | contact us

 Guidelines for CERHR Expert Panel Members
 

NTP/ NIEHS

DRAFT APRIL 5, 2001

GUIDELINES FOR CERHR EXPERT PANEL MEMBERS

NTP

CENTER FOR THE

EVALUATION OF RISKS TO

HUMAN REPRODUCTION

 

CONTENTS

I. Activities of CERHR Expert Panels

Overview

Pre-meeting Preparation

Expert Panel Meeting

Report Completion

II. CERHR Expert Panel Reports

III. Evaluation of Individual Studies

 

I. GUIDANCE FOR ACTIVITIES OF CERHR EXPERT PANEL MEMBERS

Overview

The primary activity of the CERHR is preparation of reports that provide timely, scientifically rigorous, independent evaluations of the scientific evidence that human exposure to chemicals may result in adverse effects on reproduction including sexual function and fertility (reproductive toxicity) and the normal development of children (developmental toxicity).

Each assessment is carried out by a panel of scientists representing the range of disciplines needed to interpret the scientific literature. The CERHR designates one member of the panel as the panel chair. This person is responsible for coordinating the panel's evaluation activities and for chairing the Expert Panel Meeting. All panel members serve as individual experts in their specific areas of expertise, not as representatives of their employer or other organization.

The goals of the individual assessments are 1) to produce an objective and scientifically rigorous assessment and interpretation of the scientific evidence that (a) a substance constitutes a hazard to human reproduction or development and (b) a given exposure circumstance involving the substance poses a potential risk to human reproduction or development and 2) to identify critical knowledge gaps and data needs to help establish research and testing priorities.

This document is intended to provide Expert Panel members with guidance on the processes involved in preparation of Expert Panel Reports. The overall process involves three phases: pre-meeting preparation, Expert Panel Meeting, and completion of the Panel Report. The efficiency and success of this process is highly dependent upon timely and conscientious pre-meeting preparation by panel members.

Pre-meeting Preparation

Each panel member will be assigned a topic area of responsibility for the evaluation. Initially, CERHR staff will provide each panel member with a bibliography on the chemical(s) to be evaluated, copies of the reprints and reports in their area of responsibility, and summary tables and synopses of the studies deemed most relevant (having significant and demonstrable bearing on potential reproductive and developmental toxicity) by the Center staff. The bibliography and available abstracts will be available to panel members on restricted pages of the Center's web site (http://cerhr.niehs.nih.gov). Panel members are expected to review the bibliography relevant to their assigned section and provide any additional references relevant to the topic.

The types of documents that are acceptable for use in preparing panel reports include peer-reviewed papers published or accepted for publication in the open scientific literature and reports or other scientific documents that have been peer-reviewed but may not be published in the open literature. When relevant study reports that have not been peer-reviewed are brought to the attention of the Panel members or CERHR staff, they may be reviewed for quality and completeness by the Expert Panel and,if scientifically acceptable, included in the Expert Panel Report. Published abstracts may be discussed and cited to point out the existence of additional information but cannot be used to reach conclusions by the Expert Panel. Any documents cited in the Panel reports that are not available in the open literature will be on file and publicly available from the Center.

Panel members are to review each publication for their assigned research area and, for each relevant study, summarize the basic facts and findings (see guidelines on the Evaluation of Individual Studies). Individual study summaries will include the reported findings, comments on the strengths and weaknesses of the study, and the utility (applicability to the purpose of drawing conclusions on whether or not a chemical adversely affects reproduction) of the data for evaluating reproductive effects. The tables and synopses initially provided by the CERHR staff are intended as a starting point in these efforts.

When a Panel member notes missing information in a study or reaches conclusions that differ from the author's, these should be included in square brackets. Examples include:

  • key items of information not given in a publication, e.g., [strain not specified].
  • substantial limitations noted in a study, e.g., [only 3 mice were observed in the high dose group, an inadequate number to reach a conclusion].
  • conclusions other than the author's, e.g., [significant effects were also observed for the middle dose group].

Following completion of the individual study summaries, each Panel member is asked to make additions to or deletions from the tables provided by the CERHR staff. Panel members' summaries, any additional references, and the revised table(s) are returned to the CERHR office.

CERHR staff will integrate the panel members' submissions into sections 1-4 (see Report Outline below) of the draft Expert Panel Report and prepare draft summaries for these four sections. The draft report will then be sent to each member for review. Comments and corrections are returned to the CERHR by a predetermined deadline. Based on these comments and corrections, CERHR staff will revise the draft report and return the revised draft to the Expert Panel. This draft report will be announced in the Federal Register and made available for public comment through the CERHR office and web site.

Expert Panel Meeting

The most visible activity of the Panel is the Expert Panel meeting. This is the time at which the combined expertise and judgment of the Panel are brought to focus on the evaluation. The efficiency and effectiveness of this meeting depends largely on the extent to which each Panel member is prepared. Each member will be responsible for leading the discussions and deliberations of his/her own sections and participating in the evaluation and integration of all data into a complete report.

At the Expert Panel meeting, sections 1-4 will be reviewed for content and accuracy. The Panel will openly discuss the individual sections and indicate corrections and clarifications as needed.

When necessary for interpreting individual studies or facilitating comparison among studies, the Panel may choose to convert units of exposure, conduct additional statistical analyses, reach its own conclusions on response as a function of exposure, or use the published data to calculate alternative measures such as bench mark doses. All such cases of recalculation or reinterpretation must be clearly noted in square brackets, e.g., [The Panel converted the ppm in feed to mg/kg bw/day based on daily food intake].

The Panel will work to reach agreement on the text. CERHR staff will be present to make edits to the draft Expert Panel Report. Written comments submitted by the public will also be considered at this time and, where appropriate, incorporated.

Time will be set aside during the meeting for oral public comments. The Panel will consider these comments during its deliberations, in revising sections 1-4 and in preparing section 5. Following completion of Sections 1-4, the principal activity of the Expert Panel meeting will be the drafting and review of the conclusions and the critical data needs.

The Expert Panel's goal is to reach consensus on the summaries of Sections 3 and 4 and the Summary, Conclusions, and Critical Data Needs in Section 5. In the case that disagreement among members prevents consensus on meaningful statements in any of these areas, the issue will be put to a vote by show of hands and majority opinion will prevail. The vote count will not appear in the Expert Panel Report, but will be part of the record of the Expert Panel meeting and will be publicly available upon request. The report will, however, clearly note where such disagreements occurred and the nature of the disagreements. The conclusions and their language agreed upon by the Panel will not change within the Expert Panel Report after adjournment of the Expert Panel meeting.

Report Completion

Following the Expert Panel Meeting, CERHR staff will prepare a final draft report, assuring that all corrections, revisions, and conclusions agreed to by the Panel are incorporated. This final draft will be sent to Panel members to review for completeness and accuracy. According to a predetermined deadline, members' comments will be returned to the CERHR and appropriate edits made. The final Expert Panel Report will go out for public comment and be posted on the CERHR web site. NTP staff will review the Expert Panel Report and public comments and prepare NTP Center Report for transmittal to Federal and State regulatory and research agencies and the public.

II. OUTLINE OF CERHR EXPERT PANEL REPORTS

1.0 Chemistry, Use, and Human Exposure

1.1 Chemistry

1.2 Use and Human Exposure

1.3 Utility of Data

1.4 Summary of Human Exposure Data

2.0 General Toxicology and Biological Effects

2.1 Toxicokinetics and Metabolism

2.2 General Toxicity

2.3 Genetic Toxicity

2.4 Carcinogenicity

2.5 Summary

3.0 Developmental Toxicity Data

3.1 Human Data

3.2 Experimental Animal Data

3.3 Utility of Data

3.4 Summary

4.0 Reproductive Toxicity Data

4.1 Human Data

4.2 Experimental Animal Data

4.3 Utility of Data

4.4 Summary

5.0 Summaries, Conclusions, and Critical Data Needs

5.1 Summary and Conclusions of Reproductive and Developmental Hazards

5.2 Summary of Human Exposure

5.3 Overall Conclusions

5.4 Critical Data Needs

6.0 References

7.0 Data Tables

1.0 Chemistry, Use, and Human Exposure

The purpose of this section is to present the chemical characteristics of the chemical under evaluation, information on its production and use, evidence for its occurrence in the environment, and levels of human exposure, the sources of that exposure, the people most likely to be exposed, and the factors that contribute to exposure. Direct measurement in human tissues or fluids are particularly important and should be included where possible. In this section, both published and readily available unpublished sources of information such as reports from government committees, may be used. However, each statement of fact should be substantiated by an article or report which is fully referenced and should not reflect general assumptions or personal communications. Any limitation(s) or uncertainties inherent in the reports will be described. Unpublished reports used by the Expert Panel will be maintained in the files of the CERHR and will be available upon request.

1.1 Chemistry

1.1.1 Nomenclature: the most recent Chemical Abstracts Services Registry Number and Primary Name and otehr common synonyms from the international literature.

1.1.2 Structural and molecular formulae and relative molecular mass.

1.1.3 Chemical and physical properties of the pure substance: boiling-point, melting-point, density, solubility, vapor pressure, stability, reactivity.

1.1.4 Technical products and impurities: trade names, specifications, composition, inert ingredients and impurities, manufacturers.

1.2 Use and Human Exposure

1.2.1 Production: Methods of synthesis and production; countries in which the agent is or has been produced; past and present volumes of production and trade.

1.2.2 Use: Information on past and present uses.

1.2.3 Occurrence: Levels reported in occupational environments, air, water, soil, and food including persistence and bioaccumulation when available and any uncertainties about these levels.

1.2.4 Human Exposure: Exposure levels in humans as estimated from levels determined in environmental media of from direct analysis of occurrence in human tissues or body fluids and any uncertainties about these levels.   When available, authoritative reviews of other summary documents judged scientifically sound by the Panel may be used in preparing this section.

Recognizing that data on human exposure are generally sparse and that such data will differ in type, quantity, and quality for each chemical evaluated, an attempt should be made to summarize these data as to whether or not they are sufficient (refers to a judgement on a collection of data from multiple studies) for estimating exposure to the general population, to highly exposed groups, e.g., occupationally exposed, or to potentially high risk groups such as children or pregnant women.

In cases where there are no relevant data or the data are not sufficient to estimate exposures to the general population or to defined populations of concern, it should be stated that there are insufficient data for use in the CERHR evaluation.

When the available exposure data are, for example, from a very limited number of samples or from an unrepresentative population or environmental medium, they may provide some basis for estimating general population exposures or ranges of exposures. However, these should be considered limited data and may not be sufficient for drawing any conclusions related to human risk.

Available data may permit an estimation of general population exposure or range of exposures with some confidence. Likewise, data may be available to permit such estimates in specific populations such as occupational groups or women of reproductive age. Such sufficient data may be considered of some use in reaching conclusions regarding potential for risk resulting from the estimated exposures.

Finally, there may be cases in which the available exposure data are sufficient to permit confident estimates of average exposures and exposure ranges in the general population and/or in subpopulations at potentially higher risk. These exceptional data provide the strongest basis for reaching conclusions regarding potential risk.

1.3 Utility of Data

A clear statement regarding the nature, volume, strengths and limitations of the exposure data will be included in the report along with an overall evaluation of the suitability of the data for use in assessing potential human risks.

1.4 Summary of Human Exposure Data

This section provides a summary statement of what can be concluded regarding human exposures to the chemical under evaluation. It should be informative with respect to sources and routes of exposure and known or estimated exposure levels, to include exposures of the general population and subpopulations that may be highly or otherwise uniquely exposed. Further, it should indicate if these exposures are acute, chronic, intermittent, intended, or accidental.

2.0 General Toxicology and Biological Effects

2.1 Toxicokinetics and Metabolism

The purpose of this section is to summarize information on toxicokinetics.  Studies summarized should include those that report absorption, distribution, metabolism and excretion, and tissue dosimetry.  Concise quantitative information should be given on kinetic factors that may affect a dose-response relationship, such as saturation of uptake, protein binding, metabolic activation and detoxification.  Studies of metabolism in vitro may be included when judged relevant.  Comparisons of results between animals and humans are considered highly important and should be made when possible.  Potential for transplacental transfer or secretion in breast milk is of particular relevance.  Authoritative reviews may be employed to prepare this section.

2.2 General Toxicity

The purpose of this seciton is to summarize information on categories of toxicity other than reproductive or developmental.   Studies summarized should include those that report maximum tolerated doses, single and repeated dosing regimens, and effects on specific organs and systems such as the immune, circulatory, nervous, skeletal, and endocrine systems. Although not essential to the assessment of reproductive and developmental effects, such studies can be informative with regard to dose-responses, organs affected, effects of different routes of administration, similarities or differences in effects among species, and the general health status of test animals at doses relevant to interpretation of reproductive or developmental toxicity data. Studies in humans and experimental animals should be included. Authoritative reviews may be employed to prepare this section.

2.3 Genetic Toxicity

The purpose of this section is to summarize information on the genetic effects of the chemical. Chemicals that are mutagenic or exhibit other evidence of genetic toxicity are often observed to adversely affect development and reproduction. Results of both in vitro and in vivo studies, and data from experimental animals or humans, should be summarized. Authoritative reviews may be employed to prepare this section.

2.4 Carcinogenicity

The purpose of this section is to summarize results of studies in which the potential of the chemical to induce cancer has been reported. Studies in both experimental animals and humans should be included. Authoritative reviews may be employed to prepare this section.

2.5 Summary

A summary statement related to each of the four categories in this section should be presented. Each summary statement should state clearly the extent and quality of the data evaluated, e.g., no data available, limited data - not sufficient to reach a conclusion, data sufficient to suggest an effect, or data sufficient to clearly show an effect. Summary statements should state the species, sex, experimental conditions, organs/tissues/cells affected, and the endpoint measured. For genetic toxicity, it should be stated if the effects were observed were in vitro or in vivo systems.

3.0 Developmental Toxicity Data

3.1 Human Data

The purpose of this section is to summarize all studies and reports on developmental effects in humans. All available studies should be summarized including case reports, cohort studies, and case-control studies. When available, information on susceptibility factors, e.g., life stage, diet, genetics, stressors, should be discussed. Because of the paucity and importance of studies in humans, it is important to summarize studies of questionable quality for discussion by the Panel, even though they may not contribute to the conclusions.

3.2 Experimental Animal Data

The purpose of this section is to summarize all data relevant to evaluating the developmental effects of the exposure to animals. Studies of doubtful quality should also be summarized for discussion by the Panel. In addition to developmental toxicity studies of the chemical under evaluation, the following types of studies should also be summarized: those in which the chemical was administered in conjunction with other toxicants or modifying factors, experiments on the developmental toxicity of known metabolites and derivatives, and studies in which the endpoint was defined or suspected of being an indicator of developmental toxicity. It is particularly important to address mechanism(s) of toxicity whenever the scientific literature permits.

It should be noted that a distinction between developmental and reproductive toxicity studies is not always clear. Developmental toxicity studies may include an evaluation of the reproductive system and the endpoints measured may reflect structural and/or functional effects. When such studies are encountered, they should appear in both the Developmental Toxicity and Reproductive Toxicity sections, with the greatest detail provided in the section deemed by the Panel to be the most relevant to the evaluation.

3.3 Utility of data

A clear statement regarding the nature, amount, strengths and limitations of the developmental toxicity data will be included in the report along with an overall evaluation of the utility of the data for use in assessing potential human risks.

3.4 Summary of Developmental Toxicity Data

This section provides a concise summary of those studies reviewed in sections 3.1 and 3.2 and considered to be of adequate quality for use in making an evaluation of developmental toxicity. Descriptions of studies on which critical comments have been noted in square brackets need not be brought forward to the summary if the study was deemed not of adequate (refers to individual studies) quality or completeness to contribute to the evaluation. Results reported only in abstracts should not contribute to the conclusions.

It is recognized that each chemical evaluated will involve a unique array of data. However, a statement as to whether or not the chemical is considered a developmental hazard is to be presented. The following template provides a general format and guidance on the information that should be included in this statement:

There is (sufficient, insufficient) evidence in (animals and / or humans) that (chemical X) (does or does not) cause developmental toxicity when exposure is (route, dose range, timing, duration) . The data are (relevant, assumed relevant, irrelevant) to consideration of human risk.*

sufficient / insufficient is a scientific judgment based on the amount, quality, and types of available data.

relevant = human data, or animal data for which pharmacokinetic and mechanism information is adequate to demonstrate a particular similarity to humans.

assumed relevant = no information available to modify the assumption that the data are relevant.

irrelevant = pharmacokinetic or mechanistic features of the animal models are known and demonstrated to be inconsistent with human exposure or response.

*This template is taken from the National Research Council Report, Evaluating Chemical and Other Agent Exposures for Reproductive and Developmental Toxicity. Subcommittee on Reproductive and Developmental Toxicology, Committeee on Toxicology, Board on Environmental Studies and Toxicology, Commission on Life Sciences. National Academy Press, 2001.

4.0 Reproductive Toxicity Data

4.1 Human Data

The purpose of this section is to summarize all studies and reports on reproductive effects in humans. All available studies should be summarized including case reports, cohort studies, and case-control studies. Because of the paucity and importance of studies in humans, it is important to summarize studies of questionable quality for discussion by the Panel, even though they may not contribute to the conclusions.

4.2 Experimental Animal Data

The purpose of this section is to summarize all data relevant to evaluating the reproductive effects of exposure to animals. Studies of doubtful quality may also be summarized for discussion by the Panel. In addition to reproductive toxicity studies of the chemical under evaluation, the following types of studies should also be summarized: those in which the chemical was administered in conjunction with other toxicants or modifying factors, experiments on the reproductive toxicity of known metabolites and derivatives, and studies in which the endpoint was defined as or suspected of being an indicator of reproductive toxicity. It is particularly important to address mechanism(s) of toxicity whenever the scientific literature permits.

It should be noted that a distinction between reproductive and developmental studies is not always clear. Reproductive toxicity studies may include an evaluation of developmental endpoints that reflect structural and/or functional effects. When such studies are encountered, they should appear in both the Developmental Toxicity and Reproductive Toxicity sections, with the greatest detail provided in the section deemed by the Panel to be the most relevant to the evaluation. Studies in which effects on reproductive system structure or function are reported following pre- or early postnatal exposure should be included in this section.

4.3 Utility of data

A clear statement regarding the nature, volume, strengths, and limitations of the reproductive toxicity data will be included in the report along with an overall evaluation of the utility of the data for use in assessing potential human risks.

4.4 Summary

This section provides a concise summary of those studies reviewed in sections 4.1 and 4.2 and considered to be of adequate scientific quality for use in making an evaluation of reproductive toxicity. Studies on which critical comments have been noted in square brackets in the text should not be brought forward to the summary if they were not of adequate quality to contribute to the evaluation. Results reported only in abstracts will not contribute to the conclusions.

It is recognized that each chemical evaluated will involve a unique array of data. However, a statement as to whether or not the chemical is considered a reproductive hazard in females or males is to be presented. The following template provides a general format and guidance on the information that should be included in this statement:

There is (sufficient, insufficient) evidence in (animals and / or humans) that (chemical X) (does or does not) cause reproductive toxicity in (females, males) when exposure is (route, dose range, timing, duration) . The data are (relevant, assumed relevant, irrelevant) to consideration of human risk.*

sufficient / insufficient is a scientific judgment based on the amount, quality, and types of available data.

relevant = human data, or animal data for which pharmacokinetic and mechanism information is adequate to demonstrate a particular similarity to humans.

assumed relevant = no information available to modify the assumption that the data are relevant.

irrelevant = pharmacokinetic or mechanistic features of the animal models are known and demonstrated to be inconsistent with human exposure or response.

*This template is taken from the National Research Council Report, Evaluating Chemical and Other Agent Exposures for Reproductive and Developmental Toxicity. Subcommittee on Reproductive and Developmental Toxicology, Committeee on Toxicology, Board on Environmental Studies and Toxicology, Commission on Life Sciences. National Academy Press, 2001.

5.0 Summaries, Conclusions, and Critical Data Needs

5.1 Summary and Conclusion of Reproductive and Developmental Hazards

This section of the Expert Panel Report provides a brief synopsis of the summaries presented in sections 3 and 4. , It should state whether or not the scientific data reviewed has led the Panel to conclude that the chemical assessed is likely or is not likely to be a potential reproductive or developmental hazard to humans. When data are not sufficient to reach such a conclusion, this should be clearly stated. This evaluation should be made without consideration of human exposure levels or the numbers or subpopulations of people who may be exposed.

5.2 Summary of Human Exposure

This section of the Expert Panel Report presents a synopsis of the information available on human exposures as reviewed and summarized in Section 1. The sufficiency of the data should be stated and, when possible, exposure estimates included for the general population as well as for any highly exposed groups, e.g., occupationally exposed, or for potentially high risk groups such as children or pregnant women.

5.3 Overall Conclusions

This section is based on an integration of the toxicity and exposure data and, when possible, evidence on the mechanism of action. Conclusions are presented in narrative form and present the Panel's best scientific judgment on the likelihood that adverse reproductive and/or developmental effects may occur under the exposure circumstances specified, i.e., a qualitative statement of potential risk. If the Panel concludes that adverse effects may result, the conclusions should specify the population sub-group (e.g., occupational group), sex or life stage in which such exposures may result in adverse reproductive or developmental effects. The rationale of the Panel in reaching this conclusion should be clearly described.

Although strict categories of potential risk are not prescribed for use by the panels, the narrative conclusions should qualify the likelihood of an adverse effect under specified exposure conditions using terms such as unlikely, likely, or highly likely. Previous panel reports can serve as examples for the wording of such conclusions.

5.4 Critical Data Needs

As a result of conducting the evaluation, the Panel is asked to identify critical data gaps, i.e., tests or experiments that could provide information to substantially improve an assessment of human reproductive risks. Inclusion of these critical research and testing needs in the report will provide a basis for government agencies to set research and testing priorities. It is important that the data needs identified are critical to improved risk evaluations. Data needs that are simply desirable or generally informative can be presented but should be clearly distinguished from critical needs.

6.0 References

The bibliography for each report will be prepared and maintained by the CERHR staff. Panel members should provide the staff with complete citation or source information on publications they feel should be added. When possible, reprints should be provided.

7.0 Data Tables

Data tables will be prepared and provided by the staff of the CERHR. Panel members are expected to review the tables for completeness and accuracy.

III. GUIDELINES FOR THE EVALUATION OF INDIVIDUAL STUDIES

Evaluation of Studies in Humans

(applies to sections 2, 3, and 4 of the Expert Panel Report)

Studies should be organized by type, e.g., case reports, descriptive studies, cohort studies, case-control studies. A brief, factual synopsis of each study, to include the information listed below, should be provided.

Case Reports:

A brief narrative summary of the report.

Descriptive Studies:

A brief narrative summary of the report.

Cohort Studies:

To the extent possible, a summary of each study should include information on:

- size, sex, race, and other descriptions of the original cohort

- nature of the health outcome studied and how the outcome was ascertained

- geographical location of the study

- dates of study cohort participation start and finish

- exposure studied, how measured, duration, and level of exposure

- possible confounding exposures and how measured

- criteria for inclusion / exclusion

- response and follow-up rates

- size of final cohort

- basis for risk estimation

- method of analysis

- power of study

- overall quality of the study and potential for bias, e.g., selection, recall, etc., of any type in the results

- estimates of risk and associated measures of uncertainty, e.g., 95% confidence intervals or standard errors

Case-Control Studies:

To the extent possible, a summary of each study should include information on:

- population base

- geographical location of the study

- source of case ascertainment and how endpoints were measured

- time period covered

- selection and number of controls

- source of information on exposures and how measured

- response rates of cases and controls

- method of controlling for potential confounders and how measured

- power of study

- overall quality of the study and potential for bias, e.g., selection, recall, etc., of any type in the results

- estimates of risk and associated measures of uncertainty, e.g., 95% confidence intervals or standard errors

Comments on the quality of the study (design, execution, analysis, and interpretation) should include the following factors:

-is the adverse health outcome well defined and appropriately measured?

- is the exposure well defined and appropriately measured?

- are the controls appropriate?

- are potential confounding factors identified?

- what were the confounding variables and were they measured and controlled for appropriately?

- was there evidence of a dose-effect relationship?

- is the interval between time of exposure and time of observation appropriate?

- are statistical methods clear and appropriate?

- was the power of the study adequate to detect an associationof the size expected?

- what were the potential effect modifiers and were they measured and analyzed appropriately?

Evaluation of Studies in Experimental Animals

(applies to sections 2, 3, and 4 of the Panel Report)

Experiments should be organized by animal species and route of administration. A brief, factual summary of each study should be provided, which includes the following information:

- numbers of animals in each treated and control group

- species, strain, and sex

- age at beginning and end of treatment

- route of administration

- purity of substance

- solvent or vehicle

- controls (untreated, solvent, positive)

- doses

- dosing schedule

- basis for dose selection

- duration of treatment

- endpoints observed

- method of examination

- age at observation

- number of animals and/or litters observed

- statistical methods utilized

- statistical significance

- author's conclusions supported by the data

- GLP study

Whenever these items of information are not given in a publication, this fact should be noted in square brackets, e.g., [strain not specified]. Likewise, when a limitation is noted in a study, this should also be noted in square brackets, e.g., [only 3 mice were observed in the high dose group, an inadequate number to reach a conclusion]. Conclusions other than the author's may be reached by the Panel but must be clearly identified as the Panel's, explained, and included in square brackets.

When necessary to help interpret individual studies or facilitate comparison among studies, the Panel may choose to convert units of exposure, conduct additional statistical analyses, reach its own conclusions on effect as a function of exposure, or use the published data to calculate summary measures such as bench mark doses. All such cases of recalculation or reinterpretation must be clearly noted in square brackets, e.g., [The Panel converted the ppm in feed to mg/kg bw/day based on daily food intake].

Comments on the quality of a study (design, execution, analysis, and interpretation) should take into consideration the following factors:

- was an appropriate number of animals used?

- were they randomly assigned to experimental groups?

- was the test chemical defined, source and purity stated?

- was there chemical verification of dosing preparations?

- were age of animals and duration of exposure appropriate?

- were appropriate endpoints observed?

- were endpoints observed at appropriate life stages?

- were data reported in appropriate detail?

- were appropriate statistics employed?