|
|
ENERGY INFORMATION ADMINISTRATION
INFORMATION QUALITY GUIDELINES
"EIA is the first place to go for the last word on energy."
EIA, created by Congress in 1977, is a statistical agency of the U.S. Department of Energy (DOE) and is one of the ten principal statistical agencies in the Federal government. EIA provides policy-independent data, forecasts, and analyses to promote sound policymaking, efficient markets, and public understanding regarding energy and its interaction with the economy and the environment. EIA information products are used by public and private analysts and policymakers to monitor the current status and trends of energy supply and consumption.
EIA’s activities in the creation, collection, maintenance, and dissemination of information include:
(For a general discussion of major Federal statistical agencies’ activities, including their quality programs, see the Federal Register (67 FR 38467) notice jointly issued by the agencies on June 4, 2002.)
EIA’s information dissemination activities adhere to separate information quality guidelines issued by the Office of Management and Budget (OMB), DOE, and EIA. EIA's intention is that those guidelines shall apply to information prepared by EIA for public dissemination and disseminated on or after October 1, 2002, regardless of when the information was first disseminated. Discussions of the applicable quality guidelines follow.
2. Office of Management and Budget (OMB) Information Quality Guidelines
In response to section 515 of the Treasury and General Government Appropriations Act for Fiscal Year 2001 (Public Law 106-554), the U.S. Office of Management and Budget (OMB) issued final information quality guidelines on February 22, 2002 (67 FR 8452) and directed Federal agencies to issue guidelines for ensuring and maximizing the quality of information they disseminate.
3. Department of Energy Information Quality Guidelines
The Department of Energy (DOE) information quality guidelines apply to all DOE components. DOE is also providing a mechanism for a person to request correction of DOE-disseminated information that the person believes does not comply with applicable information quality guidelines.
4. Energy Information Administration Information Quality Guidelines
EIA has performance standards to ensure the quality (i.e., objectivity, utility, and integrity) of information it disseminates to the public. Quality is ensured and maximized at levels appropriate to the nature and timeliness of the disseminated information. EIA also strives for transparency about information and methods in order to improve understanding and to facilitate reproducibility of the information. Additional information about EIA's quality program is available at our information quality guidelines Web site.
EIA’s commitment to quality and professional standards of practice includes:
To carry out its mission, EIA assumes responsibility for:
In conjunction with its information collection and dissemination activities, EIA is fully in compliance with the Paperwork Reduction Act of 1995 (PRA), Public Law 104-13. EIA shall use the PRA clearance process to help improve the quality of information disseminated to the public. EIA demonstrates in its PRA submissions to OMB the "practical utility" of a proposed information collection that EIA plans to disseminate. Additionally, for a proposed information collection that EIA plans to publicly disseminate, EIA shall evaluate the collection in light of applicable information quality guidelines and state in its PRA clearance submission to OMB that the information will be collected, maintained, and used in a manner consistent with the OMB, DOE, and EIA information quality guidelines.
With available resources, EIA continually works to improve its systems in order to provide high quality information needed by public and private policymakers and decisionmakers. EIA standards underlie its quality guidelines. The standards document the professional basis upon which EIA expects to be judged by our stakeholders and the level of quality and effort expected in all our activities, including those of our contractors.
For many years, EIA has utilized standards, policies, and other operational guidance to ensure the quality of its activities. EIA’s current Standards Manual is available. (The Manual is also available in Microsoft Word format.)
Following is a general discussion of the EIA’s commitment to performance standards for quality.
Objectivity involves ensuring the substance of the information is accurate, reliable, and unbiased, and the information is presented in an accurate, clear, complete, and unbiased manner. Objectivity is achieved for EIA’s information products by having qualified people use reliable data sources and sound analytical and forecasting techniques to prepare information products that undergo careful reviews prior to dissemination.
Much of the information disseminated by EIA is based on surveys sponsored by EIA. EIA-sponsored surveys are conducted using methodologies that are consistent with generally accepted professional standards for all aspects of surveys, including frame development; statistical design; questionnaire design and testing; data collection; and control of sampling and nonsampling errors through nonresponse analysis, imputation of missing data, and development of weights, adjustments, and variance estimates, as appropriate. EIA surveys and information systems are documented and explanatory materials are made available for EIA information products.
EIA's surveys are also approved by OMB under the Paperwork Reduction Act of 1995. (An inventory of EIA surveys is available in the EIA Survey Forms.)
EIA information products may also use data produced or maintained by other U.S. government agencies, other information organizations, and foreign organizations. EIA's use of this information facilitates public access. External information is assessed prior to EIA's dissemination of the information. However, the performance standards applied to information generated by EIA cannot be applied to information from external sources. In disseminating non-EIA information, EIA focuses on using the best available information and ensuring the transparency of that information.
Data users are encouraged to consider the initial sources of information presented in EIA’s information products and to determine the suitability of such information for their purposes.
EIA analytical reports are prepared using a variety of analytical techniques, including simple tabulations with descriptive summary statistics, multivariate statistical methods, and econometric models. Analytical techniques are reviewed for their appropriateness to the data and the analysis being conducted and are clearly identified in reports.
EIA uses models to conduct analyses and produce forecasts. Most models used by EIA have been developed by EIA staff or by contractors under direction from EIA. When EIA uses a proprietary model from another organization, EIA undertakes an analysis of the model to ensure its appropriateness before including the model results as part of an information product. Models are documented, tested, and evaluated prior to their use in conjunction with EIA information products.
EIA models are based on best judgments of current and future behavioral relationships and methods of projection. The models are periodically updated to reflect input from internal and external reviews and research findings on behavioral relationships. All updates are documented.
EIA models have detailed documentation describing the goals and objectives of the model, the data sources being used, and the methodologies and assumptions employed. Model documentation is available on EIA’s Web site at Recent Energy Model Documentation or from the model manager. (An inventory of EIA models is available in the Directory of EIA Models.)
EIA information products are based on surveys, models, and external information sources. Appropriate quality control procedures are used in all steps of preparing information products. Documentation of EIA information products is designed to improve understanding of the information so that users may assess the suitability of the information for their needs.
Information products are reviewed by technically qualified staff prior to dissemination to ensure their quality. Products that are considered to be more technically complex may also be reviewed by independent expert reviewers from outside EIA to provide additional perspective and expertise. The level of review an information product is subjected to prior to dissemination is determined by the characteristics of the product and EIA-established review procedures.
EIA informs users of the concepts and methodologies used in collecting and processing the data, the quality of the data disseminated, and other features that may affect the use or interpretation. By providing information on methodologies and concepts to information users, EIA enables users to make judgments and verify that the data they are using are similar in conceptual framework and definitions to the data they need to complete their work.
The information also allows users to better understand possible sources of error which might restrict their uses of the data. In the area of statistical information, objectivity requires acknowledging that errors in statistical estimates are unavoidable. These errors generally fall under the categories of sampling and nonsampling errors. Sampling errors result when estimates are based on a sample and not a complete enumeration of the population of interest. EIA provides information regarding what is known about the magnitude of these errors, such as variances or coefficients of variation to quantify the magnitude of sampling errors. Though quantifying nonsampling errors is more difficult, EIA does provide information to assist users in understanding those possible error sources.
If a substantive error is detected after a product is disseminated, EIA will make correction and issue an errata notice or other notification as appropriate.
EIA’s information may be revised after initial dissemination to reflect more complete information or other changes in the underlying data. EIA information products may include information that is preliminary and is expected to be revised, and revisions made to information previously disseminated. Preliminary and revised data are noted.
Utility refers to the usefulness of the information to its intended users. Utility for EIA’s information products is achieved by continuously monitoring information needs and developing new information sources or by revising existing information collection methods, models, and information products when appropriate.
EIA’s information products are widely available and broadly accessible. EIA’s efforts to ensure the utility of information products shall include:
Integrity refers to the security of information from unauthorized access or revision to ensure that the information is not compromised through corruption or falsification. EIA ensures the integrity of its information products by adhering to applicable policies and programs.
EIA shall ensure the integrity of its disseminated information in the following ways:
4.d Influential Information - Transparency and Reproducibility
Influential scientific, financial, or statistical information shall include a high degree of transparency to facilitate its reproducibility.
EIA has several information products that are considered influential because they are subject to embargo procedures given their impact on markets. For influential information, EIA shall have a high degree of transparency of data and methods ensuring the capability to reproduce the information.
EIA also disseminates important energy information that does not fall within DOE's influential information category, but the information does have many public and private uses. EIA shall strive for transparency about such information and methods in order to improve users’ understanding and to facilitate reproducibility.
To help ensure transparency and reproducibility, EIA requires documentation of systems and models and appropriate explanatory materials (e.g., information sources, survey and analytical methods, accuracy, and reliability) to accompany disseminated information. Standards also require freezing or archiving the input and output data used in disseminated information, as well as archiving the version of any model used. Estimates and projections in EIA’s information products are directly reproducible by agency officials and contractors. Many underlying data sets contain proprietary or sensitive information and are treated as confidential; hence they could not be available to, or be reproduced by, the public. Analytical results may not be easily reproducible by third parties due to the complexity and detail of the methods and data. EIA places great emphasis on its review process to ensure the quality of information disseminated. EIA will ensure reproducibility for all influential information using commonly accepted scientific, financial, and statistical standards. EIA will apply rigorous robustness checks to all analytical results before information is disseminated.
EIA also achieves transparency through wide dissemination of its information by use of the EIA Web site primarily, but also by printing some products. Releases of information products are announced on the EIA Web site and most electronic versions can be accessed and downloaded directly from the site.
5. EIA Information Subject to Information Quality Guidelines
EIA's intention is that all applicable information quality guidelines shall apply to information prepared by EIA for public dissemination and disseminated on or after October 1, 2002, regardless of when the information was first disseminated. An information product disseminated by EIA before October 1, 2002, that is no longer updated or maintained but is still available from EIA (e.g., archived information in EIA's files or in electronic files that EIA continues to distribute on its Web site) is not subject to the guidelines or to the request for correction process.
EIA information not subject to information quality guidelines includes:
Questions - EIA is fully committed to working with both information providers and users. If you have questions about EIA, its surveys, its models, or its information products, please contact EIA’s National Energy Information Center (NEIC) or an EIA staff person who is an expert on a specific energy topic.
National Energy Information Center - Provides statistical and analytical energy data, information, and referral assistance to the government and private sectors, academia, and the public.
EIA Energy Experts – EIA staff members who are experts on specific energy topics (e.g., coal, electric power, natural gas, petroleum, nuclear, renewable energy, or energy consumption).National Energy Information Center (NEIC)
1000 Independence Avenue, SW
EI-30, Room 1E-238, Forrestal Building
Washington, DC 20585
Phone: (202) 586-8800
Fax: (202) 586-0727
E-Mail: infoctr@eia.doe.gov
NOTE: Respondents to EIA surveys who report using EIA forms should not use the procedure below to correct or revise information submitted on an EIA survey form. For correcting information submitted on an EIA form, please refer to the appropriate form and contact that form’s manager using the information at EIA Survey Forms.
Requests for Correction
DOE has established administrative mechanisms allowing persons to seek and obtain, where appropriate, timely correction of information maintained and disseminated by EIA that does not comply with the OMB, DOE, or EIA information quality guidelines. For more information about the correction process or to request correction, visit the DOE Information Correction Request Web Site.
With respect to a correction of EIA information, EIA will follow established procedures for handling such requests. The correction process is designed to address the genuine and valid needs of EIA and its customers in the context of EIA’s on-going operations. The correction process includes a review by EIA staff familiar with the information for which correction is being requested to determine what action, if any, is necessary.
EIA will respond to the requestor. If the response to the request requires more than 60 calendar days to resolve, EIA will inform the requestor that more time is required, the reason why, and an estimated decision date. Upon deciding that information requires correction, EIA shall provide notice of the intention to correct.
If a person is not satisfied with the response to a request for correction, the requestor may submit an appeal to DOE within 30 days of the decision. EIA will respond to a request for appeal within 60 days of receipt. If the appeal requires more than 60 calendar days to resolve, EIA will inform the requestor that more time is required, the reason why, and an estimated decision date. For more information about the appeal process or to submit an appeal, visit the DOE Information Correction Request Web Site.
An appeal with respect to EIA information will be forwarded to EIA’s Statistics and Methods Group (SMG) for review to determine what action is appropriate. SMG is independent from the EIA program office that disseminated the information and that handled the initial request for correction
|
|
Return to EIA Home Page |
File Last Modified: October 2, 2002
Contact:
Jay.Casselberry@eia.doe.gov
Jay Casselberry, EI-70
DOE/Energy Information Administration
1000 Independence Avenue SW
Washington, DC 20585-0670
Phone: (202) 287-1717
FAX: (202) 287-1705
URL: http://www.eia.doe.gov/smg/EIA-IQ-Guidelines.html
For help with technical problems, please contact: wmaster@eia.doe.gov
Phone: (202) 586-8959