Appendix II. Fiscal Year 2002 Performance (Report) Summary (continued)

GPRA Goal 4: Evaluate the effectiveness and impact of AHRQ research and associated activities.
Performance Objective FY Targets Actual Performance Reference*
Goal 4 continued: 99 Objective 4.1 Evaluate the impact of AHRQ sponsored products in advancing methods to measure and improve health care. Cont. 99:
  • An evaluation of the outcomes of outcomes research and the impact of AHRQ-supported outcomes and effectiveness research on clinical practice.
Completed.  
  • An evaluation and synthesis of (1) primary care research supported by AHRQ and (2) an assessment of the current state of the science and future directions for primary care research.
Progress report  
  • AHRQ's state data strategy will be redesigned based on consultations with state policy makers, researchers, hospital associations, and others about their past use of data from the Healthcare Cost and Utilization Project (HCUP) as well as additional data needs.
Completed.  
  • Results of the evaluation of the Consumer Assessment of Health Plan Study (CAHPS®) will be used to improve the usability and usefulness of the tool. Findings are expected to show whether (a) the survey-based information from CAHPS® helps consumers make better health care decisions, (b) the information increases consumer confidence when choosing health care plan, and (3) CAHPS® is used by public and private organizations.
Preliminary results.  
  • Evaluation studies on: (1) the quality and usefulness of the evidence reports and technology assessments produced by the Evidence-based Practice Centers and (2) the impact of the use of these products on the health care system will be developed and initiated in FY 1999.
Final report received in June 2000.  
01-02 Objective 4.2: Evaluate the impact of MEPS data and associated products on policymaking and research products. 02:
  • Have a fully functional MEPS-based MEDSIM model to allow simulation of the potential impact of programmatic changes in health care financing and delivery Dec 2002.
  CB
  • Produce baseline FY statistics on number of MEPS-based articles published in peer review journals.
Completed. CB
  • Conduct customer satisfaction survey for MEPS workshop participants to assess how MEPS data is being used to inform research and public policy.
Completed. CB
  • Develop marketing plan to promote the MEPS-IC data to state officials Dec 2002.
  CB
  • At least 5 examples of how research using MEPS has been used to inform decisions by Federal, state and private sector policymakers.
Completed. CB
01:
  • Use of MEPS data in AHRQ research applications will increase by 10 percent over number received in baseline period of 2000
Not attained. CB
  • Feedback from MEPS workshop participants indicating that they were useful and timely.
Completed. CB
  • At least 5 examples of how research using MEPS has been used to inform decisions by Federal, state and private sector policymakers.
Completed. CB
00:
See above 4.1 for 00
   
99: Objective 4.2: Evaluate major dissemination mechanisms.
  • AHRQ Clearinghouse customer satisfaction rated at 98%.
Met. CB
  • Customer satisfaction data on AHRQ consumer publications (useful/relevant) rated at 90%.
81.3%  
01 Objective 4.3: n/a
00 Objective 4.3: Evaluate the impact of MEPS data and associated products on policymaking and research projects.
  • Use of MEPS data in 1% of research applications received by AHRQ.
MEPS used in 31% of funded projects  
  • Distribution of MEPS data sets to at least 2500 requestors.
5,700 data sets; 379 CD ROMs  
  • At least 5 examples of how research using MEPS has been used to inform decisions by Federal, state, and private sector policymakers.
15 examples given  
  • Feedback from recipients of MEPS data indicating that the data were timely, useful, and of high significance.
Met.  
GPRA Goal 5: Support initiative to improve health care quality through leadership and research.
Performance Objective FY Targets Actual Performance Reference*
00-02 Objective 5.1: Conduct research to help to measure the current status health of care quality in the Nation. 02:
  • Integration of at least one private sector data source into the national quality report by 31 December 2002.
Completed. B:35-36
01:
  • QI Taxonomy meeting held under the auspices of the QuIC.
Completed. CB
  • Number of grants and contracts funded in FY 2001 that will help to fill gaps in the information available to assess the national quality of care, or will help to expand the use of current measures to provide a broader or richer picture of quality.
Completed.  
00:
  • Data sources identified that will contribute information as part of the mosaic picture of quality of care in the Nation.
Final recommend.
March 2001
CB
  • Develop and begin to test some questions to be added to existing data collection activities to provide a better picture of quality.
Survey completed.
Fielded during FY 2001
CB
  • Develop framework for National Healthcare Quality Report.
Final report 30
March 2001
B:35
  • Provide leadership for the Executive Branch's Quality Interagency Coordination Task Force (QuIC).
Met: (details pp.110-111) CB
99 Objective 5.1: Provide leadership for the Executive Branch's Quality Interagency Coordination Task Force (QuIC) 99:
  • Collaborative work groups are established under the QuIC under take projects with direct application to improving quality of care.
Met.  
  • In addition to the work on specific projects chosen by the QuIC, communication is facilitated on common issues such as: 1) Implementation of the Bill of Rights and Responsibilities from the President's Commission on Consumer Protection and Quality in the Health Care Industry; And 2) organization or management strategies to improve quality of care.
   
Goal 5 continued: 00-02 Objective 5.2: Facilitate use of quality information to improve health care in the Nation. 02:
  • Funding of at least 5 projects bringing healthcare information to the public in an understandable, user friendly manner which facilitates its use in decision making.
  CB
01:
  • Number of grants to improve patient safety.
Funded > 40. B:31-35
  • Adoption of Agency sponsored research and tools developed by one or more users to facilitate consumers/purchaser/decisionmaker use of information about quality
Completed.  
00:
  • Development of at least one tool that can be used by large group purchasers in assisting their beneficiaries to choose the health care plan, provider, or hospital that best meets their needs.
3 examples given. CB
99 Objective 5.2: Conduct research to expand the tool box of measures and risk adjustment methods available help to measure the current status of quality in the nation. 99:
  • Inventory of measures and risk adjustment methods currently in use by Federal Agencies will be developed.
Met.  
  • Assessment of measures and risk adjustment methods needed by Federal Agencies will be conducted.
Met.  
00-02 Objective 5.3: Improve quality measurement. 02:
Adoption of at least one quality measure to be developed from our vulnerable populations RFA by a national accrediting organization.
  CB
01:
  • Identification of collaborators for research projects on electronic medical records integrated with guidelines (e.g., from the Guideline Clearinghouse) or QI indicators (e.g., CONQUEST, QI Taxonomy project, HCUP measures).
Completed. CB
  • Adoption of Living With Illness children's health measure by NCQA.
Completed. CB
00:
  • Sponsor research to fill existing gaps in quality measures in areas of high need.
Met. (Details p.112)  
99 Objective 5.3: Inform health care organizational leaders and others how to design quality into their systems 99:
  • Review research conducted that identifies appropriate ways of redesigning health care delivery systems to reduce errors.
Met.  
00: Discontinued
99 Objective 5.4: Improve understanding of how to ensure that research affects clinical practice as appropriate
99:
Research on effective dissemination of information to decisions makers including patients, clinicians, organizational leaders, purchasers, and public policy makers conducted.
Met.  

Budget Line 2: Medical Panel Expenditure Surveys

GPRA Goal 6: Collect current data and create data tapes and associated products on health care use and expenditure for use by public and private-sector decision makers and researchers. (MEPS)
Performance Objective FY Targets Actual Performance Reference*
99-02 Objective 6.1: Release and disseminate MEPS data and information products in timely manner for use by researchers, policy makers, purchasers, and plans. 02:
  • Develop a method to facilitate user's custom cross tabulations of MEPS data.
Completed. CB
  • Conduct six MEPS data user workshops.
Completed.  
  • Expand MEPS list-server participation by 20%.
Completed.  
  • Produce 4 Findings and at least one Chartbook.
Completed.  
  • Develop Frequently Asked Questions Section for MEPS web site.
Completed.  
99-02 Objective 6.1: Release and disseminate MEPS data and information products in timely manner for use by researchers, policy makers, purchasers, and plans. Cont. 01:
  • In FY 2001, 1997 Use and Expenditures, 2000 Point-in-Time, and 1998 Health Insurance and Demographics MEPS public use data files will be released.
Completed. CB
  • Response time for requests received for information, assistance or specific products is as promised 95 percent of time
Completed. CB
  • Core MEPS public use files (PUFs) available through Web site and CD-ROM within 9-18 months after data collection completed.
Available within 12 months CB
  • Specific products due in FY 2000:
  CB
          + 1999 point-in-time file Released:
July 2000
 
          + 1997 expenditure data available Released:
Available 1st quarter 2001
 
          + 1996 full panel file available Released:
Jan 2000
 
  • Customer satisfaction data from use of MEPS tapes and products rated at least 90%.
Rated at 90% CB
  • Response time for requests received from policymakers, purchasers and plans for MEPS data tapes, analyses, and/or reports responded to within promised time frames 95% of time.
96% within 4 days CB
  • Core MEPS public use files (PUFs) available through Website and CD-ROM within 9-12 months after data collection completed.
Significant progress made. CB
  • Specific products due in FY 1999:
  CB
          + 1997 point-in-time file. Delivered:
March 1999
 
          + 1996 full-year expenditure file. Delivered:
Dec. 1999
 
          + 1996 full-year event, job, and condition files. Delivered:
Job and Condition Files delivered
 
          + 1998 point-in-time file. Delivered:
November 1999 and August 1999 respectively; event files will be available by March, 2000
 
Goal 6 continued: Objective 6.1
  • Research findings and survey reports developed and disseminated for use by policy makers and researchers including MEPS Research Findings, MEPS Highlights, chart books, peer-reviewed journal articles, book published on contributions of expenditure surveys to policy making, publications oriented toward non-researchers.)
30+ publications related to MEPS B:A5-A-6
  • Customer satisfaction data from use of MEPS tapes and products rated at 85%.
Ratings between 86-96% CB
  • Requests received from policymakers, purchasers and plans for MEPS data tapes, analyses, and/or reports responded to within promised time frames 85% of the time.
Requests filled within 5 days uniformly. CB
Goal 6 continued:
99-02 Objective 6.2: Facilitate use of MEPS data and associated products as tools by extramural researchers, policy makers, purchasers, and plans.
02:
  • Determine the feasibility of existing mechanisms to provide off-site access to confidential MEPS data.
Completed. CB
  • Expand data center capacity by 10% over FY 01 level.
  CB
01:
  • Establish baseline for Data Center use capacity.
Completed. CB
  • Data centers operational
Deferred to Jan 2001 CB

          + # requests for use of the centers
          + # user-days at the data centers
          + # projects completed

   
99:
  • Inclusion of MEPS data in extramural research grants with AHRQ and other funders.
Included in 20 applications, 5 funded.  
  • Plan for extramural researcher access to MEPS data fully implemented
Met.
Fully up Feb. 2000.
 
01-02 Objective 6.3: Modify MEPS to support annual reporting on quality, health care disparities, and research on long-term care in adults and children with special needs. 02:
  • Process and make available data to be included in the National Quality Report.
Completed. B:78
  • Begin data collection to support the disparities report Sept 2002.
Completed. B:78
01:
  • Data collection begins on the treatment of common clinical conditions over time for a nationally representative portion of the population in support of the National Healthcare Quality Report.
Completed. CB
  • LTC Measures:
  CB
  1. Have developed data use agreements (DUA) with HCFA to assess and begin data development related to the MDS.
Completed.  
  1. Design MEPS over sample of adults with functional limitations and children with special needs.
Not funded.  
  1. Produce one report related to LTC.
Completed.  
  1. Have developed IAA with NCHS for LTC frame development activities.
Not funded.  
  1. Submit at least one peer-reviewed publication in the area of LTC.
Completed.  
00 Objective 6.3: Modify and enhance MEPS to enable reporting on the quality of health care in America as part of FY 2000 Priority (3), A New Tools for a New Century. 00:
  • The design decisions necessary for the expansion of MEPS databases in order to collect data that will support the National Healthcare Quality Report are completed by August 2000. The design decisions will be operationalized in the coming fiscal years.
Met. (Details pp. 117-119)  
99 Objective 6.3: Modify and enhance MEPS to enable reporting on the quality of health care in America. 99:
  • MEPS Household Survey: Interviews with 9,000 previously surveyed families to obtain calendar year 1998 health care data, and with 5,600 new families.
Met.  
  • MEPS Medical Provider Survey: Interviews with approximately 3,000 facilities, 12,000 office-based providers, 7,000 hospital-identified physicians, and more than 500 home health providers.
Met.  
  • MEPS Insurance Component (MEPS-IC): Interviews with more than 40,000 employers and 1,000 insurance carriers.
Met.  
  • MEPS data collection successfully moved to ongoing survey mode from data collection every ten years.
Met.  

Budget Line 3: Program Support

GPRA Goal 7: Support the overall direction and management of AHRQ
Performance Objective FY Targets Actual Performance Reference*
Objective 7.1 is mandatory (Capital Assets) but not applicable to AHRQ.      
00-99 Objective 7.2: Maintain acquisition performance management system to ensure: (1) timely completion of transactions, (2) vendor and customer satisfaction, and (3) efficient and effective use of resources. 01: Discontinued    
00:
  • Internal customer satisfaction rated at minimum of 4.5/5.
Rated 4.2 CB
  • External customer satisfaction rated at 4.5/5.
Rated 4.6 CB
  • Customer satisfaction survey results assessed and used to implement changes to improve and enhance services.
Met. CB
99:
  • Internal customer satisfaction rated at minimum of 4.5/5.
4.4 CB
  • External customer satisfaction rated at 4/5.
4.0  
  • Customer satisfaction survey results assessed and used to implement changes to improve and enhance services.
Met.  
Goal 7 continued:
00-99 Objective 7.3: Continued enhancement and expansion of Agency Intranet site to ensure staff have immediate access to all current information.
01: Discontinued    
00:
  • Customer satisfaction rated at minimum of 3.5/4.
3.2/5.0 CB
  • Demonstration through customer satisfaction surveys that the daily work of staff has been facilitated by the Intranet.
Met. CB
  • Assessment of customer satisfaction surveys and use of such surveys to implement changes to improve and enhance services as necessary.
Met. CB
99:
  • Customer satisfaction rated at minimum of 3.5/4.
3.1/4  
  • Customer satisfaction surveys assessed and used to implement changes to improve and enhance services as necessary.
Met.  
Goal 7 continued:
01-02 Objective 7.4: Establish and maintain a secure Agency computer network infrastructure.
02:
  • Perform initial tests, (periodically, beginning in 2nd quarter of FY 2002) to evaluate the preliminary policies and procedures.
Completed. CB
01:
  • Preliminary policies and procedures for reducing security risks will be developed by the end of FY 2001.
Completed. CB
  • Initial criteria for reporting security incidents will be established by the end of CY 2001.
Completed.  
  • Initial procedures for responding to security incidents will be established by the end of CY 2001.
Completed.  
  • Implementation of a Secure Phase 1 LAN for analysis of intramural research and survey data will be completed by end of FY-01.
Completed.  
  • Implementation of a Phase 1 firewall, intrusion detection and virus control system will be in place by end of CY 2001.
Completed.  
  • Initial security awareness training will begin by end of CY 2001.
Completed.  

Return to Contents

Current as of April 2003


Internet Citation:

Performance Plans for FY 2003 and 2004 and Performance Report for FY 2002. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/about/gpra2004/gpra04a.htm


Return to Strategic Plan
About AHRQ
AHRQ Home Page
Department of Health and Human Services