DOD Business Systems Modernization:
Air Force Business System Schedule and Cost Estimates
GAO-14-152: Published: Feb 7, 2014. Publicly Released: Mar 10, 2014.
Additional Materials:
- Highlights Page:
- Full Report:
- Accessible Text:
Contact:
What GAO Found
The Air Force's schedule that supported the February 2012 Milestone B decision for the Defense Enterprise Accounting and Management System (DEAMS) did not meet best practices. The cost estimate did meet best practices, but the issues associated with the schedule could negatively affect the cost estimate. GAO found that the schedule supporting the Air Force's decision to invest in DEAMS partially or minimally met the four characteristics for developing a high-quality and reliable schedule. For example, the schedule did not reflect all government and contractor activities, and resources were not assigned to specific activities. The schedule also lacked a valid critical path, preventing management from focusing on the activities most likely to cause critical program delays if they are not completed as planned. In addition, a schedule risk analysis was not conducted to predict a level of confidence in meeting the program's completion date.
Extent DEAMS Schedule Met Best Practices
Characteristic |
Assessment |
Comprehensive |
Partially met |
Well-constructed |
Partially met |
Credible |
Minimally met |
Controlled |
Partially met |
Source: GAO analysis based on information provided by the Air Force.
GAO found that the October 2012 updated schedule estimate was not comprehensive, well-constructed, and credible, and contained weaknesses similar to those found in the previous schedule. In May 2013, program officials provided a third schedule that they said contained some improvements but acknowledged that issues remained that prevented the schedule from meeting best practices.
GAO found that the DEAMS cost estimate fully or substantially met the four characteristics of a high-quality and reliable cost estimate. For example, the cost estimate included both government and contractor costs for the program over its life cycle and provided for an independent assessment and reconciliation. Because the cost estimate relies on dates derived from the schedule and GAO is questioning the reliability of the schedule, the credibility of the cost estimate could be affected.
Extent DEAMS Cost Estimate Met Best Practices
Characteristic |
Assessment |
Comprehensive |
Fully met |
Well-documented |
Substantially met |
Accurate |
Substantially met |
Credible |
Substantially met |
Source: GAO analysis based on information provided by the Air Force.
Why GAO Did This Study
The Department of Defense (DOD) has stated that the development and implementation of DEAMS is critical to the department's goal of producing auditable financial statements by September 2017. In October 2010, GAO reported that although the Air Force had developed a cost estimate that met best practices, it had not developed a schedule that met best practices for implementing DEAMS. GAO has published guides that identify the characteristics and associated best practices for developing reliable schedule and cost estimates. GAO was asked to review the schedule and cost estimates for selected DOD systems. This report addresses the extent to which the current schedule and cost estimates for DEAMS were prepared in accordance with GAO's Schedule and Cost Guides.
Specifically, GAO's review focused on the schedule and cost estimates that supported DOD's February 2012 Milestone B decision, which determined that investment in DEAMS was justified. GAO assessed the schedule and cost estimates and supporting documentation. GAO also assessed an updated schedule dated October 2012. GAO interviewed DEAMS program officials, lead schedulers, and cost estimators.
What GAO Recommends
GAO recommends that the Secretary of the Air Force update the cost estimate as necessary after implementing GAO's prior recommendation to adopt scheduling best practices. DOD concurred with the recommendation.
For more information, contact Asif A. Khan at (202) 512-9869 or khana@gao.gov.
Recommendation for Executive Action
Status: Open
Comments: We have reviewed the Defense Enterprise Accounting and Management System (DEAMS) integrated master schedule (IMS) three times since 2012 and the most recent review was on the October 2015 IMS. There has not been any significant improvement in the quality of the schedules over this timeframe. As a result, we do not plan to conduct any further reviews on the DEAMS IMS. We requested and obtained a copy of the DEAMS cost estimate from the DEAMS program management office. We will assess the DEAMS cost estimate to determine if the Air Force has taken sufficient action to address this recommendation on the cost estimate. This recommendation remains open.
Recommendation: To help provide for the successful implementation of DEAMS, the Secretary of the Air Force should direct the Under Secretary of the Air Force, in his capacity as the Chief Management Officer, to consider and make any necessary adjustments to the DEAMS cost estimate after addressing our prior recommendation to adopt scheduling best practices.
Agency Affected: Department of Defense: Department of the Air Force
Explore the full database of GAO's Open Recommendations
»
Nov 1, 2016
-
Defense Intelligence:
Additional Steps Could Better Integrate Intelligence Input into DOD's Acquisition of Major Weapon SystemsGAO-17-10: Published: Nov 1, 2016. Publicly Released: Nov 1, 2016.
Oct 31, 2016
-
DOD Inventory of Contracted Services:
Timely Decisions and Further Actions Needed to Address Long-Standing IssuesGAO-17-17: Published: Oct 31, 2016. Publicly Released: Oct 31, 2016. -
Joint Intelligence Analysis Complex:
DOD Partially Used Best Practices for Analyzing Alternatives and Should Do So Fully for Future Military Construction DecisionsGAO-16-853: Published: Sep 30, 2016. Publicly Released: Oct 31, 2016.
Oct 26, 2016
-
Presidential Travel:
Estimated Costs for a Specific Presidential Trip to Illinois and FloridaGAO-17-24: Published: Oct 11, 2016. Publicly Released: Oct 26, 2016. -
Joint Information Environment:
DOD Needs to Strengthen Governance and Management [Reissued on October 25, 2016]GAO-16-593: Published: Jul 14, 2016. Publicly Released: Jul 14, 2016.
Oct 24, 2016
-
Military Personnel:
Performance Measures Needed to Determine How Well DOD's Credentialing Program Helps Servicemembers [Reissued on October 21, 2016]GAO-17-133: Published: Oct 17, 2016. Publicly Released: Oct 17, 2016.
Oct 20, 2016
-
Security Assistance:
Guidance Needed for Completing Required Impact Assessments Prior to Presidential DrawdownsGAO-17-26: Published: Oct 20, 2016. Publicly Released: Oct 20, 2016.
Oct 17, 2016
-
Global Positioning System:
Observations on Quarterly Reports from the Air ForceGAO-17-162R: Published: Oct 17, 2016. Publicly Released: Oct 17, 2016.
Oct 12, 2016
-
DOD Civilian and Contractor Workforces:
Additional Cost Savings Data and Efficiencies Plan Are NeededGAO-17-128: Published: Oct 12, 2016. Publicly Released: Oct 12, 2016.
Sep 26, 2016
-
Waste Management:
DOD Has Generally Addressed Legislative Requirements on the Use of Burn Pits but Needs to Fully Assess Health EffectsGAO-16-781: Published: Sep 26, 2016. Publicly Released: Sep 26, 2016.
Looking for more? Browse all our products here