Market Research:
Better Documentation Needed to Inform Future Procurements at Selected Agencies
GAO-15-8: Published: Oct 9, 2014. Publicly Released: Oct 9, 2014.
Additional Materials:
- Highlights Page:
- Full Report:
- Accessible Text:
Contact:
(202) 512-4841
dinapolit@gao.gov
Office of Public Affairs
(202) 512-4800
youngc1@gao.gov
What GAO Found
Market research guidance at the Departments of Defense (DOD), Homeland Security (DHS), and Transportation (DOT) and the Federal Aviation Administration (FAA) is consistent with federal regulations in terms of market research objectives and builds on the techniques for communicating with industry outlined in federal regulations. All four agencies require that market research be clearly documented and note that documentation can inform current and future procurements. GAO found, however, that the agencies' guidance varied on the specificity of market research documentation. For example, DOD, DHS, and FAA guidance identify specific market research elements to be documented. Based on analysis of these market research elements, GAO identified four elements which, if recorded, would provide an understanding of the research completed. These elements include the market research methods used, when it was conducted, an analysis of vendor capabilities, and a conclusion. DOT's market research guidance did not require specific elements to be documented, which increases the risk that it would not be available to inform future procurements.
All 28 contracts GAO reviewed included some evidence of the market research conducted. The market research conducted on the 12 higher dollar contracts GAO reviewed tended to be more robust and include more techniques that involved outreach to vendors—such as issuing requests for information to industry—which appeared to help promote competition. Agencies did not take advantage of many available market research techniques on the 16 lower dollar contracts GAO reviewed and as a result may have missed opportunities to promote competition (see figure).
Figure: Market research techniques for 28 contracts GAO reviewed
GAO also identified limitations in the market research for seven DOD and DHS lower dollar contracts that appeared to be incomplete or outdated. For example, DHS relied on incomplete information regarding potential vendors' ability to meet its requirement for parking services. Further, in 14 of the 28 contracts, the four agencies did not document one or more of four basic elements that GAO's review of agency guidance identified as important to the ability to understand the research. GAO identified this shortfall most often on lower dollar contracts reviewed at DOD and DHS. Internal control standards state that significant events need to be clearly documented so as to ensure management directives are carried out. Not documenting basic elements of the market research potentially limits the ability of agency acquisition personnel to use market research to inform future procurements, a goal identified in agency guidance.
Why GAO Did This Study
The federal government spends hundreds of billions of dollars annually to acquire goods and services from the private sector to support agency missions. Market research—the process used to collect and analyze data about capabilities in the market that satisfy agency needs—is critical to inform decisions about how best to acquire these goods and services.
GAO was asked to examine how federal agencies conduct and use market research. This report assesses (1) selected agencies' market research guidance and policy and (2) how selected agencies conducted market research on selected procurements. GAO reviewed federal regulations and market research policy and guidance at DOD, DHS, and DOT—three agencies GAO selected based on fiscal year 2012 contract obligations and the mix of products and services procured. GAO also reviewed policies and guidance issued by the FAA, which is not subject to the Federal Acquisition Regulation. To assess how market research was conducted on individual contracts, GAO reviewed a nongeneralizable sample of 28 contracts selected based on dollar value and analyzed contract files.
What GAO Recommends
To inform future acquisitions, GAO recommends that the Secretary of Transportation update its market research guidance and the Secretaries of Defense and Homeland Security take action to ensure their acquisition personnel clearly document the basic elements of the market research that was conducted. The agencies concurred with these recommendations.
For more information, contact Timothy J. DiNapoli at (202) 512-4841 or dinapolit@gao.gov.
Recommendations for Executive Action
Status: Open
Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
Recommendation: To help ensure that key market research information is available for current and future use, the Secretary of Transportation should update its market research guidance to specify, at a minimum, that four basic elements--the market research methods used, the timeframes when staff used them, an analysis of the capabilities of potential sources, and a conclusion based on this analysis--be documented.
Agency Affected: Department of Transportation
Status: Open
Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
Recommendation: To help promote competition, inform future acquisitions, and encourage the use of timely and complete market research, the Secretaries of Defense and Homeland Security should take action to ensure their acquisition personnel clearly document the basic elements of the market research that was conducted. More specifically, documentation should, at a minimum, include the market research methods used, the timeframes when staff used them, an analysis of the capabilities of potential sources, and a conclusion based on this analysis.
Agency Affected: Department of Homeland Security
Status: Open
Comments: When we confirm what actions the agency has taken in response to this recommendation, we will provide updated information.
Recommendation: To help promote competition, inform future acquisitions, and encourage the use of timely and complete market research, the Secretaries of Defense and Homeland Security should take action to ensure their acquisition personnel clearly document the basic elements of the market research that was conducted. More specifically, documentation should, at a minimum, include the market research methods used, the timeframes when staff used them, an analysis of the capabilities of potential sources, and a conclusion based on this analysis.
Agency Affected: Department of Defense
Explore the full database of GAO's Open Recommendations »
Dec 3, 2014
-
Federal Data Transparency:
Effective Implementation of the DATA Act Would Help Address Government-wide Management Challenges and Improve OversightGAO-15-241T: Published: Dec 3, 2014. Publicly Released: Dec 3, 2014.
Nov 14, 2014
-
2013 Government Shutdown:
Three Departments Reported Varying Degrees of Impacts on Operations, Grants, and ContractsGAO-15-86: Published: Oct 15, 2014. Publicly Released: Nov 14, 2014.
Nov 13, 2014
-
Program Evaluation:
Some Agencies Reported that Networking, Hiring, and Involving Program Staff Help Build CapacityGAO-15-25: Published: Nov 13, 2014. Publicly Released: Nov 13, 2014.
Nov 12, 2014
-
Federal Real Property:
Strategic Focus Needed to Help Manage Vast and Diverse Warehouse PortfolioGAO-15-41: Published: Nov 12, 2014. Publicly Released: Nov 12, 2014.
Oct 31, 2014
-
Government Efficiency and Effectiveness:
Inconsistent Definitions and Information Limit the Usefulness of Federal Program InventoriesGAO-15-83: Published: Oct 31, 2014. Publicly Released: Oct 31, 2014.
Oct 30, 2014
-
Federal Real Property:
More Useful Information to Providers Could Improve the Homeless Assistance ProgramGAO-14-739: Published: Sep 30, 2014. Publicly Released: Oct 30, 2014.
Oct 27, 2014
-
U.S. Postal Service:
Information on Recent Changes to Delivery Standards, Operations, and PerformanceGAO-14-828R: Published: Sep 25, 2014. Publicly Released: Oct 27, 2014.
Oct 24, 2014
-
Managing for Results:
Selected Agencies Need to Take Additional Efforts to Improve Customer ServiceGAO-15-84: Published: Oct 24, 2014. Publicly Released: Oct 24, 2014.
Oct 20, 2014
-
Federal Paid Administrative Leave:
Additional Guidance Needed to Improve OPM DataGAO-15-79: Published: Oct 17, 2014. Publicly Released: Oct 20, 2014.
Oct 9, 2014
-
Market Research:
Better Documentation Needed to Inform Future Procurements at Selected AgenciesGAO-15-8: Published: Oct 9, 2014. Publicly Released: Oct 9, 2014.
Looking for more? Browse all our products here