Inside IES Research

Since 2014, IES has funded the Center for the Analysis of Postsecondary Readiness (CAPR) to answer questions about the rapidly evolving landscape of developmental education at community colleges and open-access four-year institutions. CAPR is providing new insights into how colleges are reforming developmental education and how their reforms are impacting student outcomes through three major studies:

• A survey and interviews about developmental education practices and reform initiatives
• An evaluation of the use of multiple measures for assessing college readiness
• An evaluation of math pathways.

Preliminary results from these studies indicate that some reforms help more students finish their developmental requirements and go on to do well in college-level math and English.

National Study of Developmental Education Policies and Practices

CAPR has documented widespread reform in developmental education at two- and four-year colleges through a national survey and interviews on developmental education practices and reforms. Early results from the survey show that colleges are moving away from relying solely on standardized tests for placing students into developmental courses. Colleges are also using new approaches to delivering developmental education including shortening developmental sequences by compressing or combining courses, using technology to deliver self-paced instruction, and placing developmental students into college-level courses with extra supports, often called corequisite remediation.

Developmental Math Instructional Methods in Public Two-Year Colleges (Percentages of Colleges Implementing Specific Reform Strategies)

Notes: Percentages among two-year public colleges that reported offering developmental courses. Colleges were counted as using an instructional method if they used it in at least two course sections. Categories are not mutually exclusive.

Evaluation of Developmental Math Pathways and Student Outcomes

CAPR has teamed up with the Charles A. Dana Center at the University of Texas at Austin to evaluate the Dana Center Mathematics Pathways (DCMP) curriculum at four community colleges in Texas. The math pathways model tailors math courses to particular majors, with a statistics pathway for social science majors, a quantitative reasoning pathway for humanities majors, and an algebra-to-calculus pathway for STEM majors. DCMP originally compressed developmental math into one semester, though now the Dana Center is recommending corequisite models. Instructors seek to engage students by delving deeply into math concepts, focusing on real-world problems, and having students work together to develop solutions.

Interim results show that larger percentages of students assigned to DCMP (versus the traditional developmental sequence) enrolled in and passed developmental math. More of the DCMP students also took and passed college-level math, fulfilling an important graduation requirement. After three semesters, 25 percent of program group students passed a college-level math course, compared with 17 percent of students assigned to traditional remediation.

Evaluation of Alternative Placement Systems and Student Outcomes (aka Multiple Measures)

CAPR is also studying the impact of using a combination of measures—such as high school GPA, years out of high school, and placement test scores—to predict whether students belong in developmental or college-level courses. Early results from the multiple measures study show that, in English and to a lesser extent in math, the multiple measures algorithms placed more students into college-level courses, and more students passed those courses (compared to students placed with a single test score).

College-Level English Course Placement, Enrollment, and Completion in CAPR’s Multiple Measures Study (Percentages Compared Across Placement Conditions)

College-Level Math Course Placement and Completion in CAPR’s Multiple Measures Study

Looking Ahead to the Future of Developmental Education

These early results from CAPR’s evaluations of multiple measures and math pathways suggest that those reforms are likely to be important pieces of future developmental education systems. CAPR will release final results from its three studies in 2019 and 2020.

Guest blog by Nikki Edgecombe and Alexander Mayer

Nikki Edgecombe is the principal investigator of the Center for the Analysis of Postsecondary Readiness, an IES-funded center led by the Community College Research Center (CCRC) and MDRC, and a senior research scientist at CCRC. Alexander Mayer is the co-principal investigator of CAPR and deputy director of postsecondary education at MDRC.

From 2002 to 2013, the Institute of Education Sciences has funded scores of research grants with a focus on improving mathematics education. Many of the outcomes of that research have been captured in a new publication, Synthesis of IES-funded Research on Mathematics.  

This Synthesis was co-authored by Bethany Rittle-Johnson, of Vanderbilt University, and Nancy C. Jordan, of University of Delaware, two nationally recognized experts in the area of mathematics education research. The co-authors reviewed published research and organized the synthesis for the public to answer the overarching question—What have we learned? The short answer: A lot!

Here’s a look at the new Synthesis by the numbers:

200

Between 2002 and 2013, IES has funded almost 200 grants on mathematics learning and teaching through its two research centers—the National Center for Education Research (NCER) and National Center for Special Education Research (NCSER).

69

The co-authors synthesized what was learned from 69 IES-funded grants that had peer-reviewed publications published between January 1, 2002, and June 30, 2014. Grants that did not have peer-reviewed publications during that time frame were not included in this synthesis.

28

The Synthesis summarizes 28 contributions that IES grants have made in furthering our understanding of mathematics teaching and learning for students in kindergarten through high school. A summary of research findings is provided for each contribution, along with citations to the publications that will allow practitioners, policymakers, and researchers to access more information about the findings if they are interested.

2

The research contributions listed in the Synthesis are divided into two sections

1. Improving Mathematics Learning in two areas: Whole numbers, operations, and word problem solving in elementary school, and fractions and algebra in the middle grades; and
2. Development and Evaluation of Teacher Professional Development Approaches.

65%

The Synthesis cites research that shows that annual income is 65 percent higher among adults who have taken calculus in high school than among adults who have completed only basic mathematics. It is our hope that this Synthesis will spark efforts to improve American students’ math proficiency and increase their interest in taking higher level math.

So, where do we go from here? IES will continue to make significant contributions to mathematics education research and practice. In particular, the co-authors of the Synthesis recommend the following future directions for IES-funded research in mathematics:

• Replication: Studies of promise or ones that demonstrate positive results must be replicated and extended to ensure that the findings can be reproduced in different educational settings, improve student achievement on measures used by teachers and schools, and lead to improvements that can be sustained over time;
• Innovation: Future work should continue to innovate and test new strategies for improving mathematics achievement. Research should examine the features of interventions that most effectively build concepts and skills in mathematics topics and address whether observed gains can be transferred to other areas of mathematics learning; and
• Context: Future research must continue to address what works for whom and under what conditions.

Although the Synthesis provides a broad overview of the contributions IES-funded research has made in mathematics education, it is not exhaustive. There are many more IES-funded studies that did not have published results by June 30, 2014. These studies are likely to produce additional findings on mathematics learning on these topics, as well as on topics not addressed in the Synthesis, such as mathematics learning in high school. Also, it should be noted that other centers and programs within IES conduct research and evaluation on mathematics that can be helpful to researchers, practitioners, and policymakers.

For more information, visit our website, or follow us on Facebook and Twitter.

Samuel Choo is a doctoral student at the dissertation stage in the Department of Early Childhood, Special Education, and Rehabilitation Counseling at the University of Kentucky (UK). In this blog post, he describes how working on an IES grant gave him first-hand experiences in planning and carrying out research in schools. He also discusses how these research experiences helped him understand the important connections between research and teaching.

By Christina Chhin, NCER Program Officer and Rob Ochsendorf, NCSER Program Officer

Here is a common question we receive at IES: “What has IES funded in the areas of mathematics and science?” Given that both NCER and NCSER have dedicated “Mathematics and Science Education” research topics, you would think it would be an easy question to answer. That is until you see that both NCER and NCSER also support projects focusing on math and science through other research topic areas, including programs such as Cognition and Student Learning, Early Learning Programs and Policies, Educational Technology, and Effective Teachers and Effective Teaching. To help answer this question, IES has just released a compendium of research grants focusing on mathematics or science funded between 2002 to 2013. This compendium is part of a series of documents intended to summarize the research investments that NCER and NCSER are making to improve student education outcomes in specific topical areas.

As noted in the compendium, between 2002 to 2013, NCER and NCSER has funded over 300 projects focused on mathematics or science education, with 215 of them being instructional interventions (e.g., packaged curricula, intervention frameworks, and instructional approaches), 75 professional development programs, 165 educational technologies, and 65 assessments in math and science. The math and science compendium is a useful tool for a wide array of education stakeholders, as it not only provides brief descriptions of each project, it also is categorizes each project into sections based on content area, grade level, and intended outcome.

So, how does the investment in mathematics and science that NCER and NCSER have made compare to other education research investments? Between 2002 and 2013, NCER and NCSER funded more than 1,110 education research grants, so research on mathematics and science makes up approximately a third of the research centers' total investment.  The compendium shows that NCER and NCSER have made significant contributions to STEM education by supporting rigorous, scientifically valid research that is relevant to education practice and policy focused on mathematics and science education; however, there is still room for growth. For instance, the compendium makes apparent that NCER and NCSER have funded few projects focusing specifically on geometry or earth and space science in grades K to 12. NCER and NCSER have come a long way in helping to support high-quality mathematics and science education research and will continue to do so to help address the gaps and needs in the field. 

Do you have a research project that will address some of these identified gaps? If so, be sure to sign up for IES Newsflash or follow us on Twitter, so that you will receive notice when our new Requests for Applications are released. 

Questions? Comments? Send us an email at IESResearch@ed.gov.

By Liz Albro, NCER Associate Commissioner of Teaching and Learning

New Evaluation of State Education Programs and Policies Awards Announced

Congratulations to the recipients of our Evaluation of State Education Programs and Policies awards. These projects examine a range of topics: low-performing schools, college- and career-readiness standards, and teacher effectiveness and evaluation.

Building Strength in Numbers: Friends of IES Briefings

The Friends of IES, a coalition of research organizations working to raise the visibility of IES-funded studies, asked three IES funded researchers to participate in briefings for Department of Education leadership and for the public on Capitol Hill. Sharing findings from their IES-funded studies, the researchers highlighted how providing high quality mathematics instruction to children as young as three-years-old, and providing systematic and sustained opportunities for those children to learn more mathematics in subsequent instructional years, can substantially narrow achievement gaps at the end of preschool and how those gains can persist over time. What to know more? Read our earlier blog post or the AERA news story for additional details.

Congratulations to Patricia Snyder on receiving the 2015 DEC Award for Mentoring

Congratulations to Patricia Snyder, recipient of the 2015 Division for Early Childhood (DEC) Award for Mentoring. DEC, a division of the Council for Exceptional Children, awards this honor to a member who has provided significant training and guidance to students and new practitioners in the field of early childhood special education. Snyder is a professor of special education and early childhood studies and the David Lawrence Jr. Endowed Chair in Early Childhood Studies at the University of Florida. She is also the Principal Investigator (PI) and Training Program Director for a NCSER-funded postdoctoral training grant, Postdoctoral Research Training Fellowships in Early Intervention and Early Learning in Special Education at the University of Florida. She has also served as the PI and co-PI on several other NCSER-funded awards.

Thanks to all of our IES Postdoctoral Fellows: Past, Present and Future!

Did you know that the third week of September was National Postdoc Appreciation Week? While we tweeted our appreciation for the postdocs we support through our NCER and NCSER Postdoctoral Training Programs, we thought you might like to learn a bit more about what some of our postdocs are doing.

Publishing: Postdocs are busy publishing findings from their research. For example, David Braithwaite, a fellow in this Carnegie Mellon postdoctoral training program recently published Effects of Variation and Prior Knowledge on Abstract Concept Learning. Two postdoc fellows, Kimberly Nesbitt and Mary Fuhs, who were trained in this Vanderbilt postdoctoral training program, are co-authors on a recent publication exploring executive function skills and academic achievement in kindergarten.  Josh Polanin, another Vanderbilt postdoc, recently published two methodological papers: one on effect sizes, the other on using a meta-analytic technique to assess the relationship between treatment intensity and program effects.

Receiving Research Funding:  Previous postdoc fellows who trained at the University of Illinois, Urbana-Champaign have recently been awarded research funding. Erin Reid and her colleagues were recently awarded an NSF DRK-12 grant to adapt and study a teacher professional development (PD) intervention, called Collaborative Math (CM), for use in early childhood programs. Former fellow David Purpura was recently awarded a grant from the Kinley Trust to delineate the role of language in early mathematics performance. Dr.  Purpura is also co-PI on a 2015 IES grant, Evaluating the Efficacy of Learning Trajectories in Early Mathematics.

Congratulations and good luck to all of our recently complete postdocs! Sixteen fellows have completed this year with 10 completing in the past two months. These fellows bringing their expertise to the community as full-time faculty, directors of research programs, and research associates at universities, non-profits, government agencies, and other organizations.

What have the Research Centers Funded? Check Out Our New Summary Documents

NCSER has funded research in a variety of topics relevant to special education and early intervention since 2006. Recently, NCSER staff summarized the work on several topics, with more to come in the future.

Research supported by both Centers is also described in our Compendium of Mathematics and Science Research, which was released in October.

Updated IES Research in the News

Curious to know what other IES-funded research projects have gotten media attention? We recently updated our IES Research in the News page, so that’s your quickest way to find out!