Program Assessment & Evaluation
ORAU is a company with a long-standing focus on education and workforce development, as well as a commitment to evaluation and continuous improvement, ensuring well-managed programs, efficient processes and services that produce desired outputs and outcomes.
The span of ORAU’s assessment and evaluation efforts includes evaluation of STEM education and workforce development programs for U.S. government agencies, private and non-profit organizations, and universities that target K-12 students and teachers; university students and faculty; and Ph.D.-level researchers.
To date, ORAU has produced more than 600 evaluation and data reports.
ORAU has experience evaluating national and international, single-site and multi-site STEM-focused programs and focuses on evaluating federally-funded programs, processes and services at national laboratories and universities. We conduct assessments and evaluations that inform stakeholders by providing outcome-oriented, data-driven information on projects or programs.
Our evaluation efforts are used to promote continuous improvement and to help assess if a program, process or service meets intended goals, outcomes, or performance metrics. To date, ORAU has produced more than 600 evaluation and data reports. ORAU has the technical capability and trained staff to conduct multiple concurrent evaluations and related activities for our clients, consistently safeguarding the integrity of evaluation data and meeting project deadlines.
What we do
- Design and plan customized evaluations
- Conduct comprehensive formative and summative annual evaluations for STEM-related programs
- Perform longitudinal evaluations of STEM workforce development programs
- Conduct process, organization, and service evaluations
- Contribute to proposal development and grant writing
- Organize and support data collection efforts
- Perform quantitative and qualitative data analysis
- Create data visualizations
- Report and present findings
- Facilitate workgroup meetings
Why choose ORAU?
We specialize in these types of program evaluations:
- External evaluations of STEM-focused grant programs (e.g., NSF-, NIH-, DOE-funded) based at universities and school systems
- Evaluation of portfolios of STEM workforce development research participation programs
- Annual and/or longitudinal evaluations of STEM workforce development programs and portfolios of programs
- STEM-related process, organization, or service evaluations
Examples of assessment and evaluation needs we can meet:
- Assisting with the articulation of logic models
- Conducting evaluability assessments and needs assessments
- Identifying stakeholders and prioritizing their needs
- Designing evaluation tools and strategies based on context-based best practices
- Conducting data collection activities related to program implementation, outputs, outcomes
- Summarizing data with appropriate qualitative and quantitative analytic techniques
- Disseminating findings to promote improvement and provide evidence of effectiveness and impact
- Assessing evaluation use and influence to increase the value of program evaluation
Areas of expertise and interest for evaluation and research studies:
- Collaboration theory and strategic partnerships
- Measurement of transdisciplinary skills in STEM fields
- Drivers of the mentor/mentee experience
- Development of professional networking in early career STEM
- Impacts of participation in research interest groups
- Application of STEM strategies to public health pipeline building
- Linkages between domain-specific constructs and measurement/evaluation tools
- Factors related to persistence among STEM majors
Erin Burr, Ph.D.
Senior Evaluator and Assessment and Evaluation Section Manager
Expertise: STEM workforce development and education evaluation in K-20 settings, strategic needs assessment in national laboratories and laboratory systems, impact evaluations/long-term follow-up studies, measurement of evaluation use and influence, applied experimental psychology
Burr has more than 15 years of experience designing, managing, and directing research and evaluation studies in STEM education and workforce development. She specializes in evaluating portfolios of STEM workforce development programs (research participation programs) at national laboratories, the experience and needs of supercomputer users and interdisciplinary programs in higher education. She has experience evaluating national and international, single- and multi-site STEM-focused programs and works with multiple federal agencies, universities and private organizations.
We're presenting at the 2018 American Evaluation Association Annual ConferenceDrs. Erin Burr, Kimberle Kelly, and Ann Martin will present multiple sessions during the annual American Evaluation Association Annual Conference in Cleveland, Ohio, Oct. 31 - Nov. 3, 2018.
For information about ORAU’s STEM program evaluations, contact Erin Burr at 865.241.4249 or Erin.Burr@orau.org.