If Not Us, Then Who? Evaluators of Color and Social Change
AbstractThe fiercest advocates for change are often program managers, policymakers, community members, and evaluators who themselves come from the minoritized communities they serve. As evaluators of African descent, we ask, “If not us, then who?” and are compelled to understand how our identities impact our perceived role and evaluation praxis. A survey conducted among evaluators of color who are diverse in age, gender, sector of employment, nation of origin, and years of experience revealed that an evaluator's ide ntity influences their role and evaluation praxis. We argue all evaluators, commissioners of evaluation,...
Source: New Directions for Evaluation - July 9, 2020 Category: Universities & Medical Training Authors: Aileen M. Reid, Ayesha S. Boyce, Adeyemo Adetogun, J. R. Moller, Cherie Avent Tags: Research Article Source Type: research

Examining Issues Facing Communities of Color Today: The Role of Evaluation to Incite Change
Discussion of key insights into present ‐day issues in advocacy‐oriented evaluation are included throughout. (Source: New Directions for Evaluation)
Source: New Directions for Evaluation - July 9, 2020 Category: Universities & Medical Training Authors: Leah C. Neubauer, Dominica McBride, Andrea D. Guajardo, Wanda D. Casillas, Melvin E. Hall Tags: Research Article Source Type: research

Inciting Social Change Through Evaluation
AbstractThis chapter summarizes and presents several current insights into our current understanding of structural racism. It then argues that evaluators have a role and a responsibility to step further into the arena by explicitly addressing structural racism in our evaluation projects. Lastly, drawing on our work at BECOME: Center for Community Engagement and Social Change, it outlines three strategies evaluators can adopt too, as we suggest, “step further into the arena.” (Source: New Directions for Evaluation)
Source: New Directions for Evaluation - July 9, 2020 Category: Universities & Medical Training Authors: Dominica McBride, Wanda Casillas, Jennifer LoPiccolo Tags: Research Article Source Type: research

Issue Information
New Directions for Evaluation, Volume 2020, Issue 165, Page 1-7, Spring 2020. (Source: New Directions for Evaluation)
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Tags: Issue Information Source Type: research

Editors ’ Notes
New Directions for Evaluation, Volume 2020, Issue 165, Page 9-16, Spring 2020. (Source: New Directions for Evaluation)
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Ann Webb Price, Kyrah K. Brown, Susan M. Wolfe Tags: Editors' Notes Source Type: research

Using a Principles ‐Focused Evaluation Approach to Evaluate Coalitions and Collaboratives Working Toward Equity and Social Justice
AbstractIn this chapter, the authors describe the relevance and importance of principles for collaborative evaluation work addressing inequities and social injustice. They provide a brief introduction to Principles ‐Focused Evaluation and describe Principles for Collaborating for Equity and Justice to provide a rational for using the Principles‐Focused Evaluation approach when evaluating collaboratives addressing inequities. They describe useful strategies for incorporating Principles‐Focused Evaluation into evaluation of such collaboratives, demonstrate how to apply it to other evaluation approaches and models, and ...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Susan M. Wolfe, Pamela D. Long, Kyrah K. Brown Tags: Research Article Source Type: research

Positioning Health Equity Within a Systems Thinking Framework to Evaluate Coalitions and Collaborative Initiatives
AbstractEvaluating coalitions and other community ‐driven efforts demands new approaches that can account for the complexity of collaborative efforts and inform ongoing innovation, including efforts to advance health equity. In this chapter, we present an evaluation framework developed in partnership between a university and local health coalitio n that combines systems thinking and equity principles. We first describe the evaluation needs and priorities of coalitions like this one that seeks to work across sectors to advance health equity, and then describe the framework and the ways it can bridge systems thinking and e...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Amy E. Hilgendorf, Travis R. Moore, Alexandra Wells, Julia Stanley Tags: Research Article Source Type: research

Evaluation Methods Commonly Used to Assess Effectiveness of Community Coalitions in Public Health: Results From a Scoping Review
AbstractCommunity coalitions are well established as an important strategy for addressing public health problems through the lens of health equity, social determinants of health, and/or a social ecologic perspective. After almost three decades of practice and research on community ‐based collaborative approaches, a large number of evaluations have been conducted to examine the processes of coalition formation, approaches to creating community change, and whether intermediate and longer‐term outcomes have been achieved. This chapter reports the results of a scoping review of the methods commonly used to evaluate communi...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Michelle C. Kegler, Sean N. Halpin, Frances Dunn Butterfoss Tags: Research Article Source Type: research

Evaluating Community ‐Based Coalitions: An Application of Best Practices to Improve Children's Health
AbstractThis chapter describes how Cook Children's Center for Children's Health (the Center) applies best practices in community ‐based coalition evaluation through the use of three guiding frameworks. The author provides an overview of the ten Guiding Principles to Coalition Evaluation, the Spectrum of Prevention, and Results‐Based Accountability, along with highlights of each framework's strengths and limitations. The a uthor also illustrates how the Center integrates these frameworks into their evaluation work and concludes with a discussion of five lessons learned. (Source: New Directions for Evaluation)
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Courtney Barnard Tags: Research Article Source Type: research

Readiness and Relationships Are Crucial for Coalitions and Collaboratives: Concepts and Evaluation Tools
AbstractCollaboration is identified as an essential component for the successful implementation of a wide range of policies and programs. A major collaboration challenge, particularly in large community initiatives, is the need for multiple organizations to develop strategic partnerships around a shared purpose. Due to the importance of collaboration in achieving desired outcomes, the readiness of organizations to collaborate, and the quality of relationships between organizations are key, particularly in the formation stage. This is especially true of community coalitions, where collaboration requires comprehensive planni...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Lauren Hajjar, Brittany S. Cook, Ariel Domlyn, Kassy Alia Ray, David Laird, Abraham Wandersman Tags: Research Article Source Type: research

Finding the Impact: Methods for Assessing the Contribution of Collective Impact to Systems and Population Change in a Multi ‐Site Study
AbstractJohn Kania and Mark Kramer put forward “Collective Impact” in 2011 as a framework for organizing multi‐sector collaborative efforts to achieve change at scale. The collective impact theory of change posits that by establishing and implementing its five conditions, groups can achieve meaningful systems changes to create long‐term gains in social and environmental conditions. While significant scale uptake has occurred, questions have remained about the degree to which collective impact, as an approach, actually works to achieve change at scale. In 2017, ORS Impact and Spark Policy Institute embarked on an ev...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Sarah Stachowiak, Jewlya Lynn, Terri Akey Tags: Research Article Source Type: research

Evaluating Networks Using PARTNER: A Social Network Data Tracking and Learning Tool
AbstractToday, cross ‐sector partners are working together and utilizing a systems approach to solve and tackle complex social problems facing their communities. While building cross‐sector organizational networks has become a best practice in solving complex problems, there is little guidance or evidence on how it can be accomplished without overburdening resource‐stressed systems. Social network analysis (SNA) is one method for evaluating networks using a quantitative approach to measure the strength of connections, how organizations position themselves in a network, leverage resources, and assess the qual ity and ...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Danielle M. Varda, Sara Sprong Tags: Research Article Source Type: research

New Directions for the Evaluation of Coalitions and Collaboratives
AbstractThis chapter summarizes the main points presented in the preceding chapters and highlights opportunities for advancing coalition evaluation. Four major suggestions for advancing coalition and collaborative evaluation are offered. First, there is a need for employing a systems/complexity perspective in coalition evaluation with associated frameworks and tools that can be applied in practice. Second, there is a need to incorporate principles of equity in coalition evaluation and to develop tools that can effectively capture processes and outcomes of equity ‐focused work. Third, there is a need for more empirical re...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Kyrah K. Brown, Susan M. Wolfe, Ann Webb Price Tags: Research Article Source Type: research

Model for Collaborative Evaluations as a Framework to Foster a Community of Collaborators
AbstractThe Model for Collaborative Evaluations (MCE) denotes an evaluation framework that supports a collaborative community. The six components of the MCE were designed to identify the situation, clarify the expectations, establish a collective commitment, ensure open communication, encourage effective practices, and follow specific guidelines to support collaboration. These six components instill strong relationships and trust among the stakeholders, fostering a community of collaborators that ensures the evaluation will be effective. The MCE uses a systems engineering approach to ensure the collaborative processes of t...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Liliana Rodr íguez‐Campos, Michael E. Mitchell, Rigoberto Rincones‐Gómez Tags: Research Article Source Type: research

Advancing the Measurement of Collective Community Capacity and the Evaluation of Community Capacity ‐Building Models
AbstractAlthough more communities, practitioners, and policymakers are recognizing the value of community capacity ‐building initiatives, more valid, reliable, and pragmatic measures of collective community capacity are needed to evaluate the effectiveness of such efforts. Over the past 6 years, there has been significant work to advance the measurement and evaluation of collective community capacity‐buildin g initiatives. Accomplishments include the design, testing, and implementation of the Adverse Childhood Experiences (ACEs) and Resilience Collective Community Capacity (ARC3) Survey; the adaptation of the ARC3 Surv...
Source: New Directions for Evaluation - March 20, 2020 Category: Universities & Medical Training Authors: Margaret Barnwell Hargreaves, Brandon Coffee ‐Borden, Natalya Verbitsky‐Savitz Tags: Research Article Source Type: research