The Systems Evaluation Protocol for evaluation planning
We describe the major implementation approaches and the tools and resources that support evaluation planning in RSE embodied in the Systems Evaluation Protocol (SEP), a step ‐by‐step guide to the tasks that every evaluation should address. The SEP provides both a conceptual framework for thinking about evaluation and a set of specific methods and tools that expand awareness of the influences of multiple parts of complex systems. The SEP is implemented through a part nership approach, joining evaluators and program professionals in an iterative, phased approach to evaluation planning, which also often emphasizes evaluat...
Source: New Directions for Evaluation - April 26, 2021 Category: Universities & Medical Training Authors: Jennifer Brown Urban,
Monica Hargraves,
Jane Buckley,
Thomas Archibald,
Claire Hebbard,
William M. Trochim Tags: ORIGINAL ARTICLE Source Type: research
Resonance, stickiness, and the value propositions of Evaluation Capacity Building: Key takeaways and future directions
AbstractThis paper presents the results of a study of program participants ’ responses to an innovative project called the Partnerships for Advancing Character program Evaluation (PACE), which operationalized a Relational Systems Evaluation (RSE) approach to Evaluation Capacity Building (ECB). We examine which tools and concepts from PACE resonated with participants and were sustained, and why. Analysis of participant interviews yielded sixteen distinct value propositions that they associated with the PACE training. Importantly, a number of them extend beyond evaluation to include contributions to other aspects of progra...
Source: New Directions for Evaluation - April 26, 2021 Category: Universities & Medical Training Authors: Monica Hargraves,
Jane Buckley,
Jennifer Brown Urban,
Miriam R. Linver,
Lisa M. Chauveron,
Satabdi Samtani,
Thomas Archibald,
Leslie Moorman Tags: ORIGINAL ARTICLE Source Type: research
Appendix —2017 Competency Survey Demographic and Quantitative Results1
(Source: New Directions for Evaluation)
Source: New Directions for Evaluation - March 8, 2021 Category: Universities & Medical Training Tags: Research Article Source Type: research
Issue Information
(Source: New Directions for Evaluation)
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Tags: Issue Information Source Type: research
Editor's Notes
(Source: New Directions for Evaluation)
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Jean A. King Tags: Editors' Notes Source Type: research
Grounding the 2018 AEA Evaluator Competencies in the Broader Context of Professionalization
AbstractProfessionalization has become a major focus of discussion in the evaluation community, and the process of professionalizing the field of evaluation has provoked strong reactions, both positive and negative, from scholars and practitioners alike. The purpose of this chapter is not to take a stand on the merit or worth of the arguments that proponents and detractors routinely make, but to situate the newly approved 2018 AEA Evaluator Competencies within the larger framework of professionalization. This chapter first presents a broad overview of the steps involved in professionalizing any field, then uses it to descr...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Sandra Ayoo,
Yuanjing Wilcox,
John M. LaVelle,
Donna Podems,
Gail Vallance Barrington Tags: Research Article Source Type: research
The Story of the AEA Competencies Task Force (2015 –2018)
AbstractThis chapter tells the story of American Evaluation Association's (AEA's) Competencies Task Force. During the 1990s, the AEA Board addressed issues related to the professionalization of the field, but chose not to move ahead with the development of competencies. Twenty years later, the global expansion of evaluation led to increasing professionalization around the world. In 2015, AEA's Board created a Competencies Task Force to formally address the issue of developing evaluator competencies for the association. This chapter describes the three ‐year development process: the Task Force formation, its processes, th...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Susan A. Tucker,
Eric Barela,
Robin Lin Miller,
Donna R. Podems Tags: Research Article Source Type: research
Commentary on the Editor's Notes and Chapters 1, 2, and 3
AbstractThe Editor's Notes were included in this commentary due to the subtle distinction between evaluation as a profession and the more focused idea of specific evaluator competencies, the core of Chapters 1 –3. Separating the two concepts was useful and created a canvas upon which to paint these comments. The chapters contain descriptions of the history underlying the 2015–2018 AEA Competencies Task Force, activities it undertook, and the final product, the competencies. Together, they demonstrate an essential competency, documenting processes and products, and are an invaluable record for future evaluators working ...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: James W. Altschuld Tags: Research Article Source Type: research
Using the 2018 AEA Evaluator Competencies for Evaluator Education and Professional Development
AbstractThis chapter addresses using the 2018 American Evaluation Association (AEA) Evaluator Competencies to structure evaluator education and training, the benefits of doing so, and the negative consequences when the competencies are not used. It discusses what educator use of competencies might look like in the design of educational experiences and the eventual potential for the accreditation of university ‐based and nonuniversity training programs. The chapter concludes by calling on evaluator education programs to take an evaluative look at their own offerings. (Source: New Directions for Evaluation)
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: John M. LaVelle,
Nicole Galport Tags: Research Article Source Type: research
Next Steps for AEA and the Newly Created AEA Professionalization and Competencies Working Group
AbstractThe final chapter summarizes the content of Parts I and II, addresses issues raised by our critical friends in Chapters 4 and 8, and offers multiple steps that the newly formed American Evaluation Association (AEA) Professionalization and Competencies Working Group may consider exploring when it addresses its three charges. Overall suggestions include four areas of activity: continuing development of the competencies, encouragement of voluntary use in a variety of spheres, extensive engagement of the AEA membership, and exploration of additional ways to professionalize the field. A summary table identifies specific...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Susan A. Tucker,
Jean A. King Tags: Research Article Source Type: research
Presenting the 2018 AEA Evaluator Competencies
AbstractThis chapter presents the Board ‐approved 2018 American Evaluation Association (AEA) Evaluator Competencies. It begins by introducing and briefly explicating each of the five competency domains—professional practice, methodology, context, planning and management, interpersonal—then details the specific competencies that comp rise each domain. The chapter continues by identifying and discussing persistent member concerns that emerged across all forms of member feedback during the development process. It concludes by naming three broad areas of potential use of the competencies, each of which is the subject of ...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Jean A. King,
Laurie Stevahn Tags: Research Article Source Type: research
Using the 2018 AEA Evaluator Competencies for Effective Program Evaluation Practice
AbstractThe ultimate goal of using the 2018 AEA Evaluator Competencies is effective program evaluation practice. This chapter suggests how the competencies can be used to enhance professional practice by individual evaluators, organizations/institutions, and evaluation associations. Individual use includes self ‐assessing expertise, pursuing professional development, and using common evaluation language. Organizational use includes guiding internal evaluations or university evaluator education programs and curricula, seeking external assistance, and cultivating institutional learning. Association use inc ludes sponsoring...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Laurie Stevahn,
Dale E. Berger,
Susan A. Tucker,
Anna Rodell Tags: Research Article Source Type: research
Power, Privilege, and Competence: Using the 2018 AEA Evaluator Competencies to Shape Socially Just Evaluation Practice
AbstractTwenty ‐first century evaluators face an imperative to recognize their privileged role in navigating socially complex terrain in ways that are ethical, demonstrate sensitivity to local and global social inequities, and reflect awareness of contested views of reality. Social justice and equity are increas ingly viewed as a foundation of practice, necessitating that evaluators learn how to address potential power imbalances occurring within evaluations, the larger contexts in which those evaluations occur, and the emerging profession itself. This chapter addresses how the 2018 American Evaluation Asso ciation (AEA)...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Hazel Symonette,
Robin Lin Miller,
Eric Barela Tags: Research Article Source Type: research
Competencies, Self ‐awareness, and Practice: Notes on My Reading of Chapters 5–7
AbstractAs part of this NDE issue with its focus on the 2018 American Evaluation Association (AEA) Evaluator Competencies, this chapter discusses the content and delivery of material in Chapters 5 through 7. The reviewed chapters, and therefore this article, address potential uses of the 2018 AEA Evaluator Competencies to promote professional self ‐knowledge, enhance education and training programs for new and in‐service professionals, and facilitate evaluator and evaluation pursuit of social justice. This chapter will assist readers of these chapters by providing a review from the perspective of an experienced evaluat...
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Melvin E. Hall Tags: Research Article Source Type: research
Editor's Notes
New Directions for Evaluation, Volume 2020, Issue 168, Page 7-11, Winter 2020. (Source: New Directions for Evaluation)
Source: New Directions for Evaluation - January 25, 2021 Category: Universities & Medical Training Authors: Jean A. King Tags: Editors' Notes Source Type: research
