Evaluation Theory, Models, and Applications is designed for evaluators and students who need to develop a commanding knowledge of the evaluation field: its history, theory and standards, models and approaches, procedures, and inclusion of personnel as well as program evaluation. This important book shows how to choose from a growing array of program evaluation approaches.
Now in its second edition, Evaluation Theory, Models, and Applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference. The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation approaches. With new evaluation designs and the inclusion of the latest literature from the field, this Second Edition is an essential update for professionals and students who want to stay current. Understanding and choosing evaluation approaches is critical to many professions, and Evaluation Theory, Models, and Applications, Second Edition is the benchmark evaluation guide.
Now in its second edition, Evaluation Theory, Models, and Applications is the vital text on evaluation models, perfect for classroom use as a textbook, and as a professional evaluation reference. The book begins with an overview of the evaluation field and program evaluation standards, and proceeds to cover the most widely used evaluation approaches. With new evaluation designs and the inclusion of the latest literature from the field, this Second Edition is an essential update for professionals and students who want to stay current. Understanding and choosing evaluation approaches is critical to many professions, and Evaluation Theory, Models, and Applications, Second Edition is the benchmark evaluation guide.
Theoretical approaches used in implementation science have three overarching aims: describing and/or guiding the process of translating research into practice (process models); understanding and/or explaining what influences implementation outcomes (determinant frameworks, classic theories, implementation theories); and evaluating implementation (evaluation frameworks).
However, the last decade of implementation science has seen wider recognition of the need to establish the theoretical bases of implementation and strategies to facilitate implementation. There is mounting interest in the use of theories, models and frameworks to gain insights into the mechanisms by which implementation is more likely to succeed. Implementation studies now apply theories borrowed from disciplines such as psychology, sociology and organizational theory as well as theories, models and frameworks that have emerged from within implementation science. There are now so many theoretical approaches that some researchers have complained about the difficulties of choosing the most appropriate [6-11].
It was possible to identify three overarching aims of the use of theories, models and frameworks in implementation science: (1) describing and/or guiding the process of translating research into practice, (2) understanding and/or explaining what influences implementation outcomes and (3) evaluating implementation. Theoretical approaches which aim at understanding and/or explaining influences on implementation outcomes (i.e. the second aim) can be further broken down into determinant frameworks, classic theories and implementation theories based on descriptions of their origins, how they were developed, what knowledge sources they drew on, stated aims and applications in implementation science. Thus, five categories of theoretical approaches used in implementation science can be delineated (Table 1; Figure 1):
The how-to-implement models typically emphasize the importance of careful, deliberate planning, especially in the early stages of implementation endeavours. In many ways, they present an ideal view of implementation practice as a process that proceeds step-wise, in an orderly, linear fashion. Still, authors behind most models emphasize that the actual process is not necessarily sequential. Many of the action models mentioned here have been subjected to testing or evaluation, and some have been widely applied in empirical research, underscoring their usefulness [9,55].
Implementation researchers are also wont to apply theories from other fields such as psychology, sociology and organizational theory. These theories have been referred to as classic (or classic change) theories to distinguish them from research-to-practice models [45]. They might be considered passive in relation to action models because they describe change mechanisms and explain how change occurs without ambitions to actually bring about change.
Although evaluation frameworks may be considered in a category of their own, theories, models and frameworks from the other four categories can also be applied for evaluation purposes because they specify concepts and constructs that may be operationalized and measured. For instance, Theoretical Domains Framework (e.g. [127,128]), and Normalization Process Theory [129] and COM-B (e.g. [130,131]) have all been widely used as evaluation frameworks. Furthermore, many theories, models and frameworks have spawned instruments that serve evaluation purposes, e.g. tools linked to PARIHS [132,133], CFIR [134] and Theoretical Domains Framework [135]. Other examples include the EBP Implementation Scale to measure the extent to which EBP is implemented [136] and the BARRIERS Scale to identify barriers to research use [137], as well as instruments to operationalize theories such as Implementation Climate [138] and Organizational Readiness [139].
With an emphasis on constructing a sound foundational knowledge base, this course is designed to provide an overview of both past and contemporary perspectives on evaluation theory, method, and practice. Course topics include, but are not limited to, basic evaluation concepts and definitions, evaluation as a cognitive activity, the view of evaluation as a transdiscipline, the general and working logic of evaluation, an overview of the history of the field, distinctions between evaluation and basic and applied social science research, evaluation-specific methods (e.g., needs assessment, stakeholder analysis, identifying evaluative criteria, standard setting), reasons and motives for conducting evaluation, central types and purposes of evaluation, objectivity, bias, and validity, the function of program theory in evaluation, evaluator roles, core competencies required for conducting high quality, professional evaluation, audiences and users of evaluation, alternative evaluation models and approaches, the political nature of evaluation and its implications for practice, professional standards and codes of conduct, and emerging and enduring issues in evaluation theory, method, and practice. Although the major focus of the course is program evaluation in multiple settings (e.g., education, criminal justice, health and medicine, human and social services, international development, science and technology), examples from personnel evaluation, policy analysis, and product evaluation also are used to illustrate foundational concepts. Throughout the course, critical thinking and active learning are emphasized.
This Guide reviews theories of science that have influenced the development of common educational evaluation models. Educators can be more confident when choosing an appropriate evaluation model if they first consider the model's theoretical basis against their program's complexity and their own evaluation needs. Reductionism, system theory, and (most recently) complexity theory have inspired the development of models commonly applied in evaluation studies today. This Guide describes experimental and quasi-experimental models, Kirkpatrick's four-level model, the Logic Model, and the CIPP (Context/Input/Process/Product) model in the context of the theories that influenced their development and that limit or support their ability to do what educators need. The goal of this Guide is for educators to become more competent and confident in being able to design educational program evaluations that support intentional program improvement while adequately documenting or describing the changes and outcomes-intended and unintended-associated with their programs.
aa06259810