Categories
Aging and Health Teaching

AGHE 800 – Evaluating Aging-Related Programs and Services

To enrol in this course, please visit: https://www.rehab.queensu.ca/academic-programs/aghe

This course introduces learners to evaluation principles and practice as applied to programs that address social, physical and economic determinants of wellness and participation for older adults. Learners will acquire skills necessary to identify and apply program evaluation methods to inform ongoing program development. Topics will include theoretical aspects of program evaluation, as well as strategies for program development, monitoring and change with a focus on participatory approaches. Current debates in the field will be discussed, with particular attention to issues underlying research and evaluation with older adult populations in community and institutional contexts. Attention will be given to knowledge mobilization strategies that foster inclusion, empowerment and innovation. 

After completing this course, students are expected to be able to demonstrate: 

  1. Skills in articulating and critiquing various approaches to program evaluation and development. 
  2. The ability to describe programs through depiction of the underlying program logic. 
  3. The ability to critique existing evaluation plans and reports in the context of aging-related programs and services. 
  4. The ability to prepare a plan for the evaluation of age-related programs and services. 
  5. Skills in applying evaluation knowledge to decision making. 
  6. Knowledge and understanding of strategies for reporting evaluation results to program administrators and other stakeholders for maximum utilization. 

Course is offered in:
Master of Science in Aging and Health, Faculty of Health Sciences, Queen’s University

Sessions taught: Winter 2020, Winter 2019

Categories
Social Innovation

Key Journals on Evaluation

The following is a list of journals that focus on evaluation theory and its application in various contexts and settings. These titles are recommended for readers looking to develop a grounding in evaluation theory and methodology.

American Journal of Evaluation
Each issue of the American Journal of Evaluation (AJE) explores decisions and challenges related to conceptualizing, designing and conducting evaluations. Four times/year it offers original, peer-reviewed, articles about the methods, theory, ethics, politics, and practice of evaluation.

Canadian Journal of Program Evaluation
The Canadian Journal of Program Evaluation seeks to promote the theory and practice of program evaluation. To this end CJPE publishes full-length articles on all aspects of the theory and practice of evaluation and shorter Evaluation Practice Notes which share practical knowledge, experiences and lessons learned. A third section of the journal, Addressing Challenges in Evaluation Practice, presents real-life cases written by evaluation practitioners. The journal has a particular interest in articles reporting original empirical research on evaluation. CJPE is a completely bilingual journal, publishing in both English and French. Readership includes academics, practitioners and policymakers. CJPE attracts authors and readers internationally.

New Directions for Evaluation
New Directions for Evaluation, a quarterly sourcebook, is one of two official journals of the American Evaluation Association. The journal publishes works on all aspects of evaluation, with an emphasis on presenting timely and thoughtful reflections on leading-edge issues of evaluation and the organizational, cultural, and societal context within which evaluations occur. 

Evaluation
The journal Evaluation launched in 1995, publishes fully refereed papers and aims to advance the theory, methodology and practice of evaluation. We favour articles that bridge theory and practice whether through generalizable and exemplary cases or theoretical and methodological innovation

Journal of MultiDisciplinary Evaluation 
The Journal of MultiDisciplinary Evaluation is a free, online journal published by the Evaluation Center at Western Michigan University. The journal focuses on news and thinking of the profession and discipline of evaluation.

Evaluation and Program Planning
Evaluation and Program Planning is based on the principle that the techniques and methods of evaluation and planning transcend the boundaries of specific fields and that relevant contributions to these areas come from people representing many different positions, intellectual traditions, and interests. The primary goals of the journal are to assist evaluators and planners to improve the practice of their professions, to develop their skills, and to improve their knowledge base.

Practical Assessment, Research & Evaluation
Practical Assessment, Research & Evaluation is a peer-reviewed online journal whose purpose is to provide free access to articles that can have a positive impact on assessment, research, evaluation, and teaching practice.

Categories
Teaching

PME 828 – Conducting Quality Program Evaluations

Program personnel plan and implement programs as a way to address the needs of intended users and their communities. These needs may be rooted in learning, recreation, behaviour, culture and health and well-being to name a few. Programs are often spearheaded by individual champions or working groups. Their focus is typically on program activities and the challenge of implementation. Rarely do they plan to learn, in any systematic way, about program design, about how the program is working or about how it could be improved following implementation.  This is an issue especially when data-informed decisions have to be made about whether programs should be supported, expanded, downsized or allowed to end.

The overall learning objectives for PME 828 are to:

  • Understand the history and purposes of educational evaluation 
  • Understand the factors and practices that contribute to a quality evaluation
  • Understand current models of evaluation and the needs they serve 
  • Make decisions that lead to a defensible design for systematic evaluative inquiry
  • Collect data about program processes, stakeholder  learning or performance and accurately interpret their meaning.Make appropriate judgments about the meaning of evaluation findings
  • Critique (using current literature and principles of evaluative inquiry examined in GDPI 802) the purposes, processes and methods proposed for evaluating a program
  • Take leadership in promoting effective evidence-informed program decision-making 
  • Report effectively to program or  organizational stakeholders what could be learned through evaluation activities 
  • Take leadership in promoting evidence-informed program and policy decision-making 
  • Mentor colleagues interested in learning more about their programs
  • Be able to argue the strengths and limitations of evidence-informed decision making 

Course is offered in:
Professional Master of Education, Faculty of Education, Queen’s University

Course authors: Drs. Lyn Shulha, Michelle Searle, Chi Yan Lam

Sessions Taught: Winter 2020, Winter 2019, Winter 2018, Fall 2017, Summer 2017

Categories
Teaching

PME 827 – Planning and Implementing Effective Classroom Assessment

The assessment of learning and achievement is a global phenomenon. Over the last 2 decades there has been considerable research demonstrating how well conceived assessment can be a powerful force both in supporting learning, and as a mechanism for individual empowerment. Yet, no matter how clearly assessment policies are defined, how concisely strategies for implementing assessment are described, and how many sample instruments are available for adoption or adaptation, the planning and implementing of assessment in classrooms continues to be a complex “wicked problem”.

Students who complete this course will develop a clear sense of the multiple and overlapping purposes for assessment and be better positioned to reason, justify, and communicate their decision-making in assessment to students, their parents and administrators. In addition, they will become more confident in using assessment information to create summaries of student achievement.

The overall learning objectives for PME 827 are to:

  • To examine theories that underpin contemporary assessment practices.
  • To explore the complexity of planning and implementing classroom assessment.
  • To develop the competencies necessary to become a school leader in classroom assessment.
  • To examine issue of quality–validity, reliability, and fairness–in classroom assessment.

This course is offered in:
Professional Master of Education, Faculty of Education, Queen’s University

Course authors: Drs. Chi Yan Lam, and Stefan Merchant

Sessions Taught: Fall 2016, Summer 2017, Winter 2016

Categories
Teaching

GDPI/PME 802 – Program Inquiry and Evaluation

This course will guide students in conducting systematic evaluative inquiry in support of data-informed program decision-making. Students will examine the multiple purposes of program evaluation, applying the principles, methods and logic inherent in the needs of targeted program personnel and decision makers.

The overall learning objectives for GDPI 802 are:

  • To develop an understanding of theoretical frameworks for inquiring into social programs, their organizational structures, learning activities, and outputs
  • To develop an understanding of how to inquire into social programs and develop program evaluation plans
  • To develop engage in professional dialogues about program inquiry and evaluation within a community of evaluation practice
  • To articulate complex understandings and response to dilemmas in program evaluation theory and practice
  • To apply understandings about program evaluation theory to a specific context of evaluation practice

Course Offered in:

Sessions Taught: Summer 2019, Winter 2019, Fall 2019, Summer 2018

Categories
5x52 Program Evaluation

The Design-Informed Program Evaluation Manifesto

the mastery within.

Consider the lyrical lines
from a Verdi’s bel canto aria,
or the highly evolved
ab
strac
tion
from Picasso’s bull.

Consider the artful sentence,
or a poet’s communication through
white space.

Consider:
the injustice of genocide
exposed
on a photograph;

the peaceful, pulsating
indicator light
on an Apple computer;

the transformation of an apprentice
under the tutelage of a master.

the catharsis from a Shakespearian tragedy
(or, say, a modern-day Steven Sondheim Sweeney Todd);

to inspire, to catalyze, to set in motion.

rhythm, sound, harmony, syntax,
colour, shade, composition.
This gestalt generates creative tension.

the ingenious thinking that lies within springs to life.

To the trained eyes,
simplicity may reveal complexity
and from chaos reveal order;
the resolution is one of beauty and wholeness.
To the untrained eyes,
the sophistication remains,
though unnoticed;

An experience is nevertheless shaped,

experienced, and inspired by the

thinking.

To design is to render our intentions into the active voice.