Saturday workshop: Critical Issues in Program Evaluation

Critical Issues in Program Evaluation: Learning Through the Practice of Complex Interviewing

with Desire Toussoukpe, PhD Student and Priscila Ledezma, PhD, University of Arizona

This session explores evaluation challenges that arise when participants share critical information “off record” due to fear of being identified and complex team dynamics. Through scenarios, frameworks, and discussion, participants will examine how evaluators can balance ethical obligations, participant trust, and the need to provide meaningful formative feedback for program improvement.

Evaluators frequently rely on interviews to understand program implementation, participant experience, and areas for improvement; however, evaluation becomes challenging when participants share critical information “off record” due to fear of retaliation, mistrust, or complex team dynamics. This session uses a real-world evaluation dilemma to explore how fear, power, and positionality influence what participants feel safe disclosing and how these dynamics can compromise data quality, ethical decision-making, and the utility of findings. Grounded in a power analysis framework (Friesen & Cimetta, 2025) and culturally responsive evaluation approaches (Hood et al., 2015), the session examines how evaluators can balance ethical obligations, participant trust, and the need to provide actionable formative feedback for program improvement.

Participants will engage in interactive activities to analyze sensitive disclosures, assess risks to anonymity in small or politically complex settings, and practice strategies for responsibly navigating off-record requests. Through scenario-based discussion and collaborative problem-solving, attendees will explore tools for protecting participant identities, mitigating power imbalances, and communicating sensitive findings in ways that minimize harm while maintaining evaluation integrity. By the end of the session, participants will be able to identify common ethical dilemmas associated with off-record information, explain how power dynamics shape participant openness and data quality, and select reporting approaches that balance transparency, accuracy, and confidentiality. The session provides evaluators with practical, culturally responsive strategies for managing conflict, honoring participant voice, and ensuring that evaluation findings support meaningful and safe program improvement.