Music by Matt Ingelson, http://www.mattingelsonmusic.com/

Support EvaluLand

Topics Covered:

• Reflections on five years of teaching evaluation
• The -ologies: ontology, epistemology, and axiology beyond just methodology
• Favorite evaluation activity (of course, it’s the evaluating the cookie activity!)
• Mentoring students of color. Five keys from Ayesha (see upcoming CJPE article):
  1. Consider impact of vicarious trauma
  2. Assist with facilitation peer mentors/squads
  3. Respect, honor, and celebrate students’ culture, religion, and family
  4. Be vigilant of microaggressions, and practice microvalidation
  5. Develop mentoring competence
• Supporting colleagues of color: helpful actions, silence as complicity, listening in, getting comfortable being uncomfortable
• Approaching institutional leaders about actions for supporting students, faculty, and staff of color
• Speaking out on the tenure track
• Having a family and being exceptional at work simultaneously (Ayesha encourages us all that it IS possible!)

Resources mentioned:

• Boyce & McGowan (2018) article “An exploration of two novice evaluation educators’ experiences developing and implementing introduction to evaluation courses”
• Evaluating the cookie activity in Preskill & Russ-Eft’s Building Evaluation Capacity book
• Upcoming issue in CJPE on evaluator education
• Ibram X. Kendi
• Letter from Dr. Boyce and students and faculty of color to their department
• Letter from Dr. Boyce and other black UNCG faculty
• NDE upcoming issue on evaluator education

Contact:

• Ayesha Boyce: Twitter @AyeshaBoyce and ayesha.boyce@uncg.edu
• EvaluLand: Website & Twitter (@EvaluLand)

About Dr. Boyce:

Dr. Ayesha S. Boyce is an assistant professor of Educational Research Methodology at UNC Greensboro. She is a program evaluation teacher, scholar, and practitioner. Before pursuing her Ph.D., she was an education research associate (evaluator) for the Arizona Department of Education. She is the Co-Director of the UNCG Office of Assessment, Evaluation, and Research Services (OAERS). Her research focuses on attending to value stances and issues related to diversity, equity, inclusion, access, cultural responsiveness, and social justice within evaluation—especially multi-site, STEM, and contexts with historically marginalized populations. She also examines teaching, mentoring, and learning in evaluation. She has evaluated over 40 programs funded by the National Science Foundation (NSF), US Department of Education, National Institutes of Health, and Spencer and Teagle foundations. She is currently the external evaluator for five NSF funded projects and a Co-Principal Investigator on four NSF funded projects. She is a Co-PI on the recently funded 1 million-dollar NSF grant, Spartans ADVANCE: Adaptations of Practices For Faculty Equity, Diversity, and Inclusion at The UNCG. Dr. Boyce is a co-chair of the American Evaluation Association Multiethnic Issues in Evaluation Topic Interest Group, a member of the editorial board for the Canadian Journal of Program Evaluation and teaches classes in program evaluation and research methodology where she emphasizes good practice with mindful attentiveness to theoretical roots. She encourages students to develop a strong methodological foundation, conduct studies based on democratic principles, and promote equity, fairness, inclusivity, and diversity. She is a 2019 UNCG School of Education Distinguished Research Scholar Award recipient and a 2019 American Evaluation Association Marcia Guttentag Promising New Evaluator Awardee.

Music by Matt Ingelson, http://www.mattingelsonmusic.com/

Support EvaluLand

Topics Covered:

• Jennifer’s background, philosophy, and experience in teaching evaluation (01:58)
• Our favorite evaluation activities: evaluating cookies, one-pages on hot topics and people in evaluation, evaluation failures, self-reflection journals, practical experience outside of class (11:33)
• Personal professional development in data visualization and R (32:00)
• What’s giving Jennifer life in evaluation right now (38:40)
• Data cleaning book proposal by Jennifer and Gary Skolits (44:13)
• What’s next for Jennifer (50:55)

Resources mentioned:

• Preskill & Russ-Eft (2015) Building Evaluation Capacity: Activities for Teaching and Training
• Wanzer (2020) What is evaluation paper (preprint)
• Hutchinson (2018) Evaluation Failures: 22 Tales of Mistakes Made and Lessons Learned
• Jennifer’s student’s blog on user experience for Ann K. Emery
• Great Graphs with Ann K. Emery](https://depictdatastudio.com/)
• R for the Rest of Us with David Keyes](https://rfortherestofus.com/)
• Amy Cesal Play-Doh data visualization activity
• Bianca Montrosse-Moorhead’s research on what ought to be included in the curriculum for master’s and doctoral eval programs
• Jennifer’s handout on the 12 steps to data cleaning](http://comm.eval.org/qual/viewdocument/cbd146-a-brief-intr-1)

Contact:

• Jennifer Ann Morrow: @evaluationdiva on Twitter and jamorrow@utk.edu
• EvaluLand: Website & Twitter (@EvaluLand)

About Jennifer:

Dr. Jennifer Ann Morrow is currently the program coordinator of the Evaluation Statistics and Measurement doctoral program at the University of Tennessee-Knoxville. Her main areas of research are higher education assessment and evaluation and effective strategies for teaching methodology. She has been teaching evaluation and methodology courses for the past 22 years. She is passionate about evaluation and assessment and regularly tweets on these topics (@evaluationdiva). In her spare time she loves to travel and explore the beautiful towns and mountains of Tennessee.

Music by Matt Ingelson, http://www.mattingelsonmusic.com/

Support EvaluLand