{"version":"https://jsonfeed.org/version/1","title":"EvaluLand","home_page_url":"https://evaluland.fireside.fm","feed_url":"https://evaluland.fireside.fm/json","description":"This podcast discusses the landscape of evaluation. Each episode will feature a guest in or around evaluation to discuss something evaluation-related. \r\n\r\nEmail me at podcast@danalinnell.com if you have any feedback or questions about the podcast.","_fireside":{"subtitle":"The Landscape of Evaluation","pubdate":"2025-07-08T05:00:00.000-05:00","explicit":false,"copyright":"CC Attribution (BY) by Dana Linnell","owner":"Dana Linnell","image":"https://media24.fireside.fm/file/fireside-images-2024/podcasts/images/d/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/cover.jpg?v=2"},"items":[{"id":"ec81b1e6-90ae-4938-9256-4b570e824863","title":"49: Advocacy Evaluation with Robin Lin Miller","url":"https://evaluland.fireside.fm/49","content_text":"I chat with Robin Lin Miller about the book she wrote with George Ayala, \"Breaking Barriers: Sexual and Gender Minority-Led Advocacy to End AIDS in Africa and the Caribbean.\" We discuss MPact, Project ACT, and the evaluation of the initiatives. \n\nAbout Robin Lin Miller\n\nRobin Lin Miller, PhD is Professor of Psychology, director of doctoral training in ecological-community psychology, and associate director of training in program evaluation at Michigan State University. She served as lead evaluation specialist for Gay Men’s Health Crisis in the early years of the HIV epidemic and established its first Department of Evaluation. She specializes in evaluating community-led programs, including human rights and advocacy initiatives. Her evaluations – principally conducted in the United States, Africa, and Caribbean – focus on adolescent and Black gay and bisexual men, bisexual girls, transgender women, and male sex workers. She served as lead scientist on the American Psychological Association’s Task Force on Therapeutic Approaches to Sexual Orientation Distress, which is routinely cited in legislation banning conversion therapy practices. Awards include the 2023 Alva and Gunnar Myrdal Evaluation Practice Award from the American Evaluation Association for substantive cumulative contributions to the development of LGBTQ evaluation practice, and the 2022 Exemplary Project W. K. Kellogg Foundation Community Engagement Scholarship Award for evaluating human rights advocacy for LGBTQ people in Africa and the Caribbean. She a member of the Academy for Community Engagement Scholarship, and a fellow of the American Psychological Association and Society for Community Research and Action. She is author of more than 100 scholarly publications, including Breaking Barriers: Sexual and Gender Minority-led Advocacy to End AIDS in Africa and the Caribbean, published by Oxford University Press, co-authored by activist-scholar George Ayala. Past funders include AmFAR, the U.S. Centers for Disease Control and Prevention, National Institute of Mental Health, National Institute of Drug Abuse, the Eunice Kennedy Shriver National Institute of Child Health and Development, and the U.S. Department of State.\n\nContact information: mill1493@msu.edu ","content_html":"\u003cp\u003eI chat with \u003ca href=\"https://www.safersexmsu.com/\" rel=\"nofollow\"\u003eRobin Lin Miller\u003c/a\u003e about the book she wrote with George Ayala, \u0026quot;\u003ca href=\"https://global.oup.com/academic/product/breaking-barriers-9780197647684?cc=us\u0026lang=en\u0026\" rel=\"nofollow\"\u003eBreaking Barriers: Sexual and Gender Minority-Led Advocacy to End AIDS in Africa and the Caribbean\u003c/a\u003e.\u0026quot; We discuss \u003ca href=\"https://mpactglobal.org/\" rel=\"nofollow\"\u003eMPact\u003c/a\u003e, Project ACT, and the evaluation of the initiatives. \u003c/p\u003e\n\n\u003ch3\u003eAbout Robin Lin Miller\u003c/h3\u003e\n\n\u003cp\u003e\u003ca href=\"https://www.safersexmsu.com/\" rel=\"nofollow\"\u003eRobin Lin Miller, PhD\u003c/a\u003e is Professor of Psychology, director of doctoral training in ecological-community psychology, and associate director of training in program evaluation at Michigan State University. She served as lead evaluation specialist for Gay Men’s Health Crisis in the early years of the HIV epidemic and established its first Department of Evaluation. She specializes in evaluating community-led programs, including human rights and advocacy initiatives. Her evaluations – principally conducted in the United States, Africa, and Caribbean – focus on adolescent and Black gay and bisexual men, bisexual girls, transgender women, and male sex workers. She served as lead scientist on the American Psychological Association’s Task Force on Therapeutic Approaches to Sexual Orientation Distress, which is routinely cited in legislation banning conversion therapy practices. Awards include the 2023 Alva and Gunnar Myrdal Evaluation Practice Award from the American Evaluation Association for substantive cumulative contributions to the development of LGBTQ evaluation practice, and the 2022 Exemplary Project W. K. Kellogg Foundation Community Engagement Scholarship Award for evaluating human rights advocacy for LGBTQ people in Africa and the Caribbean. She a member of the Academy for Community Engagement Scholarship, and a fellow of the American Psychological Association and Society for Community Research and Action. She is author of more than 100 scholarly publications, including Breaking Barriers: Sexual and Gender Minority-led Advocacy to End AIDS in Africa and the Caribbean, published by Oxford University Press, co-authored by activist-scholar George Ayala. Past funders include AmFAR, the U.S. Centers for Disease Control and Prevention, National Institute of Mental Health, National Institute of Drug Abuse, the Eunice Kennedy Shriver National Institute of Child Health and Development, and the U.S. Department of State.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eContact information\u003c/strong\u003e: \u003ca href=\"mailto:mill1493@msu.edu\" rel=\"nofollow\"\u003emill1493@msu.edu\u003c/a\u003e \u003c/p\u003e","summary":"I chat with Robin Lin Miller about the book she wrote with George Ayala, \"Breaking Barriers: Sexual and Gender Minority-Led Advocacy to End AIDS in Africa and the Caribbean.\" We discuss MPact, Project ACT, and the evaluation of the advocacy initiatives. ","date_published":"2025-07-08T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/ec81b1e6-90ae-4938-9256-4b570e824863.mp3","mime_type":"audio/mpeg","size_in_bytes":44390064,"duration_in_seconds":3749}]},{"id":"e69aa1b2-0ed3-4d33-bdc5-b9e661ec35e4","title":"48: The Garden of Evaluation Approaches","url":"https://evaluland.fireside.fm/48","content_text":"In this episode, I chat with the authors of The Garden of Evaluation Approaches about their innovative and helpful framework for thinking about evaluation theory and approaches. They each share their personal journeys into evaluation as well as into this work they have been collaborating on for years. We also discuss evaluation theory more broadly, including how to make it more accessible to new and emerging evaluators. \n\nAbout guests:\n\nBianca Montrosse-Moorhead is a Professor of Research Methods, Measurement, and Evaluation at the University of Connecticut, where she also directs the Partnership for Evaluation and Educational Research (PEER). As Co-Editor-in-Chief of New Directions for Evaluation and a fervent advocate for evaluation, Bianca has dedicated her career to bridging the space between evaluation theory and practice. Her work encompasses a broad spectrum of contributions, from evaluating various educational and social programs using diverse methodologies to enhancing the professional training of evaluators worldwide.\n\nDaniela Schroeter serves as a Presidential Innovation Professor and Associate Professor at Western Michigan University. With a Ph.D. in Interdisciplinary Evaluation and over twenty years of research, Daniela has contributed substantially to developing evaluation theories and methodologies. Her global work has involved diverse sectors, focusing on enhancing the capacity and effectiveness of evaluations. Daniela also co-edits the Teaching \u0026amp; Learning of Evaluation section of the American Journal of Evaluation.\n\nLyssa Wilson Becho serves as a Principal Research Associate at The Evaluation Center of Western Michigan University. Garnering the 2024 Marcia Guttentag Promising New Evaluator Award, Lyssa has made a significant impact in advancing evaluation methodologies, focusing on culturally responsive practices and promoting equity within evaluation processes. Lyssa is a co-Executive Editor for the Journal of MultiDisciplinary Evaluation.\n\nCollectively, their innovative work in evaluation spans continents, cementing their reputation as leaders in advancing the practical, theoretical, and methodological facets of the discipline.\n\nContact information:\n\nBianca Montrosse-Moorhead\n\n\nEmail: bianca@uconn.edu\nLinkedIn: https://www.linkedin.com/in/BMMoorhead/ \nResearchGate: https://www.researchgate.net/profile/Bianca-Montrosse-Moorhead \n\n\nDaniela Schröter\n\n\nEmail: daniela.schroeter@wmich.edu\nLinkedIn: https://www.linkedin.com/in/danielaschroeter/ \nResearchGate: https://www.researchgate.net/profile/Daniela-Schroeter\n\n\nLyssa Wilson Becho\n\n\nEmail: lyssa.becho@wmich.edu\nLinkedIn: https://www.linkedin.com/in/lyssa-wilson-becho/ \nResearchGate: https://www.researchgate.net/profile/Lyssa-Becho \n\n\nResources mentioned:\n\nProject vita (biography or résumé) with links to all free and publicly available resources: https://tinyurl.com/EvalGardenVita \n\nMontrosse-Moorhead, B., Schröter, D., \u0026amp; Becho, L. W. (2024). The garden of evaluation approaches visualization. Journal of MultiDisciplinary Evaluation, 20(48), 49–58. https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/1029 \n\nMontrosse-Moorhead, B., Schröter, D., \u0026amp; Becho, L. W. (2024). The garden of evaluation approaches. American Journal of Evaluation, 45(2), 166–185. https://doi.org/10.1177/10982140231216667\n\nBledsoe, K. L., \u0026amp; Graham, J. A. (2005). The use of multiple evaluation approaches in program evaluation. American Journal of Evaluation, 26(3), 302-319. https://doi.org/10.1177/1098214005278749 \n\nKing, J. (2024) Garden of evaluation approaches with SROI and CBA https://linkedin.com/posts/julian-king-87a015a_cba-sroi-vfi-activity-7201338499776618497-J3-z/\n\nMiller, R. L. (2010). Developing standards for empirical examinations of evaluation theory. American Journal of Evaluation, 31(3), 390–399. https://doi.org/10/fmzjxp","content_html":"\u003cp\u003eIn this episode, I chat with the authors of The Garden of Evaluation Approaches about their innovative and helpful framework for thinking about evaluation theory and approaches. They each share their personal journeys into evaluation as well as into this work they have been collaborating on for years. We also discuss evaluation theory more broadly, including how to make it more accessible to new and emerging evaluators. \u003c/p\u003e\n\n\u003ch3\u003eAbout guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003ca href=\"https://education.uconn.edu/person/bianca-montrosse-moorhead/\" rel=\"nofollow\"\u003eBianca Montrosse-Moorhead\u003c/a\u003e is a Professor of Research Methods, Measurement, and Evaluation at the University of Connecticut, where she also directs the Partnership for Evaluation and Educational Research (PEER). As Co-Editor-in-Chief of \u003cem\u003eNew Directions for Evaluation\u003c/em\u003e and a fervent advocate for evaluation, Bianca has dedicated her career to bridging the space between evaluation theory and practice. Her work encompasses a broad spectrum of contributions, from evaluating various educational and social programs using diverse methodologies to enhancing the professional training of evaluators worldwide.\u003c/p\u003e\n\n\u003cp\u003e\u003ca href=\"https://wmich.edu/spaa/directory/schroeter-0\" rel=\"nofollow\"\u003eDaniela Schroeter\u003c/a\u003e serves as a Presidential Innovation Professor and Associate Professor at Western Michigan University. With a Ph.D. in Interdisciplinary Evaluation and over twenty years of research, Daniela has contributed substantially to developing evaluation theories and methodologies. Her global work has involved diverse sectors, focusing on enhancing the capacity and effectiveness of evaluations. Daniela also co-edits the Teaching \u0026amp; Learning of Evaluation section of the \u003cem\u003eAmerican Journal of Evaluation\u003c/em\u003e.\u003c/p\u003e\n\n\u003cp\u003e\u003ca href=\"https://wmich.edu/evaluation/directory/becho\" rel=\"nofollow\"\u003eLyssa Wilson Becho\u003c/a\u003e serves as a Principal Research Associate at The Evaluation Center of Western Michigan University. Garnering the 2024 Marcia Guttentag Promising New Evaluator Award, Lyssa has made a significant impact in advancing evaluation methodologies, focusing on culturally responsive practices and promoting equity within evaluation processes. Lyssa is a co-Executive Editor for the \u003cem\u003eJournal of MultiDisciplinary Evaluation\u003c/em\u003e.\u003c/p\u003e\n\n\u003cp\u003eCollectively, their innovative work in evaluation spans continents, cementing their reputation as leaders in advancing the practical, theoretical, and methodological facets of the discipline.\u003c/p\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eBianca Montrosse-Moorhead\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eEmail: \u003ca href=\"mailto:bianca@uconn.edu\" rel=\"nofollow\"\u003ebianca@uconn.edu\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eLinkedIn: \u003ca href=\"https://www.linkedin.com/in/BMMoorhead/\" rel=\"nofollow\"\u003ehttps://www.linkedin.com/in/BMMoorhead/\u003c/a\u003e \u003c/li\u003e\n\u003cli\u003eResearchGate: \u003ca href=\"https://www.researchgate.net/profile/Bianca-Montrosse-Moorhead\" rel=\"nofollow\"\u003ehttps://www.researchgate.net/profile/Bianca-Montrosse-Moorhead\u003c/a\u003e \u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eDaniela Schröter\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eEmail: \u003ca href=\"mailto:daniela.schroeter@wmich.edu\" rel=\"nofollow\"\u003edaniela.schroeter@wmich.edu\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eLinkedIn: \u003ca href=\"https://www.linkedin.com/in/danielaschroeter/\" rel=\"nofollow\"\u003ehttps://www.linkedin.com/in/danielaschroeter/\u003c/a\u003e \u003c/li\u003e\n\u003cli\u003eResearchGate: \u003ca href=\"https://www.researchgate.net/profile/Daniela-Schroeter\" rel=\"nofollow\"\u003ehttps://www.researchgate.net/profile/Daniela-Schroeter\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eLyssa Wilson Becho\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eEmail: \u003ca href=\"mailto:lyssa.becho@wmich.edu\" rel=\"nofollow\"\u003elyssa.becho@wmich.edu\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eLinkedIn: \u003ca href=\"https://www.linkedin.com/in/lyssa-wilson-becho/\" rel=\"nofollow\"\u003ehttps://www.linkedin.com/in/lyssa-wilson-becho/\u003c/a\u003e \u003c/li\u003e\n\u003cli\u003eResearchGate: \u003ca href=\"https://www.researchgate.net/profile/Lyssa-Becho\" rel=\"nofollow\"\u003ehttps://www.researchgate.net/profile/Lyssa-Becho\u003c/a\u003e \u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eResources mentioned\u003c/strong\u003e:\u003c/p\u003e\n\n\u003cp\u003eProject vita (biography or résumé) with links to all free and publicly available resources: \u003ca href=\"https://tinyurl.com/EvalGardenVita\" rel=\"nofollow\"\u003ehttps://tinyurl.com/EvalGardenVita\u003c/a\u003e \u003c/p\u003e\n\n\u003cp\u003eMontrosse-Moorhead, B., Schröter, D., \u0026amp; Becho, L. W. (2024). The garden of evaluation approaches visualization. \u003cem\u003eJournal of MultiDisciplinary Evaluation\u003c/em\u003e, \u003cem\u003e20\u003c/em\u003e(48), 49–58. \u003ca href=\"https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/1029\" rel=\"nofollow\"\u003ehttps://journals.sfu.ca/jmde/index.php/jmde_1/article/view/1029\u003c/a\u003e \u003c/p\u003e\n\n\u003cp\u003eMontrosse-Moorhead, B., Schröter, D., \u0026amp; Becho, L. W. (2024). The garden of evaluation approaches. \u003cem\u003eAmerican Journal of Evaluation\u003c/em\u003e, \u003cem\u003e45\u003c/em\u003e(2), 166–185. \u003ca href=\"https://doi.org/10.1177/10982140231216667\" rel=\"nofollow\"\u003ehttps://doi.org/10.1177/10982140231216667\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eBledsoe, K. L., \u0026amp; Graham, J. A. (2005). The use of multiple evaluation approaches in program evaluation. \u003cem\u003eAmerican Journal of Evaluation, 26\u003c/em\u003e(3), 302-319. \u003ca href=\"https://doi.org/10.1177/1098214005278749\" rel=\"nofollow\"\u003ehttps://doi.org/10.1177/1098214005278749\u003c/a\u003e \u003c/p\u003e\n\n\u003cp\u003eKing, J. (2024) Garden of evaluation approaches with SROI and CBA \u003ca href=\"https://linkedin.com/posts/julian-king-87a015a_cba-sroi-vfi-activity-7201338499776618497-J3-z/\" rel=\"nofollow\"\u003ehttps://linkedin.com/posts/julian-king-87a015a_cba-sroi-vfi-activity-7201338499776618497-J3-z/\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eMiller, R. L. (2010). Developing standards for empirical examinations of evaluation theory. \u003cem\u003eAmerican Journal of Evaluation, 31\u003c/em\u003e(3), 390–399. \u003ca href=\"https://doi.org/10/fmzjxp\" rel=\"nofollow\"\u003ehttps://doi.org/10/fmzjxp\u003c/a\u003e\u003c/p\u003e","summary":"In this episode, I chat with the authors of The Garden of Evaluation Approaches about their innovative and helpful framework for thinking about evaluation theory and approaches. They each share their personal journeys into evaluation as well as into this work they have been collaborating on for years. We also discuss evaluation theory more broadly, including how to make it more accessible to new and emerging evaluators. ","date_published":"2025-04-22T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/e69aa1b2-0ed3-4d33-bdc5-b9e661ec35e4.mp3","mime_type":"audio/mpeg","size_in_bytes":54581688,"duration_in_seconds":4856}]},{"id":"ec1c4636-71ca-4b35-a235-4c2087892ac2","title":"47: Jennifer Villalobos","url":"https://evaluland.fireside.fm/47","content_text":"In this week’s episode, I talk with Dr. Jennifer Villalobos about evaluator education, the scholar-practitioner model, evaluation careers, and how the current administration is affecting evaluation. \n\nContact information: Jennifer P. Villalobos - jennifer.villalobos@cgu.edu \n\nAbout Dr. Jennifer Villalobos: Jennifer P. Villalobos, PhD, is an Assistant Professor of Practice and Director of the Doctor of Evaluation Practice (D.Eval) program at Claremont Graduate University. As an evaluator, scholar-practitioner, and organizational psychologist, her work focuses on advancing socially responsive evaluation, helping organizations increase their DEI profile, positive psychological interventions, and the intersection of evaluation education and practice. Outside of work, Jennifer enjoys spending time with her husband and three kids, cheering them on in their many sports and theatrical events. She’s also a firm believer in the power of community—whether that means mentoring students, collaborating with peers, or just gathering people around good food and conversation. \n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eIn this week’s episode, I talk with Dr. Jennifer Villalobos about evaluator education, the scholar-practitioner model, evaluation careers, and how the current administration is affecting evaluation. \u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eContact information\u003c/strong\u003e: Jennifer P. Villalobos - \u003ca href=\"mailto:jennifer.villalobos@cgu.edu\" rel=\"nofollow\"\u003ejennifer.villalobos@cgu.edu\u003c/a\u003e \u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eAbout Dr. Jennifer Villalobos\u003c/strong\u003e: Jennifer P. Villalobos, PhD, is an Assistant Professor of Practice and Director of the Doctor of Evaluation Practice (D.Eval) program at Claremont Graduate University. As an evaluator, scholar-practitioner, and organizational psychologist, her work focuses on advancing socially responsive evaluation, helping organizations increase their DEI profile, positive psychological interventions, and the intersection of evaluation education and practice. Outside of work, Jennifer enjoys spending time with her husband and three kids, cheering them on in their many sports and theatrical events. She’s also a firm believer in the power of community—whether that means mentoring students, collaborating with peers, or just gathering people around good food and conversation. \u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this week’s episode, I talk with Dr. Jennifer Villalobos about evaluator education, the scholar-practitioner model, evaluation careers, and how the current administration is affecting evaluation. ","date_published":"2025-03-25T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/ec1c4636-71ca-4b35-a235-4c2087892ac2.mp3","mime_type":"audio/mpeg","size_in_bytes":35730336,"duration_in_seconds":3378}]},{"id":"c1bc78b7-75a8-4764-ba4b-8ad39206f655","title":"46: Reflections on Foundations of Evaluation","url":"https://evaluland.fireside.fm/46","content_text":"I share my reflections on teaching Foundations of Evaluation after a major course revision, including how it's been going for the first four weeks. \n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eI share my reflections on teaching Foundations of Evaluation after a major course revision, including how it\u0026#39;s been going for the first four weeks. \u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"I share my reflections on teaching Foundations of Evaluation after a major course revision, including how it's been going for the first four weeks. ","date_published":"2025-02-25T07:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/c1bc78b7-75a8-4764-ba4b-8ad39206f655.mp3","mime_type":"audio/mpeg","size_in_bytes":42156566,"duration_in_seconds":3027}]},{"id":"3dc3e1ba-b87f-42e2-9929-35e4a8c990d4","title":"45: Sheila Robinson and Kim Leonard","url":"https://evaluland.fireside.fm/45","content_text":"This episode featured Kim Leonard and Sheila Robinson discussing their careers in evaluation and survey design. They shared how they met on Twitter in 2012 and began collaborating, writing blog posts that eventually became their book \"Designing Quality Survey Questions\" published by Sage Publications. Sheila and Kim discussed their process for writing the book, starting with blog content and building it out over several years into a full manuscript. They also covered common issues they see in surveys and tips for developing effective survey questions. \n\nSheila Robinson: https://www.sheilabrobinson.com/ \u0026amp; https://www.linkedin.com/in/sheilabrobinson/\nKim Leonard: https://leonardrande.com/ \u0026amp; https://www.linkedin.com/in/kim-firth-leonard-1ba9447/\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis episode featured Kim Leonard and Sheila Robinson discussing their careers in evaluation and survey design. They shared how they met on Twitter in 2012 and began collaborating, writing blog posts that eventually became their book \u0026quot;\u003ca href=\"https://us.sagepub.com/en-us/nam/designing-quality-survey-questions/book249048\" rel=\"nofollow\"\u003eDesigning Quality Survey Questions\u003c/a\u003e\u0026quot; published by Sage Publications. Sheila and Kim discussed their process for writing the book, starting with blog content and building it out over several years into a full manuscript. They also covered common issues they see in surveys and tips for developing effective survey questions. \u003c/p\u003e\n\n\u003cp\u003eSheila Robinson: \u003ca href=\"https://www.sheilabrobinson.com/\" rel=\"nofollow\"\u003ehttps://www.sheilabrobinson.com/\u003c/a\u003e \u0026amp; \u003ca href=\"https://www.linkedin.com/in/sheilabrobinson/\" rel=\"nofollow\"\u003ehttps://www.linkedin.com/in/sheilabrobinson/\u003c/a\u003e\u003cbr\u003e\nKim Leonard: \u003ca href=\"https://leonardrande.com/\" rel=\"nofollow\"\u003ehttps://leonardrande.com/\u003c/a\u003e \u0026amp; \u003ca href=\"https://www.linkedin.com/in/kim-firth-leonard-1ba9447/\" rel=\"nofollow\"\u003ehttps://www.linkedin.com/in/kim-firth-leonard-1ba9447/\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This episode featured Kim Leonard and Sheila Robinson discussing their careers in evaluation and survey design. They shared how they met on Twitter in 2012 and began collaborating, writing blog posts that eventually became their book \"Designing Quality Survey Questions.\" Sheila and Kim discussed their process for writing the book, starting with blog content and building it out over several years into a full manuscript. They also covered common issues they see in surveys and tips for developing effective survey questions.","date_published":"2024-05-28T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/3dc3e1ba-b87f-42e2-9929-35e4a8c990d4.mp3","mime_type":"audio/mpeg","size_in_bytes":43657416,"duration_in_seconds":3748}]},{"id":"230975b1-29af-4262-a564-7edbf650e88d","title":"44: Brittany Dernberger","url":"https://evaluland.fireside.fm/44","content_text":"This month I chat with Brittany Dernberger about her evaluation background and practice.\n\nBrittany Dernberger is a sociologist and gender inequality expert who has led research, evaluation, and organizational learning across academia, philanthropy, government, large international NGOs, and small nonprofits. Brittany currently leads global initiatives to measure systems-level change at CARE and co-chairs the American Evaluation Association Systems in Evaluation Topical Interest Group.\n\nLearn more about Brittany’s work at http://brittanydernberger.com/. Access CARE’s completed Systems-Level Impact evaluations at https://careevaluations.org/evaluation/keywords/systems-level-impact/. The AEA Systems in Evaluation TIG paper on Principles for Systems Thinking in is available at https://www.betterevaluation.org/sites/default/files/SETIG-Principles-FINAL-DRAFT-2018-9-9.pdf.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis month I chat with Brittany Dernberger about her evaluation background and practice.\u003c/p\u003e\n\n\u003cp\u003eBrittany Dernberger is a sociologist and gender inequality expert who has led research, evaluation, and organizational learning across academia, philanthropy, government, large international NGOs, and small nonprofits. Brittany currently leads global initiatives to measure systems-level change at CARE and co-chairs the American Evaluation Association Systems in Evaluation Topical Interest Group.\u003c/p\u003e\n\n\u003cp\u003eLearn more about Brittany’s work at \u003ca href=\"http://brittanydernberger.com/\" rel=\"nofollow\"\u003ehttp://brittanydernberger.com/\u003c/a\u003e. Access CARE’s completed Systems-Level Impact evaluations at \u003ca href=\"https://careevaluations.org/evaluation/keywords/systems-level-impact/\" rel=\"nofollow\"\u003ehttps://careevaluations.org/evaluation/keywords/systems-level-impact/\u003c/a\u003e. The AEA Systems in Evaluation TIG paper on Principles for Systems Thinking in is available at \u003ca href=\"https://www.betterevaluation.org/sites/default/files/SETIG-Principles-FINAL-DRAFT-2018-9-9.pdf\" rel=\"nofollow\"\u003ehttps://www.betterevaluation.org/sites/default/files/SETIG-Principles-FINAL-DRAFT-2018-9-9.pdf\u003c/a\u003e.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This month I chat with Brittany Dernberger about her evaluation background and practice.","date_published":"2024-04-23T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/230975b1-29af-4262-a564-7edbf650e88d.mp3","mime_type":"audio/mpeg","size_in_bytes":33447576,"duration_in_seconds":3035}]},{"id":"4577800a-f8be-4594-993b-b0f0148ded74","title":"43: Allison Prieur","url":"https://evaluland.fireside.fm/43","content_text":"This month I talk with Allison Prieur about her experiences as a graduate student in evaluation and running a business. \n\nSome resources mentioned or suggested for listeners:\n\n\nLogic of evaluation\nEvaluation of logic in practice\nDestination Dissertation\nAllison Prieur's LinkedIn profile\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis month I talk with Allison Prieur about her experiences as a graduate student in evaluation and running a business. \u003c/p\u003e\n\n\u003cp\u003eSome resources mentioned or suggested for listeners:\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://www.psychologytoday.com/ca/blog/evaluation-social-betterment/201810/the-application-the-logic-evaluation-the-real-world\" rel=\"nofollow\"\u003eLogic of evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://doi.org/10.1016/j.evalprogplan.2019.101681\" rel=\"nofollow\"\u003eEvaluation of logic in practice\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rowman.com/ISBN/9781442246140/Destination-Dissertation-A-Traveler\u0026#x27;s-Guide-to-a-Done-Dissertation-Second-Edition\" rel=\"nofollow\"\u003eDestination Dissertation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.linkedin.com/in/allisonprieur\" rel=\"nofollow\"\u003eAllison Prieur\u0026#39;s LinkedIn profile\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This month I talk with Allison Prieur about her experiences as a graduate student in evaluation and running a business. ","date_published":"2024-03-26T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/4577800a-f8be-4594-993b-b0f0148ded74.mp3","mime_type":"audio/mpeg","size_in_bytes":33710832,"duration_in_seconds":3006}]},{"id":"720941d5-a57a-4a7c-bbf6-2d9926caf571","title":"42: Making ECB sticky with Corey Newhouse and Jessica Manta Meyer","url":"https://evaluland.fireside.fm/42","content_text":"In this episode, I chat with Corey Newhouse and Jessica Manta Meyer, both from Public Profit, about how to make evaluation capacity building sticky for the organizations we work with.\n\nSome resources mentioned:\n\n\nTIERS Framework \nTipping Point Community\nIrvine Foundation\nChange Cadet\nNonProfit AF article on capacity building does not work\nInfo on the Public Profit’s evaluation cohort\n\n\nContact information:\n\ninfo@publicprofit.net\n\nAbout Corey:\n\nCorey got her start as a teacher at Summerbridge Cincinnati in the early 1990s and has been involved in educational equity and social justice movements ever since. She founded Public Profit to build a team that would seamlessly blend social science research methods, organizational change strategy, and a deep commitment to supporting changemakers.\n\nAs the Founder and Principal of Public Profit, Corey leads the team’s strategic direction, external relationships, and business development. In addition, Corey serves as an internal thought partner to project teams, assisting with the design of Public Profit’s engagements in evaluation, capacity building, and strategic program design. She is co-author of Public Profit’s Creative Ways to Solicit Stakeholder Feedback and Dabbling in the Data, and a contributor to Evaluation Failures: 22 Tales of Mistakes Made and Lessons Learned. She is a co-editor of the volume, Measure, Use, Improve! Data Use in Out-of-School Time.\n\nAbout Jes:\n\nJessica began her career as a peer volunteer on a national youth talkline providing referrals and support to youth in crisis. Challenged by what she heard on the talkline, and by some of her own experiences with the health care system, she developed an interest in health education, equity and advocacy, which launched a career in the social services sector. Eventually, Jessica combined that with a lifetime love of numbers and inquiry, which led her to program evaluation.\n\nPrior to joining Public Profit, Jessica had several years of experience creating, directing and evaluating a range of youth development, LGBT, and health programs. Her work has run the gamut of nonprofit and social service roles including nonprofit finance, human resources, development and agency-led evaluations. \n\nJessica directs many of the projects at Public Profit. She designs evaluation studies, develops project strategy, and manages implementation including all aspects of data collection, analysis, and reporting. An expert facilitator, Jessica also facilitates large stakeholder meetings and evaluation capacity building trainings, and provides evaluation coaching to clients and staff alike.","content_html":"\u003cp\u003eIn this episode, I chat with Corey Newhouse and Jessica Manta Meyer, both from Public Profit, about how to make evaluation capacity building sticky for the organizations we work with.\u003c/p\u003e\n\n\u003ch3\u003eSome resources mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://aea365.org/blog/ie-tig-week-laura-beals-and-rachel-albert-on-tiers-a-tool-for-allocating-evaluation-resources-at-nonprofit-agencies/\" rel=\"nofollow\"\u003eTIERS Framework\u003c/a\u003e \u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://tippingpoint.org/\" rel=\"nofollow\"\u003eTipping Point Community\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.irvine.org/\" rel=\"nofollow\"\u003eIrvine Foundation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.changecadet.com/\" rel=\"nofollow\"\u003eChange Cadet\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://nonprofitaf.com/\" rel=\"nofollow\"\u003eNonProfit AF\u003c/a\u003e article on \u003ca href=\"https://nonprofitaf.com/2020/10/capacity-buildings-necessary-existential-crisis/\" rel=\"nofollow\"\u003ecapacity building does not work\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eInfo on the Public Profit’s \u003ca href=\"https://www.publicprofit.net/Driving-Toward-Impact\" rel=\"nofollow\"\u003eevaluation cohort\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cp\u003e\u003ca href=\"mailto:info@publicprofit.net\" rel=\"nofollow\"\u003einfo@publicprofit.net\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003eAbout Corey:\u003c/h3\u003e\n\n\u003cp\u003eCorey got her start as a teacher at Summerbridge Cincinnati in the early 1990s and has been involved in educational equity and social justice movements ever since. She founded Public Profit to build a team that would seamlessly blend social science research methods, organizational change strategy, and a deep commitment to supporting changemakers.\u003c/p\u003e\n\n\u003cp\u003eAs the Founder and Principal of Public Profit, Corey leads the team’s strategic direction, external relationships, and business development. In addition, Corey serves as an internal thought partner to project teams, assisting with the design of Public Profit’s engagements in evaluation, capacity building, and strategic program design. She is co-author of Public Profit’s Creative Ways to Solicit Stakeholder Feedback and Dabbling in the Data, and a contributor to Evaluation Failures: 22 Tales of Mistakes Made and Lessons Learned. She is a co-editor of the volume, Measure, Use, Improve! Data Use in Out-of-School Time.\u003c/p\u003e\n\n\u003ch3\u003eAbout Jes:\u003c/h3\u003e\n\n\u003cp\u003eJessica began her career as a peer volunteer on a national youth talkline providing referrals and support to youth in crisis. Challenged by what she heard on the talkline, and by some of her own experiences with the health care system, she developed an interest in health education, equity and advocacy, which launched a career in the social services sector. Eventually, Jessica combined that with a lifetime love of numbers and inquiry, which led her to program evaluation.\u003c/p\u003e\n\n\u003cp\u003ePrior to joining Public Profit, Jessica had several years of experience creating, directing and evaluating a range of youth development, LGBT, and health programs. Her work has run the gamut of nonprofit and social service roles including nonprofit finance, human resources, development and agency-led evaluations. \u003c/p\u003e\n\n\u003cp\u003eJessica directs many of the projects at Public Profit. She designs evaluation studies, develops project strategy, and manages implementation including all aspects of data collection, analysis, and reporting. An expert facilitator, Jessica also facilitates large stakeholder meetings and evaluation capacity building trainings, and provides evaluation coaching to clients and staff alike.\u003c/p\u003e","summary":"In this episode, I chat with Corey Newhouse and Jessica Manta Meyer, both from Public Profit, about how to make evaluation capacity building sticky for the organizations we work with.","date_published":"2023-06-20T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/720941d5-a57a-4a7c-bbf6-2d9926caf571.mp3","mime_type":"audio/mpeg","size_in_bytes":42775560,"duration_in_seconds":4360}]},{"id":"485c0be9-5915-4ee8-8dca-a72fc59d2858","title":"41: Theory-based approaches for navigating complexity with Michael Moses","url":"https://evaluland.fireside.fm/41","content_text":"In this episode, I chat with Michael Moses about theory-based approaches for navigating complexity, adaptive management, participatory strategy, and actions to shift power. \n\nThings and resources mentioned:\n\n\nSystems thinking in evaluation (including a discussion of complexity) - Bob Williams and Sjon Van't Hof\nOutcome mapping and outcome harvesting and emergent learning\nEmergent Learning (including before action reviews, after action reviews, emergent learning tables, and more approaches for supporting collective learning and action)\nStrategy Testing - Deborah Ladner and the Asia Foundation\nKat Haugh - visual facilitation, sensemaking, and notetaking\nLearning to Make All Voices Count Initiative - Summary and full paper\nCynara training on Decolonizing M\u0026amp;E and Research, led by Michelle Lokot\n\n\nContact information:\n\nMichael Moses\nmmoses@encompassworld.com\nLinkedIn\n\nAbout Michael Moses:\n\nMichael Moses is a strategist, facilitator, and evaluator with over 12 years of experience working with public and private sector partners to achieve social impact. He advises foundations, companies, governments, and nonprofits in their efforts to design and implement strategies for advancing change, including by capturing and using data to navigate the complex systems in which they work. In doing so, he helps changemakers learn how to improve programs and organizations, adapt, and over time, strengthen their impact.","content_html":"\u003cp\u003eIn this episode, I chat with Michael Moses about theory-based approaches for navigating complexity, adaptive management, participatory strategy, and actions to shift power. \u003c/p\u003e\n\n\u003ch3\u003eThings and resources mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://www.bobwilliams.co.nz/ewExternalFiles/Wicked.pdf\" rel=\"nofollow\"\u003eSystems thinking in evaluation\u003c/a\u003e (including a discussion of complexity) - Bob Williams and Sjon Van\u0026#39;t Hof\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.betterevaluation.org/methods-approaches/approaches/outcome-mapping\" rel=\"nofollow\"\u003eOutcome mapping\u003c/a\u003e and \u003ca href=\"https://www.betterevaluation.org/methods-approaches/approaches/outcome-harvesting\" rel=\"nofollow\"\u003eoutcome harvesting\u003c/a\u003e and \u003ca href=\"https://emergentlearning.org/\" rel=\"nofollow\"\u003eemergent learning\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://emergentlearning.org/\" rel=\"nofollow\"\u003eEmergent Learning\u003c/a\u003e (including before action reviews, after action reviews, emergent learning tables, and more approaches for supporting collective learning and action)\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://asiafoundation.org/wp-content/uploads/2015/10/Strategy-Testing-An-Innovative-Approach-to-Monitoring-Highly-Flexible-Aid-Programs.pdf\" rel=\"nofollow\"\u003eStrategy Testing\u003c/a\u003e - Deborah Ladner and the Asia Foundation\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.katherinehaugh.com/\" rel=\"nofollow\"\u003eKat Haugh\u003c/a\u003e - visual facilitation, sensemaking, and notetaking\u003c/li\u003e\n\u003cli\u003eLearning to Make All Voices Count Initiative - \u003ca href=\"https://www.makingallvoicescount.org/supporting-local-learning-adaptation-understanding-effectiveness-adaptive-processes\" rel=\"nofollow\"\u003eSummary\u003c/a\u003e and \u003ca href=\"https://opendocs.ids.ac.uk/opendocs/bitstream/handle/20.500.12413/13351/MAVC_RR_Moses%20FINAL.pdf\" rel=\"nofollow\"\u003efull paper\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eCynara training on \u003ca href=\"https://cynara.co/trainingstore/decolonize\" rel=\"nofollow\"\u003eDecolonizing M\u0026amp;E and Research\u003c/a\u003e, led by \u003ca href=\"https://uk.linkedin.com/in/michellelokot\" rel=\"nofollow\"\u003eMichelle Lokot\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003e\u003cstrong\u003eContact information\u003c/strong\u003e:\u003c/h3\u003e\n\n\u003cp\u003eMichael Moses\u003cbr\u003e\n\u003ca href=\"mailto:mmoses@encompassworld.com\" rel=\"nofollow\"\u003emmoses@encompassworld.com\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"https://www.linkedin.com/in/michael-moses-a9bb9616/\" rel=\"nofollow\"\u003eLinkedIn\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003e\u003cstrong\u003eAbout Michael Moses\u003c/strong\u003e:\u003c/h3\u003e\n\n\u003cp\u003eMichael Moses is a strategist, facilitator, and evaluator with over 12 years of experience working with public and private sector partners to achieve social impact. He advises foundations, companies, governments, and nonprofits in their efforts to design and implement strategies for advancing change, including by capturing and using data to navigate the complex systems in which they work. In doing so, he helps changemakers learn how to improve programs and organizations, adapt, and over time, strengthen their impact.\u003c/p\u003e","summary":"In this episode, I chat with Michael Moses about theory-based approaches for navigating complexity, adaptive management, participatory strategy, and actions to shift power. ","date_published":"2023-05-23T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/485c0be9-5915-4ee8-8dca-a72fc59d2858.mp3","mime_type":"audio/mpeg","size_in_bytes":39638616,"duration_in_seconds":3310}]},{"id":"56bbb49e-5ec6-44a6-b232-8e021edcf2da","title":"40: Community-based participatory research with Dr. Tatiana Bustos","url":"https://evaluland.fireside.fm/40","content_text":"In this episode, I chat with Dr. Tatiana Elisa Bustos on community-based participatory research (CBPR). We talked about what it is, how it compares to research and other similar forms of inquiry, and how to get started doing CBPR. \n\nDisclaimer: Views expressed here are personal and not reflective of the speaker's respective employers or agencies.\n\nContact information\n\nDr. Tatiana Elisa Bustos\ntbust002@gmail.com\n@TElisa72\nhttps://www.linkedin.com/in/tebustos/\n\nAbout Dr. Bustos\n\nDr. Tatiana Elisa Bustos knows that community partner engagement is key to understanding social issues. She’ll share her experience applying community-based participatory research approaches. \n\nDr. Bustos innovates outside the box ways to do research that invite community participation, improving programs through implementation with a social justice lens. As a 1st generation college student and the daughter of Nicaraguan immigrants, equity is deeply important to her. She is an author and award-winning researcher. She leads professional development workshops on implementation science and community based participatory research.\n\nShe received her PhD in Community Psychology from Michigan State University, an MS in Psychology from Nova Southeastern University, and a BA in Psychology from Florida International University. Connect with her on LinkedIn.\n\nDr. Bustos also appeared on The Sci-Files on Impact 89FM and Beyond the Manuscript, the podcast of Progress in Community Health Partnerships.\n\nResources\n\nProfessional Organizations\n\n\nSociety for Community Research and Action\nAmerican Evaluation Association Connect (CBPR search)\nCommunity Psychology TIG\n\n\nTraining Institutes\n\n\nhttps://www.detroiturc.org/programs-expertise/cbpr-capacity-building\nhttps://www.detroiturc.org/about-cbpr/online-cbpr-course\nhttps://www.mitrainingcenter.org/courses/cbprs0218noce \n\n\nToolkits\n\n\nhttps://ctb.ku.edu/en/table-of-contents/evaluate/evaluation/intervention-research/main\n\n\nJournals\n\n\nGlobal Journal of Community Psychology\nAmerican Journal of Community Psychology\nCollaborations: A Journal of Community Based Research and Practice\n","content_html":"\u003cp\u003eIn this episode, I chat with Dr. Tatiana Elisa Bustos on community-based participatory research (CBPR). We talked about what it is, how it compares to research and other similar forms of inquiry, and how to get started doing CBPR. \u003c/p\u003e\n\n\u003cp\u003eDisclaimer: Views expressed here are personal and not reflective of the speaker\u0026#39;s respective employers or agencies.\u003c/p\u003e\n\n\u003ch3\u003eContact information\u003c/h3\u003e\n\n\u003cp\u003eDr. Tatiana Elisa Bustos\u003cbr\u003e\n\u003ca href=\"mailto:tbust002@gmail.com\" rel=\"nofollow\"\u003etbust002@gmail.com\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"https://mobile.twitter.com/telisa72\" rel=\"nofollow\"\u003e@TElisa72\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"https://www.linkedin.com/in/tebustos/\" rel=\"nofollow\"\u003ehttps://www.linkedin.com/in/tebustos/\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003eAbout Dr. Bustos\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eDr. Tatiana Elisa Bustos\u003c/strong\u003e knows that community partner engagement is key to understanding social issues. She’ll share her experience applying community-based participatory research approaches. \u003c/p\u003e\n\n\u003cp\u003eDr. Bustos innovates outside the box ways to do research that invite community participation, improving programs through implementation with a social justice lens. As a 1st generation college student and the daughter of Nicaraguan immigrants, equity is deeply important to her. She is an author and award-winning researcher. She leads professional development workshops on implementation science and community based participatory research.\u003c/p\u003e\n\n\u003cp\u003eShe received her PhD in Community Psychology from Michigan State University, an MS in Psychology from Nova Southeastern University, and a BA in Psychology from Florida International University. \u003ca href=\"https://www.linkedin.com/in/tebustos/\" rel=\"nofollow\"\u003eConnect with her on LinkedIn.\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eDr. Bustos also appeared on The Sci-Files on Impact 89FM and Beyond the Manuscript, the podcast of \u003cem\u003eProgress in Community Health Partnerships\u003c/em\u003e.\u003c/p\u003e\n\n\u003ch3\u003eResources\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eProfessional Organizations\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"http://scra27.org/\" rel=\"nofollow\"\u003eSociety for Community Research and Action\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://comm.eval.org/search?executeSearch=true\u0026SearchTerm=community+based+participatory+action+research\u0026l=1\" rel=\"nofollow\"\u003eAmerican Evaluation Association Connect\u003c/a\u003e (CBPR search)\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://comm.eval.org/communitypsychology/home\" rel=\"nofollow\"\u003eCommunity Psychology TIG\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eTraining Institutes\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://www.detroiturc.org/programs-expertise/cbpr-capacity-building\" rel=\"nofollow\"\u003ehttps://www.detroiturc.org/programs-expertise/cbpr-capacity-building\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.detroiturc.org/about-cbpr/online-cbpr-course\" rel=\"nofollow\"\u003ehttps://www.detroiturc.org/about-cbpr/online-cbpr-course\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.mitrainingcenter.org/courses/cbprs0218noce\" rel=\"nofollow\"\u003ehttps://www.mitrainingcenter.org/courses/cbprs0218noce\u003c/a\u003e \u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eToolkits\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://ctb.ku.edu/en/table-of-contents/evaluate/evaluation/intervention-research/main\" rel=\"nofollow\"\u003ehttps://ctb.ku.edu/en/table-of-contents/evaluate/evaluation/intervention-research/main\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eJournals\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://www.gjcpp.org/\" rel=\"nofollow\"\u003eGlobal Journal of Community Psychology\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://onlinelibrary.wiley.com/journal/15732770\" rel=\"nofollow\"\u003eAmerican Journal of Community Psychology\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://collaborations.miami.edu/\" rel=\"nofollow\"\u003eCollaborations: A Journal of Community Based Research and Practice\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e","summary":"In this episode, I chat with Dr. Tatiana Elisa Bustos on community-based participatory research (CBPR). We talked about what it is, how it compares to research and other similar forms of inquiry, and how to get started doing CBPR. ","date_published":"2023-02-07T05:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/56bbb49e-5ec6-44a6-b232-8e021edcf2da.mp3","mime_type":"audio/mpeg","size_in_bytes":23280096,"duration_in_seconds":2085}]},{"id":"66ba2d37-0d55-449b-9d0a-fefda814f6ad","title":"39: #Eval22 Conference Preview","url":"https://evaluland.fireside.fm/39","content_text":"In this episode, I provide a brief overview of the #Eval22 conference, describe the schedule at a glance, and provide tips for getting the most out of the conference. I hope to see you in New Orleans! Say hi to me at the conference to get an EvaluLand nametag ribbon. \n\nEval22 Resources\n\n\nRegister to attend the AEA Annual Business Meeting on November 3 at 2pm ET; a recording will be made available after the meeting. \nRegister to attend TIG virtual meetings before and after the conference\nSee the conference schedule at a glance or the entire searchable program\nLearn more about the professional development workshops offered Monday, Tuesday, and Wednesday prior to the conference\nAttend all the social events at the conference: poster exhibit \u0026amp; meet the authors reception, TIG fair \u0026amp; reception, and the silent auction to benefit international presenters\nAttend all the plenary sessions and presidential strand sessions focused on the theme of the conference and watch the virtual pre-conference presidential town hall series that occurred in the months leading up to the conference\nCheck out the resources for attendees, including guide to New Orleans, Zoom background options, PowerPoint templates, marketing toolkit, and tips for social media\nCheck out the speaker resources, including information about rooms and materials, printing and shipping, and the potent presentations information\nCheck out the floor plan for the Exhibit Hall, including the exhibitors, posters, and TIG fair\nThis LinkedIn post by Sylvia Pu, PhD has a ton of great comments about how to get the most out of the conference\n","content_html":"\u003cp\u003eIn this episode, I provide a brief overview of the #Eval22 conference, describe the schedule at a glance, and provide tips for getting the most out of the conference. I hope to see you in New Orleans! Say hi to me at the conference to get an EvaluLand nametag ribbon. \u003c/p\u003e\n\n\u003ch3\u003eEval22 Resources\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eRegister to attend the AEA \u003ca href=\"https://www.evaluationconference.org/Programs/Annual-Business-Meeting\" rel=\"nofollow\"\u003eAnnual Business Meeting\u003c/a\u003e on November 3 at 2pm ET; a recording will be made available after the meeting. \u003c/li\u003e\n\u003cli\u003eRegister to attend \u003ca href=\"https://www.evaluationconference.org/Programs/Topical-Interest-Groups\" rel=\"nofollow\"\u003eTIG virtual meetings\u003c/a\u003e before and after the conference\u003c/li\u003e\n\u003cli\u003eSee the conference \u003ca href=\"https://www.evaluationconference.org/Programs/Schedule-At-A-Glance\" rel=\"nofollow\"\u003eschedule at a glance\u003c/a\u003e or the \u003ca href=\"https://evaluation.secure-platform.com/a/solicitations/2/sessiongallery/schedule?dayId=13\u0026searchParams=%7B%22pageIndex%22%3A0,%22sortMode%22%3A%22SessionName%22,%22sortDirection%22%3A%22Ascending%22,%22sortByFieldId%22%3Anull,%22displayMode%22%3Anull,%22filterByFieldValues%22%3A%5B%5D,%22filterByTextValue%22%3Anull,%22filterByFavorites%22%3Afalse,%22filterByScheduleRoomIds%22%3A%5B%5D,%22filterBySessionTypeIds%22%3A%5B%5D,%22filterByScheduleDayIds%22%3A%5B%5D,%22filterByScheduleTimeSlotIds%22%3A%5B%5D,%22isScheduleOtherEventSearchAllowed%22%3Atrue%7D\" rel=\"nofollow\"\u003eentire searchable program\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eLearn more about the \u003ca href=\"https://www.evaluationconference.org/Programs/Workshops\" rel=\"nofollow\"\u003eprofessional development workshops\u003c/a\u003e offered Monday, Tuesday, and Wednesday prior to the conference\u003c/li\u003e\n\u003cli\u003eAttend all the \u003ca href=\"https://www.evaluationconference.org/Programs/Social-Events\" rel=\"nofollow\"\u003esocial events\u003c/a\u003e at the conference: poster exhibit \u0026amp; meet the authors reception, TIG fair \u0026amp; reception, and the silent auction to benefit international presenters\u003c/li\u003e\n\u003cli\u003eAttend all the \u003ca href=\"https://www.evaluationconference.org/Programs/Plenary-Sessions\" rel=\"nofollow\"\u003eplenary sessions\u003c/a\u003e and \u003ca href=\"https://www.evaluationconference.org/Programs/Presidential-Strand\" rel=\"nofollow\"\u003epresidential strand sessions\u003c/a\u003e focused on the \u003ca href=\"https://www.evaluationconference.org/About/2022-Theme\" rel=\"nofollow\"\u003etheme of the conference\u003c/a\u003e and watch the \u003ca href=\"https://www.evaluationconference.org/Programs/Virtual-Pre-Conference-Presidential-Series\" rel=\"nofollow\"\u003evirtual pre-conference presidential town hall series\u003c/a\u003e that occurred in the months leading up to the conference\u003c/li\u003e\n\u003cli\u003eCheck out the \u003ca href=\"https://www.evaluationconference.org/Attendees/Attendee-Resources\" rel=\"nofollow\"\u003eresources for attendees\u003c/a\u003e, including guide to New Orleans, Zoom background options, PowerPoint templates, marketing toolkit, and tips for social media\u003c/li\u003e\n\u003cli\u003eCheck out the \u003ca href=\"https://www.evaluationconference.org/Speakers/Presenter-Resources\" rel=\"nofollow\"\u003espeaker resources\u003c/a\u003e, including information about rooms and materials, printing and shipping, and the \u003ca href=\"https://www.eval.org/Education-Programs/Potent-Presentations\" rel=\"nofollow\"\u003epotent presentations information\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eCheck out the \u003ca href=\"https://floorplan.dc.smithbucklin.com/fxfloorplan/22AEA/exfx.html#floorplan\" rel=\"nofollow\"\u003efloor plan for the Exhibit Hall\u003c/a\u003e, including the exhibitors, posters, and TIG fair\u003c/li\u003e\n\u003cli\u003eThis LinkedIn post by Sylvia Pu, PhD has a ton of great comments about \u003ca href=\"https://www.linkedin.com/posts/sylviapu_aeaconference-aea-activity-6985348540688433152-ssj1?utm_source=share\u0026utm_medium=member_desktop\" rel=\"nofollow\"\u003ehow to get the most out of the conference\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e","summary":"In this episode, I provide a brief overview of the #Eval22 conference, describe the schedule at a glance, and provide tips for getting the most out of the conference. I hope to see you in New Orleans! Say hi to me at the conference to get an EvaluLand nametag ribbon. ","date_published":"2022-11-01T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/66ba2d37-0d55-449b-9d0a-fefda814f6ad.mp3","mime_type":"audio/mpeg","size_in_bytes":12437872,"duration_in_seconds":906}]},{"id":"a2ea0f0f-5341-4cc6-8967-d723eb61940c","title":"38: Subcontracting with Dr. Tamara Hamai","url":"https://evaluland.fireside.fm/38","content_text":"I talked with Dr. Tamara Hamai of Hamai Consulting about contracting, subcontracting, and independent consulting in evaluation. We discussed the minor differences between contracting and subcontracting, cleared up a common misconception of what subcontracting relationships are like, how to get into subcontracting, and tips for setting up contracts. \n\nContact information:\n\nTamara Hamai\nHamai Consulting\nassistant@hamaiconsulting.com\nhttps://sustainableimpact.co \n\nAbout Dr. Tamara Hamai:\n\nTamara Hamai, Ph.D., has dedicated her career to empowering organizations and rebuilding our global systems to encourage children’s holistic growth and well-being, from prenatal through the completion of higher education – especially those who are most vulnerable and facing the greatest challenges. In 2008, she founded Hamai Consulting as a platform to help organizations increase their impact, stability, and strength to make a bigger impact in children’s lives. Dr. Hamai’s work spans most aspects of child development, such as early childhood education, higher education, child welfare, parenting and discipline, trauma, and adverse childhood experiences. She has previously been featured by KTLA, KPIX CBS San Francisco, ABC 7 News, NBC Radio, American Psychological Association, Western Psychological Association, Institute for Violence, Abuse, and Trauma, American Evaluation Association, National Head Start Association, and several blogs. She is also a reviewer and on the Editorial Board for publications such as the Journal of Aggression, Maltreatment \u0026amp; Trauma, Journal of Child \u0026amp; Adolescent Trauma, Journal of Sexual Abuse, and the Journal of Child Custody.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eI talked with Dr. Tamara Hamai of Hamai Consulting about contracting, subcontracting, and independent consulting in evaluation. We discussed the minor differences between contracting and subcontracting, cleared up a common misconception of what subcontracting relationships are like, how to get into subcontracting, and tips for setting up contracts. \u003c/p\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cp\u003eTamara Hamai\u003cbr\u003e\nHamai Consulting\u003cbr\u003e\n\u003ca href=\"mailto:assistant@hamaiconsulting.com\" rel=\"nofollow\"\u003eassistant@hamaiconsulting.com\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"https://sustainableimpact.co\" rel=\"nofollow\"\u003ehttps://sustainableimpact.co\u003c/a\u003e \u003c/p\u003e\n\n\u003ch3\u003eAbout Dr. Tamara Hamai:\u003c/h3\u003e\n\n\u003cp\u003eTamara Hamai, Ph.D., has dedicated her career to empowering organizations and rebuilding our global systems to encourage children’s holistic growth and well-being, from prenatal through the completion of higher education – especially those who are most vulnerable and facing the greatest challenges. In 2008, she founded Hamai Consulting as a platform to help organizations increase their impact, stability, and strength to make a bigger impact in children’s lives. Dr. Hamai’s work spans most aspects of child development, such as early childhood education, higher education, child welfare, parenting and discipline, trauma, and adverse childhood experiences. She has previously been featured by KTLA, KPIX CBS San Francisco, ABC 7 News, NBC Radio, American Psychological Association, Western Psychological Association, Institute for Violence, Abuse, and Trauma, American Evaluation Association, National Head Start Association, and several blogs. She is also a reviewer and on the Editorial Board for publications such as the Journal of Aggression, Maltreatment \u0026amp; Trauma, Journal of Child \u0026amp; Adolescent Trauma, Journal of Sexual Abuse, and the Journal of Child Custody.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":" I talked with Dr. Tamara Hamai of Hamai Consulting about contracting, subcontracting, and independent consulting in evaluation. We discussed the minor differences between contracting and subcontracting, cleared up a common misconception of what subcontracting relationships are like, how to get into subcontracting, and tips for setting up contracts. ","date_published":"2022-09-06T04:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/a2ea0f0f-5341-4cc6-8967-d723eb61940c.mp3","mime_type":"audio/mpeg","size_in_bytes":17398200,"duration_in_seconds":3136}]},{"id":"bfeb50e4-dbae-49e3-becc-ab1075aa3b44","title":"37: Strategic Planning with Carrie Tanasichuk and Harry Daley","url":"https://evaluland.fireside.fm/37","content_text":"This episode I chatted with Carrie Tanasichuk and Harry Daley about how they have been using theories of change as their main process for facilitating strategic planning with non-profits. \n\nIn the episode, they also mentioned:\n\n\nThe Community Foundation of Saint John’s impact measurement and evaluation principles\nThe Community Builder’s Approach to Theory of Change\nThe Miles Nadal JCC Theory of Change\n\n\nAbout Carrie and Harry:\n\n*Carrie Tanasichuk *(Twitter DrCarrieTee \u0026amp; [carrie@sjfoundation.ca](carrie@sjfoundation.ca)) has 16 years of experience in evaluation. She is passionate about using her expertise to help organizations demonstrate impact, improve, and innovate. She has worked across sectors (non-profit, for-profit, government) in diverse areas, including poverty reduction, youth development, criminal justice, health promotion and screening, and technology. She has a Ph.D. in Applied Social Psychology from the University of Saskatchewan.\n\nHarry Daley ([harry@sjfoundation.ca](harry@sjfoundation.ca)) was born and raised in Saint John, New Brunswick. He has dedicated his personal and professional life to working with organizations that focus on poverty reduction and amplifying the youth voice. He has used evaluation as a tool for designing experiential and participatory youth programming and believes evaluation is an integral aspect of program design and facilitation rather than something that lives outside the programs. Harry has a Bachelor of Philosophy in Interdisciplinary Leadership from the University of New Brunswick’s Renaissance College.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis episode I chatted with Carrie Tanasichuk and Harry Daley about how they have been using theories of change as their main process for facilitating strategic planning with non-profits. \u003c/p\u003e\n\n\u003cp\u003eIn the episode, they also mentioned:\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eThe Community Foundation of Saint John’s \u003ca href=\"https://thecommunityfoundationsj.com/impact/\" rel=\"nofollow\"\u003eimpact measurement and evaluation principles\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eThe Community Builder’s \u003ca href=\"https://www.theoryofchange.org/pdf/TOC_fac_guide.pdf\" rel=\"nofollow\"\u003eApproach to Theory of Change\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eThe \u003ca href=\"https://www.mnjcc.org/\" rel=\"nofollow\"\u003eMiles Nadal\u003c/a\u003e JCC \u003ca href=\"https://changeopenly.com/wp-content/uploads/2020/12/TOCsample-MNjcc_TheoryofChange.pdf\" rel=\"nofollow\"\u003eTheory of Change\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Carrie and Harry:\u003c/h3\u003e\n\n\u003cp\u003e*\u003cem\u003eCarrie Tanasichuk *\u003c/em\u003e(Twitter \u003ca href=\"https://twitter.com/DrCarrieTee\" rel=\"nofollow\"\u003eDrCarrieTee\u003c/a\u003e \u0026amp; [\u003ca href=\"mailto:carrie@sjfoundation.ca\" rel=\"nofollow\"\u003ecarrie@sjfoundation.ca\u003c/a\u003e](\u003ca href=\"mailto:carrie@sjfoundation.ca\" rel=\"nofollow\"\u003ecarrie@sjfoundation.ca\u003c/a\u003e)) has 16 years of experience in evaluation. She is passionate about using her expertise to help organizations demonstrate impact, improve, and innovate. She has worked across sectors (non-profit, for-profit, government) in diverse areas, including poverty reduction, youth development, criminal justice, health promotion and screening, and technology. She has a Ph.D. in Applied Social Psychology from the University of Saskatchewan.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eHarry Daley\u003c/strong\u003e ([\u003ca href=\"mailto:harry@sjfoundation.ca\" rel=\"nofollow\"\u003eharry@sjfoundation.ca\u003c/a\u003e](\u003ca href=\"mailto:harry@sjfoundation.ca\" rel=\"nofollow\"\u003eharry@sjfoundation.ca\u003c/a\u003e)) was born and raised in Saint John, New Brunswick. He has dedicated his personal and professional life to working with organizations that focus on poverty reduction and amplifying the youth voice. He has used evaluation as a tool for designing experiential and participatory youth programming and believes evaluation is an integral aspect of program design and facilitation rather than something that lives outside the programs. Harry has a Bachelor of Philosophy in Interdisciplinary Leadership from the University of New Brunswick’s Renaissance College.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This episode I chatted with Carrie Tanasichuk and Harry Daley about how they have been using theories of change as your main process for facilitating strategic planning with non-profits. ","date_published":"2022-08-02T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/bfeb50e4-dbae-49e3-becc-ab1075aa3b44.mp3","mime_type":"audio/mpeg","size_in_bytes":21295824,"duration_in_seconds":3763}]},{"id":"20e55745-3ac7-4b2a-a389-e762e756c9c5","title":"36: Evaluation Job Market with Bradlie Nabours","url":"https://evaluland.fireside.fm/36","content_text":"This episode I chatted with Bradlie Nabours about how he got into the field of evaluation and his experience applying for evaluation jobs. He also talks about his evaluation experience and provides great tips on applying for jobs in the evaluation space. \n\nJob search \u0026amp; application recommendations:\n\n\nDon’t give up. Know your worth. The job process is difficult, but don’t settle and remember it doesn’t reflect necessarily on you. Keep applying!\nDon’t limit yourself in what positions you look for. Expand your horizons.\nNetwork like your life depends on it! This includes having an online presence and building and leveraging connections with people in your field such as through LinkedIn, EvalYouth (LinkedIn \u0026amp; Twitter @evalyouth_na), and your professors!\nBe a versatile applicant. Build your resume. Seek out learning opportunities to grow as a professional. Be willing to experiment and try new things. \n\n\nContact information:\n\n\nEmail: [bradlietnabours@gmail.com ](bradlietnabours@gmail.com)\nTwitter: bradn98\nLinkedIn: www.linkedin.com/in/bnabours\n\n\nAbout Bradlie Nabours:\n\nBradlie is a perinatal health program evaluator at Johns Hopkins All Children’s Hospital in St.Petersburg, Fl. He works for a federal Healthy Start program focused on reducing adverse perinatal outcomes for black women and their families. He holds a Bachelors of Science in Public Health from Georgia Southern University and completed his Master’s in Public Health with a graduate certificate in Maternal and Child Health from the University of South Florida. He started his evaluation journey while in grad school where he worked as a graduate assistance on the evaluation of a non-profit family violence prevention program. While in grad school his research focused racial disparities in birth outcomes which led him to start his career at the intersection of his research interest and evaluation. \n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis episode I chatted with Bradlie Nabours about how he got into the field of evaluation and his experience applying for evaluation jobs. He also talks about his evaluation experience and provides great tips on applying for jobs in the evaluation space. \u003c/p\u003e\n\n\u003ch3\u003eJob search \u0026amp; application recommendations:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eDon’t give up. Know your worth. The job process is difficult, but don’t settle and remember it doesn’t reflect necessarily on you. Keep applying!\u003c/li\u003e\n\u003cli\u003eDon’t limit yourself in what positions you look for. Expand your horizons.\u003c/li\u003e\n\u003cli\u003eNetwork like your life depends on it! This includes having an online presence and building and leveraging connections with people in your field such as through LinkedIn, EvalYouth (\u003ca href=\"https://www.linkedin.com/company/evalyouth-north-america/\" rel=\"nofollow\"\u003eLinkedIn\u003c/a\u003e \u0026amp; Twitter \u003ca href=\"https://twitter.com/evalyouth_na\" rel=\"nofollow\"\u003e@evalyouth_na\u003c/a\u003e), and your professors!\u003c/li\u003e\n\u003cli\u003eBe a versatile applicant. Build your resume. Seek out learning opportunities to grow as a professional. Be willing to experiment and try new things. \u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eEmail: [\u003ca href=\"mailto:bradlietnabours@gmail.com\" rel=\"nofollow\"\u003ebradlietnabours@gmail.com\u003c/a\u003e ](\u003ca href=\"mailto:bradlietnabours@gmail.com\" rel=\"nofollow\"\u003ebradlietnabours@gmail.com\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eTwitter: \u003ca href=\"https://twitter.com/bradn98\" rel=\"nofollow\"\u003ebradn98\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eLinkedIn: \u003ca href=\"http://www.linkedin.com/in/bnabours\" rel=\"nofollow\"\u003ewww.linkedin.com/in/bnabours\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Bradlie Nabours:\u003c/h3\u003e\n\n\u003cp\u003eBradlie is a perinatal health program evaluator at Johns Hopkins All Children’s Hospital in St.Petersburg, Fl. He works for a federal Healthy Start program focused on reducing adverse perinatal outcomes for black women and their families. He holds a Bachelors of Science in Public Health from Georgia Southern University and completed his Master’s in Public Health with a graduate certificate in Maternal and Child Health from the University of South Florida. He started his evaluation journey while in grad school where he worked as a graduate assistance on the evaluation of a non-profit family violence prevention program. While in grad school his research focused racial disparities in birth outcomes which led him to start his career at the intersection of his research interest and evaluation. \u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This episode I chatted with Bradlie Nabours about how he got into the field of evaluation and his experience applying for evaluation jobs. He also talks about his evaluation experience and provides great tips on applying for jobs in the evaluation space. ","date_published":"2022-07-05T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/20e55745-3ac7-4b2a-a389-e762e756c9c5.mp3","mime_type":"audio/mpeg","size_in_bytes":17634360,"duration_in_seconds":3259}]},{"id":"de544414-b7c8-4303-873b-c12d31300250","title":"35: International Evaluation with Dr. Tristi Nichols","url":"https://evaluland.fireside.fm/35","content_text":"On this episode, I’m chatting with Dr. Tristi Nichols about her work conducting international evaluation and her journey into the international and evaluation spaces. \n\nResources:\n\n\nFootprint evaluation\nOECD DAC Criteria for Evaluation Framework\n\n\nList of websites to find international evaluation: \n\n\nhttps://www.ungm.org/ type “evaluation” in the title bar [for UN only]\nhttps://reliefweb.int/ or https://reliefweb.int/jobs\nhttps://www.evalcommunity.com/\n\n\nContact information:\n\nTristi Nichols\ntnichols@manitouinc.com\n914-414-8288\n@tristiempo\nhttps://www.linkedin.com/in/drtristinichols/ \n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eOn this episode, I’m chatting with Dr. Tristi Nichols about her work conducting international evaluation and her journey into the international and evaluation spaces. \u003c/p\u003e\n\n\u003ch3\u003eResources:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://www.betterevaluation.org/en/footprint-evaluation-webinar\" rel=\"nofollow\"\u003eFootprint evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.oecd.org/dac/evaluation/daccriteriaforevaluatingdevelopmentassistance.htm\" rel=\"nofollow\"\u003eOECD DAC Criteria for Evaluation Framework\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eList of websites to find international evaluation: \u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://www.ungm.org/\" rel=\"nofollow\"\u003ehttps://www.ungm.org/\u003c/a\u003e type “evaluation” in the title bar [for UN only]\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://reliefweb.int/\" rel=\"nofollow\"\u003ehttps://reliefweb.int/\u003c/a\u003e or \u003ca href=\"https://reliefweb.int/jobs\" rel=\"nofollow\"\u003ehttps://reliefweb.int/jobs\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.evalcommunity.com/\" rel=\"nofollow\"\u003ehttps://www.evalcommunity.com/\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cp\u003eTristi Nichols\u003cbr\u003e\n\u003ca href=\"mailto:tnichols@manitouinc.com\" rel=\"nofollow\"\u003etnichols@manitouinc.com\u003c/a\u003e\u003cbr\u003e\n914-414-8288\u003cbr\u003e\n@tristiempo\u003cbr\u003e\n\u003ca href=\"https://www.linkedin.com/in/drtristinichols/\" rel=\"nofollow\"\u003ehttps://www.linkedin.com/in/drtristinichols/\u003c/a\u003e \u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"On this episode, I’m chatting with Dr. Tristi Nichols about her work conducting international evaluation and her journey into the international and evaluation spaces. ","date_published":"2022-06-07T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/de544414-b7c8-4303-873b-c12d31300250.mp3","mime_type":"audio/mpeg","size_in_bytes":43388184,"duration_in_seconds":3426}]},{"id":"9656e244-c489-4168-a640-847525578f57","title":"34: Evaluation Job Market with Dr. Ayesha Boyce","url":"https://evaluland.fireside.fm/34","content_text":"On this episode, I’m chatting with Dr. Ayesha Boyce about the evaluation job market. Ayesha provides a ton of great insights and information about how to search for jobs, what to consider when looking for jobs, and tips for being a strong job candidate. \n\nAyesha was previously on the podcast discussing \"teaching evaluation and supporting students and colleagues of color.\"\n\nContact information:\n\nAyesha Boyce\nEmail: ayesha.boyce@asu.edu\nTwitter: @AyeshaBoyce\nWebsite: https://education.asu.edu/about/people/ayesha-boyce\n\nAbout GUEST:\n\nAyesha Boyce is currently an associate professor in the Division of Educational Leadership and Innovation at Arizona State University. She also co-directs the STEM Program Evaluation Lab. Boyce’s scholarship focuses on attending to value stances and issues related to diversity, equity, inclusion, access, cultural responsiveness, and social justice within evaluation—especially multi-site, STEM, and contexts with historically marginalized populations. She also examines teaching, mentoring, and learning in evaluation. She has evaluated more than 55 programs funded by the National Science Foundation (NSF), US Department of Education, National Institutes of Health, and Spencer and Teagle foundations. Boyce is a 2019 American Evaluation Association Marcia Guttentag Promising New Evaluator Award recipient. In her teaching and mentorship, Boyce encourages students to develop a strong methodological foundation, conduct studies based on democratic principles, and promote equity, fairness, inclusivity, and diversity.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eOn this episode, I’m chatting with Dr. Ayesha Boyce about the evaluation job market. Ayesha provides a ton of great insights and information about how to search for jobs, what to consider when looking for jobs, and tips for being a strong job candidate. \u003c/p\u003e\n\n\u003cp\u003eAyesha was previously on the podcast discussing \u0026quot;\u003ca href=\"https://evaluland.fireside.fm/4\" rel=\"nofollow\"\u003eteaching evaluation and supporting students and colleagues of color\u003c/a\u003e.\u0026quot;\u003c/p\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cp\u003eAyesha Boyce\u003cbr\u003e\nEmail: \u003ca href=\"mailto:ayesha.boyce@asu.edu\" rel=\"nofollow\"\u003eayesha.boyce@asu.edu\u003c/a\u003e\u003cbr\u003e\nTwitter: @AyeshaBoyce\u003cbr\u003e\nWebsite: \u003ca href=\"https://education.asu.edu/about/people/ayesha-boyce\" rel=\"nofollow\"\u003ehttps://education.asu.edu/about/people/ayesha-boyce\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003eAbout GUEST:\u003c/h3\u003e\n\n\u003cp\u003eAyesha Boyce is currently an associate professor in the Division of Educational Leadership and Innovation at Arizona State University. She also co-directs the \u003ca href=\"http://www.stemprogramevaluation.org\" rel=\"nofollow\"\u003eSTEM Program Evaluation Lab\u003c/a\u003e. Boyce’s scholarship focuses on attending to value stances and issues related to diversity, equity, inclusion, access, cultural responsiveness, and social justice within evaluation—especially multi-site, STEM, and contexts with historically marginalized populations. She also examines teaching, mentoring, and learning in evaluation. She has evaluated more than 55 programs funded by the National Science Foundation (NSF), US Department of Education, National Institutes of Health, and Spencer and Teagle foundations. Boyce is a 2019 American Evaluation Association Marcia Guttentag Promising New Evaluator Award recipient. In her teaching and mentorship, Boyce encourages students to develop a strong methodological foundation, conduct studies based on democratic principles, and promote equity, fairness, inclusivity, and diversity.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"On this episode, I’m chatting with Dr. Ayesha Boyce about the evaluation job market. Ayesha provides a ton of great insights and information about how to search for jobs, what to consider when looking for jobs, and tips for being a strong job candidate. ","date_published":"2022-05-03T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/9656e244-c489-4168-a640-847525578f57.mp3","mime_type":"audio/mpeg","size_in_bytes":47439744,"duration_in_seconds":3591}]},{"id":"59b11bc5-040a-4647-902e-b8909c2f843d","title":"33: Worker Training Evaluation with Dr. Eric Persaud","url":"https://evaluland.fireside.fm/33","content_text":"On this episode, I’m chatting with Eric Persaud about evaluation at the National Institutes of Health, including his work in the Worker Training Program at the National Institute of Environmental Health Sciences. We also talked about his dissertation, how he got into the field of evaluation, and his experiences in conducting evaluation in general.\n\nAbout Dr. Eric Persaud:\n\nEric Persaud received his doctorate in Public Health at the Department of Environmental and Occupational Health Sciences, State University of New York-Downstate Health Sciences University. He focuses on evaluating and researching training programs related to preparing workers for emergencies and disasters, and hazardous workplaces. He has been involved in evaluation and research associated with fentanyl and first responders, opioids and the workplace, and protecting workers from COVID-19.\n\nYou can reach Eric Persaud at Eric.Persaud@NIH.gov \n\nYou can learn more about the NIEHS Worker Training Program at https://www.niehs.nih.gov/careers/hazmat/about_wetp/index.cfm \n\nResources:\n\n\nBiosafety and infectious disease occupational health training from the NIEHS Worker Training Program: A Historical look at capacity building that supported a COVID-19 response. Eric Persaud, Deborah Weinstock, Demia S. Wright. Journal of Emergency Management. 2022. \nOpioids and the Workplace Prevention and Response Awareness Training: Mixed Methods Follow-Up Evaluation - Eric Persaud, Aimee Afable, Laura A. Geer, Paul Landsbergis, 2021\nCOVID-19 Biosafety Training and Infectious Disease Response Evaluation Report. NIEHS Worker Training Program. 2021.\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eOn this episode, I’m chatting with Eric Persaud about evaluation at the National Institutes of Health, including his work in the Worker Training Program at the National Institute of Environmental Health Sciences. We also talked about his dissertation, how he got into the field of evaluation, and his experiences in conducting evaluation in general.\u003c/p\u003e\n\n\u003ch3\u003eAbout Dr. Eric Persaud:\u003c/h3\u003e\n\n\u003cp\u003eEric Persaud received his doctorate in Public Health at the Department of Environmental and Occupational Health Sciences, State University of New York-Downstate Health Sciences University. He focuses on evaluating and researching training programs related to preparing workers for emergencies and disasters, and hazardous workplaces. He has been involved in evaluation and research associated with fentanyl and first responders, opioids and the workplace, and protecting workers from COVID-19.\u003c/p\u003e\n\n\u003cp\u003eYou can reach Eric Persaud at \u003ca href=\"mailto:Eric.Persaud@NIH.gov\" rel=\"nofollow\"\u003eEric.Persaud@NIH.gov\u003c/a\u003e \u003c/p\u003e\n\n\u003cp\u003eYou can learn more about the NIEHS Worker Training Program at \u003ca href=\"https://www.niehs.nih.gov/careers/hazmat/about_wetp/index.cfm\" rel=\"nofollow\"\u003ehttps://www.niehs.nih.gov/careers/hazmat/about_wetp/index.cfm\u003c/a\u003e \u003c/p\u003e\n\n\u003ch3\u003eResources:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://www.wmpllc.org/ojs/index.php/jem/article/view/3172/3440\" rel=\"nofollow\"\u003eBiosafety and infectious disease occupational health training from the NIEHS Worker Training Program: A Historical look at capacity building that supported a COVID-19 response. Eric Persaud, Deborah Weinstock, Demia S. Wright. Journal of Emergency Management. 2022. \u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://journals.sagepub.com/doi/abs/10.1177/10482911211010343\" rel=\"nofollow\"\u003eOpioids and the Workplace Prevention and Response Awareness Training: Mixed Methods Follow-Up Evaluation - Eric Persaud, Aimee Afable, Laura A. Geer, Paul Landsbergis, 2021\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://tools.niehs.nih.gov/wetp/public/hasl_get_blob.cfm?ID=13421\" rel=\"nofollow\"\u003eCOVID-19 Biosafety Training and Infectious Disease Response Evaluation Report. NIEHS Worker Training Program. 2021.\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"On this episode, I’m chatting with Eric Persaud about evaluation at the National Institutes of Health, including his work in the Worker Training Program at the National Institute of Environmental Health Sciences. We also talked about his dissertation, how he got into the field of evaluation, and his experiences in conducting evaluation in general.","date_published":"2022-04-12T06:15:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/59b11bc5-040a-4647-902e-b8909c2f843d.mp3","mime_type":"audio/mpeg","size_in_bytes":35787288,"duration_in_seconds":2967}]},{"id":"42c7d8b8-de6d-465b-995f-84c2ee5243be","title":"32: Systemic Design Thinking with Jan Noga","url":"https://evaluland.fireside.fm/32","content_text":"This episode I chatted with Jan Noga about systemic design thinking. There’s a wealth of resources and information provided below!\n\nContact information:\n\nJan Noga\nJan.Noga@pathfinderevaluation.com\nwww.pathfinderevaluation.com\n\nAbout Jan Noga:\n\nJan Noga is an independent evaluation consultant based in Cincinnati, Ohio. She holds a bachelor’s degree from Stanford in developmental and counseling psychology with specialization in early and middle childhood and a master’s degree from the University of Cincinnati in instructional design and technology. Jan has worked in the non-profit and public sectors in human services and education for more than 30 years in roles spanning teaching, research, policy, and program planning and evaluation. As a program evaluator, Jan has planned and conducted both large and small-scale evaluations and provided organizational consulting and capacity building support to clients. She has also taught courses and workshops on such topics as systems thinking, systemic design thinking, research methods and techniques, program planning and development, and survey design and analysis. Jan has been a member of AEA since 2000 and was one of the founding members of the Systems in Evaluation TIG, serving as program chair and then TIG chair from 2004-2012. She is particularly interested in the use of systems approaches as a foundation for design, planning, implementation, and evaluation of change efforts in the human service and education arenas. \n\nSystems Thinking Resources for Evaluators:\n\nHands on resources:\n\n\nWilliams, Bob. 2020. Systemic evaluation design: A workbook. Available for download from https://bobwilliams.gumroad.com/\nWilliams, Bob. 2021. Systems diagrams: A practical guide. Available for download from https://bobwilliams.gumroad.com/\n\n\nGood for starting out\n\n\nAnderson, V. \u0026amp; Johnson, L. (1997). Systems thinking basics: From concepts to causal loops. Waltham, MA: Pegasus Communications.\nMeadows, D.H. (2008). Thinking in systems: A primer. White River Junction, VT: Chelsea Green Publishing.\nRamage, M. \u0026amp; Shipp, K (2009). Systems Thinkers. New York: Springer.\nSweeney, L.B. \u0026amp; Meadows, D. (2010). The systems thinking playbook. White River Junction, VT: Chelsea Green Publishing.\nWilliams, B. \u0026amp; Hummelbrunner, R. (2011). Systems concepts in action: A practitioner’s toolkit. Stanford, CA: Stanford University Press.\nWilliams, B. and Imam, I, eds. (2007). Systems concepts in evaluation: An expert anthology. Point Reyes, CA: EdgePress.\nWilliams, B. and Van’t Hoft, S (2016). Wicked solutions: A systems approach to complex problems. Available at http://bit.ly/1SVoOH3\n\n\nGood for more advanced reading:\n\n\nBamberger, M, Vaessen, J., \u0026amp; Raimondo, E. (eds.) (2016) Dealing with complexity in development evaluation: A practical approach. Thousand Oaks, CA: Sage Publications.\nCabrera, D., Colosi, L., \u0026amp; Lobdell, C. (2008) Systems thinking. Evaluation and Program Planning, 31(3), 299-310.\nCabrera, D. \u0026amp; Cabrera, L (2015). Systems thinking made simple: New hope for solving wicked problems. Odyssean Publishing.\nCapra, F \u0026amp; Luisi, PL (2016). The systems view of life: A unifying vision (6th printing). New York: Cambridge University Press.\nCheckland, P. (1999). Systems thinking, systems practice. New York: John Wiley \u0026amp; Sons, Ltd. Cunliff, E., (2002) Connecting systems thinking to action, The Systems Thinker, 15(2), 6-7.\nEoyang, G.H. \u0026amp; Holladay, R.J. (2013) Adaptive action: Leveraging uncertainty in your organization. Stanford: Stanford Business Books.\nKarach, R, (1997) How to see structure, The Systems Thinker, 8(4), 6-7.\nPatton M.Q. (2010). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford Press.\nPatton, M.Q., McKegg, K., \u0026amp; Wehipeihana, N., eds. (2015). Developmental evaluation exemplars: Principles in practice. New York: Guilford Press.\nSenge, P. (1990) The fifth discipline: The art and practice of the learning organization. New York: Doubleday.\nStroh, DP (2015). Systems thinking for social change. White River Junction, VT: Chelsea Green Publishing.\nUlrich, W \u0026amp; Reynolds, M (2010). Critical systems heuristics. In: Reynolds, Martin and Holwell, Sue eds. Systems approaches to managing change: A practical guide. London: Springer, pp. 243–292.\nvon Bertalanffy, Ludwig. (1950). The theory of open systems in physics and biology. Science,\n13, 23-29.\nvon Bertalanffy, Ludwig. (1968). General systems theory. New York: George Braziller, Inc.\nWolf-Branigin, M. (2013) Using complexity theory for research and evaluation. Oxford: Oxford University Press.\n\n\nSome other resources:\n\n\nInternational Society for Systems Sciences\nhttps://aea365.org/blog/systemic-design-thinking-for-evaluation-of-social-innovations-a-pd-for-intermediate-and-advanced-evaluators-by-jan-noga/\nhttp://www.epreconsulting.com/SETIG%202018%20Principles.pdf \nhttps://systemic-design.org/\nhttps://modus.medium.com/what-the-is-systems-design-e005c1e9fef8\nhttps://rsdsymposium.org/ \nMartin Reynolds Open University\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis episode I chatted with Jan Noga about systemic design thinking. There’s a wealth of resources and information provided below!\u003c/p\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cp\u003eJan Noga\u003cbr\u003e\n\u003ca href=\"mailto:Jan.Noga@pathfinderevaluation.com\" rel=\"nofollow\"\u003eJan.Noga@pathfinderevaluation.com\u003c/a\u003e\u003cbr\u003e\n\u003ca href=\"http://www.pathfinderevaluation.com\" rel=\"nofollow\"\u003ewww.pathfinderevaluation.com\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003eAbout Jan Noga:\u003c/h3\u003e\n\n\u003cp\u003eJan Noga is an independent evaluation consultant based in Cincinnati, Ohio. She holds a bachelor’s degree from Stanford in developmental and counseling psychology with specialization in early and middle childhood and a master’s degree from the University of Cincinnati in instructional design and technology. Jan has worked in the non-profit and public sectors in human services and education for more than 30 years in roles spanning teaching, research, policy, and program planning and evaluation. As a program evaluator, Jan has planned and conducted both large and small-scale evaluations and provided organizational consulting and capacity building support to clients. She has also taught courses and workshops on such topics as systems thinking, systemic design thinking, research methods and techniques, program planning and development, and survey design and analysis. Jan has been a member of AEA since 2000 and was one of the founding members of the Systems in Evaluation TIG, serving as program chair and then TIG chair from 2004-2012. She is particularly interested in the use of systems approaches as a foundation for design, planning, implementation, and evaluation of change efforts in the human service and education arenas. \u003c/p\u003e\n\n\u003ch3\u003eSystems Thinking Resources for Evaluators:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eHands on resources:\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eWilliams, Bob. 2020. Systemic evaluation design: A workbook. Available for download from \u003ca href=\"https://bobwilliams.gumroad.com/\" rel=\"nofollow\"\u003ehttps://bobwilliams.gumroad.com/\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eWilliams, Bob. 2021. Systems diagrams: A practical guide. Available for download from \u003ca href=\"https://bobwilliams.gumroad.com/\" rel=\"nofollow\"\u003ehttps://bobwilliams.gumroad.com/\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eGood for starting out\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eAnderson, V. \u0026amp; Johnson, L. (1997). Systems thinking basics: From concepts to causal loops. Waltham, MA: Pegasus Communications.\u003c/li\u003e\n\u003cli\u003eMeadows, D.H. (2008). Thinking in systems: A primer. White River Junction, VT: Chelsea Green Publishing.\u003c/li\u003e\n\u003cli\u003eRamage, M. \u0026amp; Shipp, K (2009). Systems Thinkers. New York: Springer.\u003c/li\u003e\n\u003cli\u003eSweeney, L.B. \u0026amp; Meadows, D. (2010). The systems thinking playbook. White River Junction, VT: Chelsea Green Publishing.\u003c/li\u003e\n\u003cli\u003eWilliams, B. \u0026amp; Hummelbrunner, R. (2011). Systems concepts in action: A practitioner’s toolkit. Stanford, CA: Stanford University Press.\u003c/li\u003e\n\u003cli\u003eWilliams, B. and Imam, I, eds. (2007). Systems concepts in evaluation: An expert anthology. Point Reyes, CA: EdgePress.\u003c/li\u003e\n\u003cli\u003eWilliams, B. and Van’t Hoft, S (2016). Wicked solutions: A systems approach to complex problems. Available at \u003ca href=\"http://bit.ly/1SVoOH3\" rel=\"nofollow\"\u003ehttp://bit.ly/1SVoOH3\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eGood for more advanced reading:\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eBamberger, M, Vaessen, J., \u0026amp; Raimondo, E. (eds.) (2016) Dealing with complexity in development evaluation: A practical approach. Thousand Oaks, CA: Sage Publications.\u003c/li\u003e\n\u003cli\u003eCabrera, D., Colosi, L., \u0026amp; Lobdell, C. (2008) Systems thinking. Evaluation and Program Planning, 31(3), 299-310.\u003c/li\u003e\n\u003cli\u003eCabrera, D. \u0026amp; Cabrera, L (2015). Systems thinking made simple: New hope for solving wicked problems. Odyssean Publishing.\u003c/li\u003e\n\u003cli\u003eCapra, F \u0026amp; Luisi, PL (2016). The systems view of life: A unifying vision (6th printing). New York: Cambridge University Press.\u003c/li\u003e\n\u003cli\u003eCheckland, P. (1999). Systems thinking, systems practice. New York: John Wiley \u0026amp; Sons, Ltd. Cunliff, E., (2002) Connecting systems thinking to action, The Systems Thinker, 15(2), 6-7.\u003c/li\u003e\n\u003cli\u003eEoyang, G.H. \u0026amp; Holladay, R.J. (2013) Adaptive action: Leveraging uncertainty in your organization. Stanford: Stanford Business Books.\u003c/li\u003e\n\u003cli\u003eKarach, R, (1997) How to see structure, The Systems Thinker, 8(4), 6-7.\u003c/li\u003e\n\u003cli\u003ePatton M.Q. (2010). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford Press.\u003c/li\u003e\n\u003cli\u003ePatton, M.Q., McKegg, K., \u0026amp; Wehipeihana, N., eds. (2015). Developmental evaluation exemplars: Principles in practice. New York: Guilford Press.\u003c/li\u003e\n\u003cli\u003eSenge, P. (1990) The fifth discipline: The art and practice of the learning organization. New York: Doubleday.\u003c/li\u003e\n\u003cli\u003eStroh, DP (2015). Systems thinking for social change. White River Junction, VT: Chelsea Green Publishing.\u003c/li\u003e\n\u003cli\u003eUlrich, W \u0026amp; Reynolds, M (2010). Critical systems heuristics. In: Reynolds, Martin and Holwell, Sue eds. Systems approaches to managing change: A practical guide. London: Springer, pp. 243–292.\u003c/li\u003e\n\u003cli\u003evon Bertalanffy, Ludwig. (1950). The theory of open systems in physics and biology. Science,\u003c/li\u003e\n\u003cli\u003e13, 23-29.\u003c/li\u003e\n\u003cli\u003evon Bertalanffy, Ludwig. (1968). General systems theory. New York: George Braziller, Inc.\u003c/li\u003e\n\u003cli\u003eWolf-Branigin, M. (2013) Using complexity theory for research and evaluation. Oxford: Oxford University Press.\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eSome other resources:\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eInternational Society for Systems Sciences\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://aea365.org/blog/systemic-design-thinking-for-evaluation-of-social-innovations-a-pd-for-intermediate-and-advanced-evaluators-by-jan-noga/\" rel=\"nofollow\"\u003ehttps://aea365.org/blog/systemic-design-thinking-for-evaluation-of-social-innovations-a-pd-for-intermediate-and-advanced-evaluators-by-jan-noga/\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.epreconsulting.com/SETIG%202018%20Principles.pdf\" rel=\"nofollow\"\u003ehttp://www.epreconsulting.com/SETIG%202018%20Principles.pdf\u003c/a\u003e \u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://systemic-design.org/\" rel=\"nofollow\"\u003ehttps://systemic-design.org/\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://modus.medium.com/what-the-is-systems-design-e005c1e9fef8\" rel=\"nofollow\"\u003ehttps://modus.medium.com/what-the-is-systems-design-e005c1e9fef8\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rsdsymposium.org/\" rel=\"nofollow\"\u003ehttps://rsdsymposium.org/\u003c/a\u003e \u003c/li\u003e\n\u003cli\u003eMartin Reynolds Open University\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"in this episode, I chat with Jan Noga about systemic design thinking in evaluation.","date_published":"2022-03-08T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/42c7d8b8-de6d-465b-995f-84c2ee5243be.mp3","mime_type":"audio/mpeg","size_in_bytes":50236104,"duration_in_seconds":3936}]},{"id":"4efae706-6605-4ca1-8a80-0c9f871e143d","title":"31: Trauma-informed organizations with Martha Brown","url":"https://evaluland.fireside.fm/31","content_text":"This episode I chat with Martha Brown, PhD about trauma-informed evaluation, but more specifically about how we as evaluators can help organizations become more trauma-informed. We talk about trauma, the SAMHSA model of trauma-informed work, and much more! \n\nMartha talked about trauma-informed evaluation also on the Glass Frog podcast with Debbie Gowensmith and on the Community Possibilities podcast. Other resources mentioned include the AEA365 series on trauma-informed evaluation and the Center for Victims of Torture.\n\nFor an introductory, self-paced course to learn more about trauma and what it means to be trauma-informed, visit https://www.rjaeconsulting.com/becoming-trauma-informed-how-to-apply-the-principles-of-trauma-informed-care-to-your-life-work-and-community-  Suggested donation is $75-99 - special module for evaluators. \n\nContact information:\n\nmartha@rjaeconsulting.com \n\nAbout Martha:\n\nMartha Brown is president and founder of RJAE Consulting and an active member of the American Evaluation Association (AEA).  She received her doctorate in Curriculum \u0026amp; Instruction from Florida Atlantic University in 2015 and is an accomplished author, evaluator, program designer, presenter, trainer, and teacher. Dr. Brown’s research has been published in numerous peer-reviewed journals and edited books. She also authored the best-selling book, Creating Restorative Schools: Setting Schools Up to Succeed, available from Living Justice Press. She has presented at numerous national and international conferences on the topics of educational policy reform, restorative justice, arts education, and culturally responsive evaluation.\n\nMartha’s content expertise is in trauma informed organizations and practices, restorative justice, and arts evaluation. She brings a unique blend of creativity, caring, passion, and technical skills to her work. Martha utilizes a restorative approach to her work as an evaluator, always placing relationships at the center of her work.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis episode I chat with Martha Brown, PhD about trauma-informed evaluation, but more specifically about how we as evaluators can help organizations become more trauma-informed. We talk about trauma, the SAMHSA model of trauma-informed work, and much more! \u003c/p\u003e\n\n\u003cp\u003eMartha talked about trauma-informed evaluation also on the Glass Frog podcast with Debbie Gowensmith and on the Community Possibilities podcast. Other resources mentioned include the AEA365 series on trauma-informed evaluation and the Center for Victims of Torture.\u003c/p\u003e\n\n\u003cp\u003eFor an introductory, self-paced course to learn more about trauma and what it means to be trauma-informed, visit \u003ca href=\"https://www.rjaeconsulting.com/becoming-trauma-informed-how-to-apply-the-principles-of-trauma-informed-care-to-your-life-work-and-community-\" rel=\"nofollow\"\u003ehttps://www.rjaeconsulting.com/becoming-trauma-informed-how-to-apply-the-principles-of-trauma-informed-care-to-your-life-work-and-community-\u003c/a\u003e  Suggested donation is $75-99 - special module for evaluators. \u003c/p\u003e\n\n\u003ch3\u003eContact information:\u003c/h3\u003e\n\n\u003cp\u003e\u003ca href=\"mailto:martha@rjaeconsulting.com\" rel=\"nofollow\"\u003emartha@rjaeconsulting.com\u003c/a\u003e \u003c/p\u003e\n\n\u003ch3\u003eAbout Martha:\u003c/h3\u003e\n\n\u003cp\u003eMartha Brown is president and founder of RJAE Consulting and an active member of the American Evaluation Association (AEA).  She received her doctorate in Curriculum \u0026amp; Instruction from Florida Atlantic University in 2015 and is an accomplished author, evaluator, program designer, presenter, trainer, and teacher. Dr. Brown’s research has been published in numerous peer-reviewed journals and edited books. She also authored the best-selling book, Creating Restorative Schools: Setting Schools Up to Succeed, available from Living Justice Press. She has presented at numerous national and international conferences on the topics of educational policy reform, restorative justice, arts education, and culturally responsive evaluation.\u003c/p\u003e\n\n\u003cp\u003eMartha’s content expertise is in trauma informed organizations and practices, restorative justice, and arts evaluation. She brings a unique blend of creativity, caring, passion, and technical skills to her work. Martha utilizes a restorative approach to her work as an evaluator, always placing relationships at the center of her work.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This episode I chat with Martha Brown, PhD about trauma-informed evaluation, but more specifically about how we as evaluators can help organizations become more trauma-informed. ","date_published":"2022-02-08T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/4efae706-6605-4ca1-8a80-0c9f871e143d.mp3","mime_type":"audio/mpeg","size_in_bytes":49498104,"duration_in_seconds":3717}]},{"id":"bffb8802-8720-45ba-933d-60b96c9ebdd8","title":"30: Eval21Reflections with Radical (Re)imagining","url":"https://evaluland.fireside.fm/30","content_text":"I chat with Libby Smith and Tiffany Tovey, two of the three hosts of the Radical Re(imagining) podcast, to chat about what felt radical about the 2021 AEA virtual conference. \n\nWe'd love to hear from you! What felt radical to you about the conference? Feel free to add your reflections on LinkedIn or Twitter. Be sure to use the #Eval21 hashtag, and tag us in your reflections!\n\nTwitter accounts: \n\n\n@RadReImagining\n@work_with_libby\n@Tiffany7001\n@EvaluLand\n@danawanzer\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eI chat with Libby Smith and Tiffany Tovey, two of the three hosts of the \u003ca href=\"https://radicalreimagining.com/\" rel=\"nofollow\"\u003eRadical Re(imagining)\u003c/a\u003e podcast, to chat about what felt radical about the 2021 AEA virtual conference. \u003c/p\u003e\n\n\u003cp\u003eWe\u0026#39;d love to hear from you! What felt radical to you about the conference? Feel free to add your reflections on LinkedIn or Twitter. Be sure to use the #Eval21 hashtag, and tag us in your reflections!\u003c/p\u003e\n\n\u003cp\u003eTwitter accounts: \u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://twitter.com/RadReImagining\" rel=\"nofollow\"\u003e@RadReImagining\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://twitter.com/work_with_libby\" rel=\"nofollow\"\u003e@work_with_libby\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://twitter.com/Tiffany7001\" rel=\"nofollow\"\u003e@Tiffany7001\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://twitter.com/EvaluLand\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://twitter.com/danawanzer\" rel=\"nofollow\"\u003e@danawanzer\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"I chat with Libby Smith and Tiffany Tovey, two of the three hosts of the Radical Re(imagining) podcast, to chat about what felt radical about the 2021 AEA virtual conference. ","date_published":"2021-12-07T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/bffb8802-8720-45ba-933d-60b96c9ebdd8.mp3","mime_type":"audio/mpeg","size_in_bytes":43838550,"duration_in_seconds":2296}]},{"id":"013baa28-b8a4-4c9e-86f4-11d57acc05ce","title":"29: Project Management with Jennifer Puma","url":"https://evaluland.fireside.fm/29","content_text":"Jennifer Puma and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and how she brings her project management training into her organizations and with the clients she works with. We discuss things like scoping projects, setting up ad hoc meetings, how project management aligns with various types of budgeting approaches, and so much more! \n\nAlso, be sure to check out the Glass Frog Podcast, which is another evaluation-related podcast that I highly recommend!\n\nAs a reformed management consultant, Jennifer leverages more than 15 years of consulting and project management experience to manage program evaluations and research projects at Glass Frog. Her functional specialty is in the development and practical application of theories of change and evaluation frameworks. Jennifer holds a B.A. degree from The College of New Jersey and a M.P.A. degree from The Maxwell School of Citizenship and Public Affairs at Syracuse University. She lives in Brooklyn, NY, with her husband and ridiculous rescue dog, Sammy.\n\nHere is the John Oliver clip that Jen mentions as well: Nothing Good Happens in Excel. As Jen says, \"When it comes to project management, we do some of our work in Excel and share with clients but are careful to check in, first, about their level of comfort with Excel. John Oliver's observation is funny because it's true.\"\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eJennifer Puma and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and how she brings her project management training into her organizations and with the clients she works with. We discuss things like \u003ca href=\"https://www.evalacademy.com/new-products/program-evaluation-scoping-guide\" rel=\"nofollow\"\u003escoping projects\u003c/a\u003e, setting up ad hoc meetings, how project management aligns with various types of budgeting approaches, and so much more! \u003c/p\u003e\n\n\u003cp\u003eAlso, be sure to check out the \u003ca href=\"https://glassfrog.us/podcast/\" rel=\"nofollow\"\u003eGlass Frog Podcast\u003c/a\u003e, which is another \u003ca href=\"https://evaluland.fireside.fm/other-eval-podcasts\" rel=\"nofollow\"\u003eevaluation-related podcast\u003c/a\u003e that I highly recommend!\u003c/p\u003e\n\n\u003cp\u003eAs a reformed management consultant, \u003ca href=\"https://glassfrog.us/staff_trusted/jennifer-puma/\" rel=\"nofollow\"\u003eJennifer\u003c/a\u003e leverages more than 15 years of consulting and project management experience to manage program evaluations and research projects at \u003ca href=\"https://glassfrog.us/\" rel=\"nofollow\"\u003eGlass Frog\u003c/a\u003e. Her functional specialty is in the development and practical application of theories of change and evaluation frameworks. Jennifer holds a B.A. degree from The College of New Jersey and a M.P.A. degree from The Maxwell School of Citizenship and Public Affairs at Syracuse University. She lives in Brooklyn, NY, with her husband and ridiculous rescue dog, Sammy.\u003c/p\u003e\n\n\u003cp\u003eHere is the John Oliver clip that Jen mentions as well: \u003ca href=\"https://www.youtube.com/watch?v=S46yX42IqaA\" rel=\"nofollow\"\u003eNothing Good Happens in Excel\u003c/a\u003e. As Jen says, \u0026quot;When it comes to project management, we do some of our work in Excel and share with clients but are careful to check in, first, about their level of comfort with Excel. John Oliver\u0026#39;s observation is funny because it\u0026#39;s true.\u0026quot;\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"Jennifer Puma and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and how she brings her project management training into her organizations and with the clients she works with.","date_published":"2021-12-02T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/013baa28-b8a4-4c9e-86f4-11d57acc05ce.mp3","mime_type":"audio/mpeg","size_in_bytes":85677552,"duration_in_seconds":4470}]},{"id":"06461770-71e1-45fa-815c-58bbaf5996df","title":"28: Project Management with Jennifer Bisgard","url":"https://evaluland.fireside.fm/28","content_text":"Jennifer Bisgard and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and useful tools in her company's practice. Jennifer has a wealth of information in her over 20 years of experience leading evaluation projects, and I learned a lot about how to better do this work from her. Khulisa has a wonderful library of resources including blog posts about QASP, analyzing WhatsApp data, and using rubrics. Every Tuesday they publish #EvalTuesdayTip. \n\nMs Jennifer Bisgard co-founded Khulisa Management Services in 1993. An expert in monitoring and evaluation (M\u0026amp;E) and organisational development, she leads evaluations and capacity building assignments in the Education, Power, and Democracy and Governance sectors. Khulisa has about 100 staff, based in Johannesburg, Nairobi, Lusaka, Mbabane, and Bethesda.\n\nPrior to establishing Khulisa, Jennifer was the Senior Education Specialist at USAID/Pretoria from 1988 to 1993.\n\nMs Bisgard has served on boards for the: African Evaluation Association (AfrEA), International Organization for Cooperation in Evaluation (IOCE) and South African Monitoring and Evaluation Association (SAMEA). She is a current board member of BetterEvaluation.  \n\nJennifer co-authored a chapter of “Evaluation Failures: 22 Tales of Mistakes Made and Lessons Learned” published by Sage Publishers in August 2018. The book, edited by Kylie Hutchinson, includes a forward by Michael Quinn Paton.\n\nShe has a Master’s Degree in Social Change and Development from Johns Hopkins University.\n\nShe is an American but has been in South Africa for 33 years. She is married to Marc (a dual Dutch-South Africa citizen) and has three boys: Zuko (adopted, now 23); Dylan (18) and Thomas (14). The family is completed by Border Collie, Riley and Africanis, Milly.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eJennifer Bisgard and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and useful tools in her company\u0026#39;s practice. Jennifer has a wealth of information in her over 20 years of experience leading evaluation projects, and I learned a lot about how to better do this work from her. Khulisa has a wonderful library of resources including blog posts about \u003ca href=\"https://www.khulisa.com/lesson-5-make-sure-that-the-data-you-collect-throughout-the-evaluation-process-is-high-quality-but-remains-private/\" rel=\"nofollow\"\u003eQASP\u003c/a\u003e, \u003ca href=\"https://www.khulisa.com/a-step-by-step-guide-on-analyzing-whatsapp-data/\" rel=\"nofollow\"\u003eanalyzing WhatsApp data\u003c/a\u003e, and \u003ca href=\"https://www.khulisa.com/guest-blog-the-value-of-contribution-and-evidence-rubrics-for-evaluations/\" rel=\"nofollow\"\u003eusing rubrics\u003c/a\u003e. Every Tuesday they publish \u003ca href=\"https://www.khulisa.com/thought-leadership/eval-tuesday-tips/\" rel=\"nofollow\"\u003e#EvalTuesdayTip\u003c/a\u003e. \u003c/p\u003e\n\n\u003cp\u003eMs Jennifer Bisgard co-founded \u003ca href=\"https://www.khulisa.com/\" rel=\"nofollow\"\u003eKhulisa Management Services\u003c/a\u003e in 1993. An expert in monitoring and evaluation (M\u0026amp;E) and organisational development, she leads evaluations and capacity building assignments in the Education, Power, and Democracy and Governance sectors. Khulisa has about 100 staff, based in Johannesburg, Nairobi, Lusaka, Mbabane, and Bethesda.\u003c/p\u003e\n\n\u003cp\u003ePrior to establishing Khulisa, Jennifer was the Senior Education Specialist at USAID/Pretoria from 1988 to 1993.\u003c/p\u003e\n\n\u003cp\u003eMs Bisgard has served on boards for the: \u003ca href=\"https://afrea.org/\" rel=\"nofollow\"\u003eAfrican Evaluation Association (AfrEA)\u003c/a\u003e, \u003ca href=\"https://www.ioce.net/\" rel=\"nofollow\"\u003eInternational Organization for Cooperation in Evaluation (IOCE)\u003c/a\u003e and \u003ca href=\"https://www.samea.org.za/home\" rel=\"nofollow\"\u003eSouth African Monitoring and Evaluation Association (SAMEA)\u003c/a\u003e. She is a current board member of \u003ca href=\"https://www.betterevaluation.org/\" rel=\"nofollow\"\u003eBetterEvaluation\u003c/a\u003e.  \u003c/p\u003e\n\n\u003cp\u003eJennifer co-authored a chapter of “\u003ca href=\"https://us.sagepub.com/en-us/nam/evaluation-failures/book260109\" rel=\"nofollow\"\u003eEvaluation Failures: 22 Tales of Mistakes Made and Lessons Learned\u003c/a\u003e” published by Sage Publishers in August 2018. The book, edited by Kylie Hutchinson, includes a forward by Michael Quinn Paton.\u003c/p\u003e\n\n\u003cp\u003eShe has a Master’s Degree in Social Change and Development from Johns Hopkins University.\u003c/p\u003e\n\n\u003cp\u003eShe is an American but has been in South Africa for 33 years. She is married to Marc (a dual Dutch-South Africa citizen) and has three boys: Zuko (adopted, now 23); Dylan (18) and Thomas (14). The family is completed by Border Collie, Riley and \u003ca href=\"https://southafrica-info.com/arts-culture/africanis_original_dog_africa/\" rel=\"nofollow\"\u003eAfricanis\u003c/a\u003e, Milly.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"Jennifer Bisgard and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and useful tools in her company's practice. ","date_published":"2021-11-18T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/06461770-71e1-45fa-815c-58bbaf5996df.mp3","mime_type":"audio/mpeg","size_in_bytes":79164192,"duration_in_seconds":4122}]},{"id":"22bf96e8-a2eb-4110-8b35-711bc82222ef","title":"27: Independent Consulting with Elizabeth Grim","url":"https://evaluland.fireside.fm/27","content_text":"Elizabeth and I discuss her new independent consulting business (Elizabeth Grim Consulting LLC) and how she meets clients where they are, builds capacity and relationships, and leans into her values in the work. We also discuss Brene Brown's values exercise and another version of the exercise as a card deck, how we've embraced new ways of thinking about the world, and reporting in evaluation.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eElizabeth and I discuss her new independent consulting business (\u003ca href=\"https://elizabethgrim.com/\" rel=\"nofollow\"\u003eElizabeth Grim Consulting LLC\u003c/a\u003e) and how she meets clients where they are, builds capacity and relationships, and leans into her values in the work. We also discuss \u003ca href=\"https://daretolead.brenebrown.com/wp-content/uploads/2019/02/Values.pdf\" rel=\"nofollow\"\u003eBrene Brown\u0026#39;s values exercise\u003c/a\u003e and \u003ca href=\"https://bestself.co/products/core-values-deck\" rel=\"nofollow\"\u003eanother version of the exercise as a card deck\u003c/a\u003e, how we\u0026#39;ve embraced new ways of thinking about the world, and reporting in evaluation.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"Elizabeth and I discuss her incredible journey through evaluation from research analyst to independent consultant to founder and principal of her own evaluation consulting firm, Intention 2 Impact.","date_published":"2021-10-26T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/22bf96e8-a2eb-4110-8b35-711bc82222ef.mp3","mime_type":"audio/mpeg","size_in_bytes":63287688,"duration_in_seconds":3286}]},{"id":"3125f161-2418-4e23-b038-8a62f246d025","title":"26: Evaluation entrepreneurship with Nina Sabarre","url":"https://evaluland.fireside.fm/26","content_text":"_Note: Sorry for the poor audio quality on my end. Recording is hard... _\n\nNina and I discuss her incredible journey through evaluation from research analyst to independent consultant to founder and principal of her own evaluation consulting firm, Intention 2 Impact. We discuss starting up her business and how that's been going. Along the way, we also discuss her evaluation background, including her dissertation-in-progress on entrepreneurship in evaluation. \n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003e_Note: Sorry for the poor audio quality on my end. Recording is hard... _\u003c/p\u003e\n\n\u003cp\u003eNina and I discuss her incredible journey through evaluation from research analyst to independent consultant to founder and principal of her own evaluation consulting firm, \u003ca href=\"https://www.intention2impact.com/\" rel=\"nofollow\"\u003eIntention 2 Impact\u003c/a\u003e. We discuss starting up her business and how that\u0026#39;s been going. Along the way, we also discuss her evaluation background, including her dissertation-in-progress on entrepreneurship in evaluation. \u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"Nina and I discuss her incredible journey through evaluation from research analyst to independent consultant to founder and principal of her own evaluation consulting firm, Intention 2 Impact.","date_published":"2021-09-28T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/3125f161-2418-4e23-b038-8a62f246d025.mp3","mime_type":"audio/mpeg","size_in_bytes":64223520,"duration_in_seconds":3330}]},{"id":"9cccf79d-2e5e-4df9-8ce6-e778773989b2","title":"25: What's the difference between evaluation and research? An interview by James Pann","url":"https://evaluland.fireside.fm/25","content_text":"I'm interviewed by James Pann, PhD about my latest research on evaluation study in the American Journal of Evaluation. We discuss the difference between research and evaluation, the pros and cons of professionalization, the definition of evaluation, and other evaluation related topics.\n\nLink to the article in AJE\n\nLink to the YouTube video of the interview\n\nIf you've got ideas for the podcast, or would like to be a guest on the podcast (students, practitioners, scholars, and others are all welcome!), then please email me at dana@danawanzer.com\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eI\u0026#39;m interviewed by \u003ca href=\"https://evalnetwork.com/about-me/\" rel=\"nofollow\"\u003eJames Pann, PhD\u003c/a\u003e about my latest research on evaluation study in the American Journal of Evaluation. We discuss the difference between research and evaluation, the pros and cons of professionalization, the definition of evaluation, and other evaluation related topics.\u003c/p\u003e\n\n\u003cp\u003e\u003ca href=\"https://journals.sagepub.com/doi/abs/10.1177/1098214020920710\" rel=\"nofollow\"\u003eLink to the article in AJE\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003e\u003ca href=\"https://www.youtube.com/watch?v=KLcYU9xptwU\" rel=\"nofollow\"\u003eLink to the YouTube video of the interview\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eIf you\u0026#39;ve got ideas for the podcast, or would like to be a guest on the podcast (students, practitioners, scholars, and others are all welcome!), then please email me at \u003ca href=\"mailto:dana@danawanzer.com\" rel=\"nofollow\"\u003edana@danawanzer.com\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"I'm interviewed by James Pann, PhD about my latest research on evaluation study in the American Journal of Evaluation. ","date_published":"2021-07-13T05:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/9cccf79d-2e5e-4df9-8ce6-e778773989b2.mp3","mime_type":"audio/mpeg","size_in_bytes":67303387,"duration_in_seconds":3500}]},{"id":"90b911cc-9389-4191-8425-00c70c6b4ed2","title":"24: Evaluation Worldwide - Eastern Europe, Central Asia, and South Caucasus","url":"https://evaluland.fireside.fm/24","content_text":"After chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \n\nThis episode is one in which I chat with evaluators from the Eastern Europe, Central Asia, and South Caucasus (ECA) about what evaluation looks like in their region. I chat with Tamara Kabysh-Rybalka and Dana Reva, both of whom are involved with EvalYouth ECA, about their experiences evaluating in their region. \n\nWe discuss a variety of topics, including how they define evaluation, how their countries and region affects how evaluation is done, what valuing looks like in their region, professional ethical guidelines, stakeholder involvement, how people get into the field of evaluation, ECA Summer Institute and other training and networking opportunities, institutionalization of evaluation in ECA, regional policies related to evaluation, and more.\n\nResources discussed:\n\n\nThe Eurasian Alliance of National Evaluation Associations\nEval4Action Regional Consultation, Eurasia\nEval Partners Global Forum\n\n\nLearn more about EvalYouth ECA here:\n\n\nECA EvalYouth Website\nEvalYouth Website\nFacebook (EvalYouthECA)\nYouTube\nTwitter (EcaEval)\n\n\nAbout the guests:\n\nDana Rev: Dana Reva is doing her masters studies in sociology at the moment. Dana assisted in monitoring several projects for IOM and has been volunteering in EvalYouth ECA Task Force I since 2019.\n\nTamara Kabysh-Rybalka: Tamara Kabysh-Rybalka started working in Monitoring and Evaluation field in 2017, has experience in a variety of USAID projects/programs, is involved in EvalYouth ECA since 2019, currently works in UNFPA in the SIDA funded project on gender equality.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \u003c/p\u003e\n\n\u003cp\u003eThis episode is one in which I chat with evaluators from the Eastern Europe, Central Asia, and South Caucasus (ECA) about what evaluation looks like in their region. I chat with Tamara Kabysh-Rybalka and Dana Reva, both of whom are involved with EvalYouth ECA, about their experiences evaluating in their region. \u003c/p\u003e\n\n\u003cp\u003eWe discuss a variety of topics, including how they define evaluation, how their countries and region affects how evaluation is done, what valuing looks like in their region, professional ethical guidelines, stakeholder involvement, how people get into the field of evaluation, ECA Summer Institute and other training and networking opportunities, institutionalization of evaluation in ECA, regional policies related to evaluation, and more.\u003c/p\u003e\n\n\u003ch3\u003eResources discussed:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"http://www.evaleurasia.org/_about_en_\" rel=\"nofollow\"\u003eThe Eurasian Alliance of National Evaluation Associations\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.evaleurasia.org/_about_en_\" rel=\"nofollow\"\u003eEval4Action Regional Consultation, Eurasia\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.evaleurasia.org/_about_en_\" rel=\"nofollow\"\u003eEval Partners Global Forum\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eLearn more about EvalYouth ECA here:\u003c/h3\u003e\n\n\u003col\u003e\n\u003cli\u003e\u003ca href=\"https://www.eca-evalyouth.org/\" rel=\"nofollow\"\u003eECA EvalYouth Website\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://evalyouth.org/index.php/evalyouth-eca/\" rel=\"nofollow\"\u003eEvalYouth Website\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.facebook.com/EvalYouthECA\" rel=\"nofollow\"\u003eFacebook (EvalYouthECA)\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.youtube.com/channel/UC71edcbSrXVZHXXqUJ9WR4g\" rel=\"nofollow\"\u003eYouTube\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://twitter.com/EcaEval\" rel=\"nofollow\"\u003eTwitter (EcaEval)\u003c/a\u003e\u003c/li\u003e\n\u003c/ol\u003e\n\n\u003ch3\u003eAbout the guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eDana Rev\u003c/strong\u003e: Dana Reva is doing her masters studies in sociology at the moment. Dana assisted in monitoring several projects for IOM and has been volunteering in EvalYouth ECA Task Force I since 2019.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eTamara Kabysh-Rybalka\u003c/strong\u003e: Tamara Kabysh-Rybalka started working in Monitoring and Evaluation field in 2017, has experience in a variety of USAID projects/programs, is involved in EvalYouth ECA since 2019, currently works in UNFPA in the SIDA funded project on gender equality.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this short series of episodes, I talk with evaluators across the world to discuss what evaluation looks like in their region. In this episode, I chat with Tamara Kabysh-Rybalka and Dana Reva about evaluation in Eastern Europe, Central Asia, and South Caucasus.","date_published":"2021-05-11T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/90b911cc-9389-4191-8425-00c70c6b4ed2.mp3","mime_type":"audio/mpeg","size_in_bytes":46973971,"duration_in_seconds":2439}]},{"id":"24fb3b5d-12d9-4779-bb7f-48e13b8fdcdf","title":"23: Evaluation Worldwide - Middle East and North Africa","url":"https://evaluland.fireside.fm/23","content_text":"After chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \n\nThis episode is one in which I chat with evaluators from the Middle East and North Africa (MENA) about what evaluation looks like in their region. I chat with Hayat Askar and Sana Ben Salem about their experiences evaluating in their region, specifically Jordan and Tunisia, respectively. \n\nWe discuss a variety of topics, including how they define evaluation, how their countries and region affects how evaluation is done, what evaluation looks like in their contexts (purpose, approaches, stakeholder involvement, recommendations, use, etc.), interesting trends and things going on in their local VOPEs, how people get into the field of evaluation, and more. \n\nAbout the guests:\n\nHayat Askar: Monitoring and Evaluation (M\u0026amp;E) professional with experience in the fields of Project Management, Data Visualization and Gender, working with various stakeholders from government, private sector and international organizations. Hayat is the Vice-president of Jordan Development Evaluation Association (EvalJordan), a co-lead in EvalSDGs Guidance Group and Eval4Action blog coordinator.\n\nSana Ben Salem: Sana Ben Salem is a PhD candidate in Management and strategy of companies with a focus on digital Business Models, focal point of the Tunisian Evaluation Network, IOCE EvalMENA Representative, former chair of the professional insertion working group with the RF-Ee and member of EvalYouth Task force1. She followed many training in the evaluation field (IPDET), in diplomacy, renewable energies and SDGs. She is also an Activist in climate change, involved in the island innovation network as a representative of the Island of Djerba in Tunisia.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \u003c/p\u003e\n\n\u003cp\u003eThis episode is one in which I chat with evaluators from the Middle East and North Africa (MENA) about what evaluation looks like in their region. I chat with Hayat Askar and Sana Ben Salem about their experiences evaluating in their region, specifically Jordan and Tunisia, respectively. \u003c/p\u003e\n\n\u003cp\u003eWe discuss a variety of topics, including how they define evaluation, how their countries and region affects how evaluation is done, what evaluation looks like in their contexts (purpose, approaches, stakeholder involvement, recommendations, use, etc.), interesting trends and things going on in their local VOPEs, how people get into the field of evaluation, and more. \u003c/p\u003e\n\n\u003ch3\u003eAbout the guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eHayat Askar\u003c/strong\u003e: Monitoring and Evaluation (M\u0026amp;E) professional with experience in the fields of Project Management, Data Visualization and Gender, working with various stakeholders from government, private sector and international organizations. Hayat is the Vice-president of Jordan Development Evaluation Association (EvalJordan), a co-lead in EvalSDGs Guidance Group and Eval4Action blog coordinator.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eSana Ben Salem\u003c/strong\u003e: Sana Ben Salem is a PhD candidate in Management and strategy of companies with a focus on digital Business Models, focal point of the Tunisian Evaluation Network, IOCE EvalMENA Representative, former chair of the professional insertion working group with the RF-Ee and member of EvalYouth Task force1. She followed many training in the evaluation field (IPDET), in diplomacy, renewable energies and SDGs. She is also an Activist in climate change, involved in the island innovation network as a representative of the Island of Djerba in Tunisia.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this short series of episodes, I talk with evaluators across the world to discuss what evaluation looks like in their region. In this episode, I chat with Hayat Askar and Sana Ben Salem about evaluation in the Middle East and North Africa.","date_published":"2021-04-27T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/24fb3b5d-12d9-4779-bb7f-48e13b8fdcdf.mp3","mime_type":"audio/mpeg","size_in_bytes":55319515,"duration_in_seconds":2917}]},{"id":"3694d8fd-00c8-454c-a529-d2f075cb7adc","title":"22: Evaluation Worldwide - Latin America and Caribbean","url":"https://evaluland.fireside.fm/22","content_text":"After chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \n\nThis episode is one in which I chat with evaluators from Latin America and the Caribbean (LAC) about what evaluation looks like in their region. I chat with Claudia Olavarría and Gerardo Sánchez-Romero about evaluation in the LAC region. They are the co-chairs of EvalYouth LAC, which you can contact via Twitter, Facebook, or email via evalyouthlac@gmail.com. \n\nWe discuss a variety of topics, including how they define evaluation, stakeholder involvement, the governmental contexts they work in (e.g., CONEVAL, Mideplan), the purpose of doing evaluation, evaluation designs, evaluation standards (Estándares de Evaluación para América Latina y el Caribe), Evaluación Participativa, training and education in evaluation, professionalization, Eval4Action, the SDG 2030 Agenda, Evaluation without Borders, Blue Marble evaluation, and more. \n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \u003c/p\u003e\n\n\u003cp\u003eThis episode is one in which I chat with evaluators from Latin America and the Caribbean (LAC) about what evaluation looks like in their region. I chat with Claudia Olavarría and Gerardo Sánchez-Romero about evaluation in the LAC region. They are the co-chairs of \u003ca href=\"https://evalyouth.org/index.php/evalyouth-in-lac/\" rel=\"nofollow\"\u003eEvalYouth LAC\u003c/a\u003e, which you can contact via \u003ca href=\"https://twitter.com/evalyouth_lac\" rel=\"nofollow\"\u003eTwitter\u003c/a\u003e, \u003ca href=\"https://www.facebook.com/EvalYouthLAC/\" rel=\"nofollow\"\u003eFacebook\u003c/a\u003e, or email via \u003ca href=\"mailto:evalyouthlac@gmail.com\" rel=\"nofollow\"\u003eevalyouthlac@gmail.com\u003c/a\u003e. \u003c/p\u003e\n\n\u003cp\u003eWe discuss a variety of topics, including how they define evaluation, stakeholder involvement, the governmental contexts they work in (e.g., \u003ca href=\"https://en.wikipedia.org/wiki/National_Council_for_the_Evaluation_of_Social_Development_Policy_(CONEVAL)\" rel=\"nofollow\"\u003eCONEVAL\u003c/a\u003e, \u003ca href=\"https://www.mideplan.go.cr/\" rel=\"nofollow\"\u003eMideplan\u003c/a\u003e), the purpose of doing evaluation, evaluation designs, evaluation standards (\u003ca href=\"https://www.researchgate.net/publication/308143662_Estandares_de_Evaluacion_para_America_Latina_y_el_Caribe\" rel=\"nofollow\"\u003eEstándares de Evaluación para América Latina y el Caribe\u003c/a\u003e), \u003ca href=\"https://evalparticipativa.net/\" rel=\"nofollow\"\u003eEvaluación Participativa\u003c/a\u003e, training and education in evaluation, professionalization, \u003ca href=\"https://www.eval4action.org/\" rel=\"nofollow\"\u003eEval4Action\u003c/a\u003e, the \u003ca href=\"https://sdgs.un.org/2030agenda\" rel=\"nofollow\"\u003eSDG 2030 Agenda\u003c/a\u003e, Evaluation without Borders, Blue Marble evaluation, and more. \u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this short series of episodes, I talk with evaluators across the world to discuss what evaluation looks like in their region. In this episode, I chat with Tom Ling and Oto Potluka from the European Evaluation Society about evaluation in Europe.","date_published":"2021-04-13T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/3694d8fd-00c8-454c-a529-d2f075cb7adc.mp3","mime_type":"audio/mpeg","size_in_bytes":77544475,"duration_in_seconds":3995}]},{"id":"a6d1ffa3-e33f-459e-b3c2-5c201fdd8447","title":"21: Evaluation Worldwide - Europe","url":"https://evaluland.fireside.fm/21","content_text":"After chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \n\nThis episode is one in which I chat with evaluators from Europe about what evaluation looks like in their region. I chat with Tom Ling and Oto Potluka about European evaluation. They are both board members of the European Evaluation Society, the professional association for evaluators in Europe. We discuss a variety of topics, including the streams of evaluation happening in evaluation, the role of evaluators in program design, reflective practice, stakeholder involvement, impact evaluation, evaluation approaches like theory-driven evaluation, how the GDPR affects evaluation, and more.\n\nSpecial thanks to Lauren Weiss, the EES Adminstration and Communications Manager, for helping coordinate this episode.\n\nAbout the guests:\n\nOto Potluka: Oto Potluka (Ph.D.) is a senior researcher at the Center for Philanthropy Studies, University of Basel (Switzerland). He has studied at the University of Economics Prague, Faculty of Economics and Public Administration. Than, he obtained Ph.D. at the Charles University Prague, Faculty of Social Sciences in 2009. Since 2001, his main activities have concerned IREAS, a non-profit think tank in regional development. His responsibility was mainly evaluation work in the field of the regional and economic development, and civil society.\n\nHe has participated in dozens of Czech and international evaluation, research, and training projects in the field of economic development and the impact of public regulation and public expenditure programmes. He has experience with evaluations of public expenditure programmes in regional development, especially those co-financed by EU cohesion policy.\n\nHe has experience from several professional associations. He had been actively working in the board of directors of the Czech Evaluation Society for two terms between years 2012-2015. Among the other associations belong European Evaluation Society, American Evaluation Association, Czech Economic Association, and Regional Studies Association. As a member of these organisations, he has always actively participating in building of evaluation culture and evaluation capacities.\n\nTom Ling: Tom Ling has over 25 years of experience in designing, managing and delivering evaluations. He is a senior research leader at RAND Europe where he is head of evaluation. He leads evaluations and applied research focused on the key challenges facing organisations in health, well-being, and international development. Before re-joining RAND, Ling was head of Impact Innovation and Evidence at Save the Children where his responsibilities included ensuring that evaluations contribute to policy and change in the challenging environment of international development. Prior to Save the Children, Ling spent ten years at RAND Europe as director for Evaluation and Performance Audit following four years as senior research fellow at the National Audit Office in the UK. Before that he taught and researched in various universities.\n\nHe has over 20 years’ experience contributing to research projects with the European Commission, Save the Children, UK government departments, the National Audit Office, the Health Foundation in the UK and many others. He has published widely on evaluation, accountability, and related topics. He recently co-edited Performance Audit: Contributing to Accountability in Democratic Government (London: Edward Elgar), following his Performance Audit Handbook and The Evidence Book, a critical examination of the use of evidence in public policy and service delivery. He is a senior research associate with Cambridge University and a Professor (Emeritus) with Anglia Ruskin University.\n\nIn any spare time Tom is a keen musician playing the fiddle in both Scottish traditional and jazz bands with many recordings, compositions and performances to his name. He has a wife and two daughters and lives in Cambridge, England.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world. \u003c/p\u003e\n\n\u003cp\u003eThis episode is one in which I chat with evaluators from Europe about what evaluation looks like in their region. I chat with Tom Ling and Oto Potluka about European evaluation. They are both board members of the European Evaluation Society, the professional association for evaluators in Europe. We discuss a variety of topics, including the streams of evaluation happening in evaluation, the role of evaluators in program design, reflective practice, stakeholder involvement, impact evaluation, evaluation approaches like theory-driven evaluation, how the GDPR affects evaluation, and more.\u003c/p\u003e\n\n\u003cp\u003eSpecial thanks to Lauren Weiss, the EES Adminstration and Communications Manager, for helping coordinate this episode.\u003c/p\u003e\n\n\u003ch3\u003eAbout the guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eOto Potluka\u003c/strong\u003e: Oto Potluka (Ph.D.) is a senior researcher at the Center for Philanthropy Studies, University of Basel (Switzerland). He has studied at the University of Economics Prague, Faculty of Economics and Public Administration. Than, he obtained Ph.D. at the Charles University Prague, Faculty of Social Sciences in 2009. Since 2001, his main activities have concerned IREAS, a non-profit think tank in regional development. His responsibility was mainly evaluation work in the field of the regional and economic development, and civil society.\u003c/p\u003e\n\n\u003cp\u003eHe has participated in dozens of Czech and international evaluation, research, and training projects in the field of economic development and the impact of public regulation and public expenditure programmes. He has experience with evaluations of public expenditure programmes in regional development, especially those co-financed by EU cohesion policy.\u003c/p\u003e\n\n\u003cp\u003eHe has experience from several professional associations. He had been actively working in the board of directors of the Czech Evaluation Society for two terms between years 2012-2015. Among the other associations belong European Evaluation Society, American Evaluation Association, Czech Economic Association, and Regional Studies Association. As a member of these organisations, he has always actively participating in building of evaluation culture and evaluation capacities.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eTom Ling\u003c/strong\u003e: Tom Ling has over 25 years of experience in designing, managing and delivering evaluations. He is a senior research leader at RAND Europe where he is head of evaluation. He leads evaluations and applied research focused on the key challenges facing organisations in health, well-being, and international development. Before re-joining RAND, Ling was head of Impact Innovation and Evidence at Save the Children where his responsibilities included ensuring that evaluations contribute to policy and change in the challenging environment of international development. Prior to Save the Children, Ling spent ten years at RAND Europe as director for Evaluation and Performance Audit following four years as senior research fellow at the National Audit Office in the UK. Before that he taught and researched in various universities.\u003c/p\u003e\n\n\u003cp\u003eHe has over 20 years’ experience contributing to research projects with the European Commission, Save the Children, UK government departments, the National Audit Office, the Health Foundation in the UK and many others. He has published widely on evaluation, accountability, and related topics. He recently co-edited Performance Audit: Contributing to Accountability in Democratic Government (London: Edward Elgar), following his Performance Audit Handbook and The Evidence Book, a critical examination of the use of evidence in public policy and service delivery. He is a senior research associate with Cambridge University and a Professor (Emeritus) with Anglia Ruskin University.\u003c/p\u003e\n\n\u003cp\u003eIn any spare time Tom is a keen musician playing the fiddle in both Scottish traditional and jazz bands with many recordings, compositions and performances to his name. He has a wife and two daughters and lives in Cambridge, England.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this short series of episodes, I talk with evaluators across the world to discuss what evaluation looks like in their region. In this episode, I chat with Tom Ling and Oto Potluka from the European Evaluation Society about evaluation in Europe.","date_published":"2021-03-30T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/a6d1ffa3-e33f-459e-b3c2-5c201fdd8447.mp3","mime_type":"audio/mpeg","size_in_bytes":54943435,"duration_in_seconds":2867}]},{"id":"3a40c581-6f07-4d8c-b8d4-3ebe5258cef0","title":"20: The Influence of Carol Weiss with Gregory Greenman II","url":"https://evaluland.fireside.fm/20","content_text":"We’re getting meta today… looking at the influence of a major influencer in evaluation: Carol Weiss! I chat with Gregory Greenman II about his dissertation examining citation metrics of her work across disciplines.\n\nAbout Gregory:\n\nGregory spends a lot of his time thinking about the nature of evidence and its role in policy decisions. He believes that applying sound evaluative thinking and appropriate research methods helps us down the path toward building a just and equitable society. His current research examines the \"how and why\" of evidence-based policymaking and how we evaluate interdisciplinary research.\n\nGregory currently works with Eval4Impact, helping organizations understand which aspects of their interventions are successful. He is also an honorary fellow with the Centre for Program Evaluation at the Melbourne Graduate School of Education, where he co-taught evaluation for the past four years. Before making his way to evaluation, he managed legislative research and policy analysis on barriers to prisoner reentry and drug policy at a university in Illinois.\n\nGregory earned his PhD in Interdisciplinary Evaluation from Western Michigan University in 2020. He is the website coordinator for the RoE TIG and an associate editor for the Journal of MultiDisciplinary Evaluation.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eWe’re getting meta today… looking at the influence of a major influencer in evaluation: Carol Weiss! I chat with Gregory Greenman II about his dissertation examining citation metrics of her work across disciplines.\u003c/p\u003e\n\n\u003ch3\u003eAbout Gregory:\u003c/h3\u003e\n\n\u003cp\u003eGregory spends a lot of his time thinking about the nature of evidence and its role in policy decisions. He believes that applying sound evaluative thinking and appropriate research methods helps us down the path toward building a just and equitable society. His current research examines the \u0026quot;how and why\u0026quot; of evidence-based policymaking and how we evaluate interdisciplinary research.\u003c/p\u003e\n\n\u003cp\u003eGregory currently works with Eval4Impact, helping organizations understand which aspects of their interventions are successful. He is also an honorary fellow with the Centre for Program Evaluation at the Melbourne Graduate School of Education, where he co-taught evaluation for the past four years. Before making his way to evaluation, he managed legislative research and policy analysis on barriers to prisoner reentry and drug policy at a university in Illinois.\u003c/p\u003e\n\n\u003cp\u003eGregory earned his PhD in Interdisciplinary Evaluation from Western Michigan University in 2020. He is the website coordinator for the RoE TIG and an associate editor for the Journal of MultiDisciplinary Evaluation.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"We’re getting meta today… looking at the influence of a major influencer in evaluation: Carol Weiss! I chat with Gregory Greenman II about his dissertation examining citation metrics of her work across disciplines.","date_published":"2021-03-16T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/3a40c581-6f07-4d8c-b8d4-3ebe5258cef0.mp3","mime_type":"audio/mpeg","size_in_bytes":53819579,"duration_in_seconds":2851}]},{"id":"9359221e-dada-4cc1-afdd-d2a1a1382fb6","title":"19: Book Publishing with Helen Salmon","url":"https://evaluland.fireside.fm/19","content_text":"I chat with Helen Salmon from SAGE Publishing about book publishing! We go over how to generate ideas for books, what the book publishing process looks like, and about some of the most recent evaluation books from SAGE! \n\nSage has been a friendly publisher for evaluation books for decades. As Patton stated in the third edition of Qualitative Research and Evaluation Methods (2002): \"[Sara Miller McCune's] vision and follow-through have made Sage publications the leading publisher of both evaluation and qualitative inquiry books.\" (p. xxiv). \n\nSome recent evaluation books mentioned:\n\n\nEvaluation in Today's World by Veronica G. Thomas and Patricia B. Campbell\nThe Practice of Evaluation by Ryan P. Kilmer and James R. Cook\nCompleting Your Evaluation Dissertation, Thesis, or Culminating Project by Tamara M. Walser and Michael S. Trevisan\nProgram Evaluation by Susan P. Giancola\n\n\nMore information for interested book authors and editors: https://us.sagepub.com/en-us/nam/book-author-editors\n\nAbout Helen:\n\nHelen Salmon is an Executive Editor at SAGE Publishing where she signs and develops textbooks in research methods, statistics, and evaluation across the social and behavioral sciences. Originally from the U.K., Helen has worked for SAGE for 22 years, moving to their U.S. office in Thousand Oaks, California in 2005. She is passionate about helping authors develop books that will meet the needs of today’s students, and publishing the voices of a more diverse group of authors at SAGE.\n\nYou can find her blog here: [helen.salmon.net](helen.salmon.net)\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eI chat with Helen Salmon from SAGE Publishing about book publishing! We go over how to generate ideas for books, what the book publishing process looks like, and about some of the most recent evaluation books from SAGE! \u003c/p\u003e\n\n\u003cp\u003eSage has been a friendly publisher for evaluation books for decades. As Patton stated in the third edition of Qualitative Research and Evaluation Methods (2002): \u0026quot;[Sara Miller McCune\u0026#39;s] vision and follow-through have made Sage publications the leading publisher of both evaluation and qualitative inquiry books.\u0026quot; (p. xxiv). \u003c/p\u003e\n\n\u003cp\u003eSome recent evaluation books mentioned:\u003c/p\u003e\n\n\u003col\u003e\n\u003cli\u003e\u003ca href=\"https://us.sagepub.com/en-us/nam/evaluation-in-today%E2%80%99s-world/book263463\" rel=\"nofollow\"\u003eEvaluation in Today\u0026#39;s World\u003c/a\u003e by Veronica G. Thomas and Patricia B. Campbell\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://us.sagepub.com/en-us/nam/the-practice-of-evaluation/book254842\" rel=\"nofollow\"\u003eThe Practice of Evaluation\u003c/a\u003e by Ryan P. Kilmer and James R. Cook\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://us.sagepub.com/en-us/nam/completing-your-evaluation-dissertation-thesis-or-culminating-project/book259160\" rel=\"nofollow\"\u003eCompleting Your Evaluation Dissertation, Thesis, or Culminating Project\u003c/a\u003e by Tamara M. Walser and Michael S. Trevisan\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://us.sagepub.com/en-us/nam/program-evaluation/book253271\" rel=\"nofollow\"\u003eProgram Evaluation\u003c/a\u003e by Susan P. Giancola\u003c/li\u003e\n\u003c/ol\u003e\n\n\u003cp\u003eMore information for interested book authors and editors: \u003ca href=\"https://us.sagepub.com/en-us/nam/book-author-editors\" rel=\"nofollow\"\u003ehttps://us.sagepub.com/en-us/nam/book-author-editors\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003eAbout Helen:\u003c/h3\u003e\n\n\u003cp\u003eHelen Salmon is an Executive Editor at SAGE Publishing where she signs and develops textbooks in research methods, statistics, and evaluation across the social and behavioral sciences. Originally from the U.K., Helen has worked for SAGE for 22 years, moving to their U.S. office in Thousand Oaks, California in 2005. She is passionate about helping authors develop books that will meet the needs of today’s students, and publishing the voices of a more diverse group of authors at SAGE.\u003c/p\u003e\n\n\u003cp\u003eYou can find her blog here: [helen.salmon.net](helen.salmon.net)\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"I chat with Helen Salmon from SAGE Publishing about book publishing! ","date_published":"2021-03-02T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/9359221e-dada-4cc1-afdd-d2a1a1382fb6.mp3","mime_type":"audio/mpeg","size_in_bytes":35695267,"duration_in_seconds":2204}]},{"id":"cce31e6c-9ac2-486e-b70b-a11a26d35938","title":"18: EvalYouth Global Mentoring Program","url":"https://evaluland.fireside.fm/18","content_text":"In this week's episode, I chat with Sawsan Al-Zatari, Zach Tilton, and Teddy Theoharis about the EvalYouth Global Mentoring Program (EY-GMP).\n\nLinks:\n\n\nEvalYouth\n\n\nYEEs in VOPEs\nMentoring program\nE-Learning \nYouth participatory evaluation\n\nEY-GMP evaluations:\n\n\n2017-18 Pilot Phase\n2018-19\n2020 in-progress\n\nHow to get involved:\n\n\nBecome a volunteer for EvalYouth\nJoin a Task Force\nFollow on social media: Twitter, LinkedIn, Facebook, and YouTube\n\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eIn this week\u0026#39;s episode, I chat with Sawsan Al-Zatari, Zach Tilton, and Teddy Theoharis about the EvalYouth Global Mentoring Program (EY-GMP).\u003c/p\u003e\n\n\u003ch3\u003eLinks:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://evalyouth.org/\" rel=\"nofollow\"\u003eEvalYouth\u003c/a\u003e\n\n\u003col\u003e\n\u003cli\u003e\u003ca href=\"https://evalyouth.org/index.php/tf1-yees-in-vopes/\" rel=\"nofollow\"\u003eYEEs in VOPEs\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://evalyouth.org/index.php/tf2-mentoring-program/\" rel=\"nofollow\"\u003eMentoring program\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://evalyouth.org/index.php/tf3-elearning-conferences/\" rel=\"nofollow\"\u003eE-Learning \u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://evalyouth.org/index.php/tf4-youth-participatory-evaluation/\" rel=\"nofollow\"\u003eYouth participatory evaluation\u003c/a\u003e\u003c/li\u003e\n\u003c/ol\u003e\u003c/li\u003e\n\u003cli\u003eEY-GMP evaluations:\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://evalpartners.org/sites/default/files/documents/evalyouth/EvalYouth%20TF2%20Mentoring%20Program%20-%20Pilot%20Phase%20Evaluation%20-%20July%202018.pdf\" rel=\"nofollow\"\u003e2017-18 Pilot Phase\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://evalpartners.org/sites/default/files/files/Evaluation%20of%20GMP%202019.pdf\" rel=\"nofollow\"\u003e2018-19\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e2020 in-progress\u003c/li\u003e\n\u003c/ul\u003e\u003c/li\u003e\n\u003cli\u003eHow to get involved:\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://volunteer.evalyouth.org/?page_id=10\" rel=\"nofollow\"\u003eBecome a volunteer\u003c/a\u003e for EvalYouth\u003c/li\u003e\n\u003cli\u003eJoin a Task Force\u003c/li\u003e\n\u003cli\u003eFollow on social media: \u003ca href=\"https://twitter.com/Eval_Youth\" rel=\"nofollow\"\u003eTwitter\u003c/a\u003e, \u003ca href=\"https://www.linkedin.com/in/evalyouth/\" rel=\"nofollow\"\u003eLinkedIn\u003c/a\u003e, \u003ca href=\"https://www.facebook.com/EvalYouth\" rel=\"nofollow\"\u003eFacebook\u003c/a\u003e, and \u003ca href=\"https://www.youtube.com/channel/UC5glSYDLvUub097giZRYWpA\" rel=\"nofollow\"\u003eYouTube\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"I chat with Sawsan Al-Zatari, Zach Tilton, and Teddy Theoharis about the EvalYouth Global Mentoring Program.","date_published":"2021-02-16T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/cce31e6c-9ac2-486e-b70b-a11a26d35938.mp3","mime_type":"audio/mpeg","size_in_bytes":39262800,"duration_in_seconds":2644}]},{"id":"49a75890-d80d-4e88-8cde-9baa768a998a","title":"17: Teaching Interpersonal Effectiveness with Tiffany Smith and Libby Smith","url":"https://evaluland.fireside.fm/17","content_text":"This week I chat with Tiffany Smith and Libby Smith about our experiences teaching a course on interpersonal effectiveness in the MS in Applied Psychology program at the University of Wisconsin-Stout. We also discuss why teaching interpersonal skills is important and why we believe these skills can and should be explicitly taught. \n\nSome background on the course\n\nThe course is a 3-credit, 8-week course that focuses on developing self-awareness through personal and collaborative reflective practice. It is the third course in the evaluation concentration. Tiffany brought this course to our evaluation program and taught it from 2015-17. Libby then taught it from 2018-19, bringing in new elements. Dana taught it most recently in an online environment due to the COVID-19 pandemic. \n\nResources:\n\n\nRadical (Re)imagining: A collaborative reflective space\nBeing Human at Work: A breathwork practice for integrating the personal and professional selves\nTiffany Smith and colleagues' article \"Demystifying reflective practice: Using the DATA model to enhance evaluators' professional activities\"\nSmith, Smith, \u0026amp; Wanzer (2020) A framework for purposefully fostering interpersonal skills. Presented at the International Society for Evlauation Education (ISEE).\nGlass Frog podcast episode on Cultivating Interpersonal Effectiveness\n\n\nAbout the guests:\n\nTiffany [Smith] Tovey: Tiffany [Smith] Tovey (she/her) is a researcher, program evaluator, and educator who focuses on the importance of reflective practice, epistemological awareness, and interpersonal communication in her work and life.\n\nShe is currently the senior evaluation specialist at the Office of Assessment, Evaluation, and Research Services in the Educational Research Methodology department at the University of North Carolina Greensboro.\n\nAt UNCG, she leads and facilitates numerous evaluation and research projects in K12 education, higher education, and community settings. She also teaches workshops and courses in interpersonal skills, reflective practice, research methods (qualitative and quantitative), and evaluation.\n\nShe has a Ph. D. in Educational Psychology and Research with a focus on Evaluation, Statistics, and Measurement and a cognate in Communication Studies from the University of Tennessee, Knoxville. She has a Bachelor’s degree in Psychology and Philosophy from the University of Tennessee, Knoxville as well, and thus very much enjoys a good, deep, philosophical conversation.\n\nLibby Smith: Libby Smith (she/they) is an organizational healing facilitator, as an experienced and holistic evaluator and educator she excels at the human component of evaluation and organizational change. Never one to shy away from crucial conversations, Libby deftly balances accountability and compassion.\n\nTheir work focuses on building equity and accessibility through personal growth \u0026amp; embodiment practices. Libby uses all of these skills to provide intersectional and liberation-forward guidance to organizations and clients seeking transformative change.\n\nShe has an MS in Applied Psychology works for Catalyst at the University of Wisconsin-Stout, where she also serves as Program Director for the MS Applied Psychology program.\n\nShe has been practicing breathwork since 2018, primarily with the guidance of Amy Kuretsky, and has trained in breathwork healing with David Elliott She loves to walk in the woods, take photos and is auntie to 11 year old twin girls. You can learn more about her work at workwithlibby.com\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I chat with Tiffany Smith and Libby Smith about our experiences teaching a course on interpersonal effectiveness in the \u003ca href=\"https://www.uwstout.edu/programs/ms-applied-psychology\" rel=\"nofollow\"\u003eMS in Applied Psychology program\u003c/a\u003e at the University of Wisconsin-Stout. We also discuss why teaching interpersonal skills is important and why we believe these skills can and should be explicitly taught. \u003c/p\u003e\n\n\u003ch3\u003eSome background on the course\u003c/h3\u003e\n\n\u003cp\u003eThe course is a 3-credit, 8-week course that focuses on developing self-awareness through personal and collaborative reflective practice. It is the third course in the evaluation concentration. Tiffany brought this course to our evaluation program and taught it from 2015-17. Libby then taught it from 2018-19, bringing in new elements. Dana taught it most recently in an online environment due to the COVID-19 pandemic. \u003c/p\u003e\n\n\u003ch3\u003eResources:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://radicalreimagining.com/\" rel=\"nofollow\"\u003eRadical (Re)imagining\u003c/a\u003e: A collaborative reflective space\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://workwithlibby.com/breathwork\" rel=\"nofollow\"\u003eBeing Human at Work\u003c/a\u003e: A breathwork practice for integrating the personal and professional selves\u003c/li\u003e\n\u003cli\u003eTiffany Smith and colleagues\u0026#39; article \u0026quot;\u003ca href=\"https://www.sciencedirect.com/science/article/pii/S014971891500049X\" rel=\"nofollow\"\u003eDemystifying reflective practice: Using the DATA model to enhance evaluators\u0026#39; professional activities\u003c/a\u003e\u0026quot;\u003c/li\u003e\n\u003cli\u003eSmith, Smith, \u0026amp; Wanzer (2020) \u003ca href=\"https://vimeo.com/470799423\" rel=\"nofollow\"\u003eA framework for purposefully fostering interpersonal skills\u003c/a\u003e. Presented at the International Society for Evlauation Education (ISEE).\u003c/li\u003e\n\u003cli\u003eGlass Frog podcast episode on \u003ca href=\"https://glassfrog.us/s2e7/\" rel=\"nofollow\"\u003eCultivating Interpersonal Effectiveness\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout the guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eTiffany [Smith] Tovey\u003c/strong\u003e: \u003ca href=\"https://twitter.com/Tiffany7001\" rel=\"nofollow\"\u003eTiffany [Smith] Tovey\u003c/a\u003e (she/her) is a researcher, program evaluator, and educator who focuses on the importance of reflective practice, epistemological awareness, and interpersonal communication in her work and life.\u003c/p\u003e\n\n\u003cp\u003eShe is currently the senior evaluation specialist at the \u003ca href=\"https://oaers.uncg.edu/\" rel=\"nofollow\"\u003eOffice of Assessment, Evaluation, and Research Services\u003c/a\u003e in the \u003ca href=\"https://soe.uncg.edu/directory/faculty-and-staff/bio-tiffany-smith/\" rel=\"nofollow\"\u003eEducational Research Methodology department\u003c/a\u003e at the University of North Carolina Greensboro.\u003c/p\u003e\n\n\u003cp\u003eAt UNCG, she leads and facilitates numerous evaluation and research projects in K12 education, higher education, and community settings. She also teaches workshops and courses in interpersonal skills, reflective practice, research methods (qualitative and quantitative), and evaluation.\u003c/p\u003e\n\n\u003cp\u003eShe has a Ph. D. in Educational Psychology and Research with a focus on Evaluation, Statistics, and Measurement and a cognate in Communication Studies from the University of Tennessee, Knoxville. She has a Bachelor’s degree in Psychology and Philosophy from the University of Tennessee, Knoxville as well, and thus very much enjoys a good, deep, philosophical conversation.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eLibby Smith\u003c/strong\u003e: \u003ca href=\"https://twitter.com/work_with_libby\" rel=\"nofollow\"\u003eLibby Smith\u003c/a\u003e (she/they) is an organizational healing facilitator, as an experienced and holistic evaluator and educator she excels at the human component of evaluation and organizational change. Never one to shy away from crucial conversations, Libby deftly balances accountability and compassion.\u003c/p\u003e\n\n\u003cp\u003eTheir work focuses on building equity and accessibility through personal growth \u0026amp; embodiment practices. Libby uses all of these skills to provide intersectional and liberation-forward guidance to organizations and clients seeking transformative change.\u003c/p\u003e\n\n\u003cp\u003eShe has an MS in Applied Psychology works for \u003ca href=\"https://www.evolvewithcatalyst.com/\" rel=\"nofollow\"\u003eCatalyst\u003c/a\u003e at the University of Wisconsin-Stout, where she also serves as Program Director for the \u003ca href=\"https://www.uwstout.edu/programs/ms-applied-psychology\" rel=\"nofollow\"\u003eMS Applied Psychology program\u003c/a\u003e.\u003c/p\u003e\n\n\u003cp\u003eShe has been practicing breathwork since 2018, primarily with the guidance of Amy Kuretsky, and has trained in breathwork healing with David Elliott She loves to walk in the woods, take photos and is auntie to 11 year old twin girls. You can learn more about her work at \u003ca href=\"https://comm.eval.org/people/workwithlibby.com\" rel=\"nofollow\"\u003eworkwithlibby.com\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I chat with Tiffany and Libby about our experiences teaching a course on interpersonal effectiveness, including why it's important and why we believe these skills can and should be explicitly taught.","date_published":"2021-02-02T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/49a75890-d80d-4e88-8cde-9baa768a998a.mp3","mime_type":"audio/mpeg","size_in_bytes":62153279,"duration_in_seconds":3897}]},{"id":"f60e6b66-f735-4726-bc5c-0d7418d1ccb1","title":"16: Social Justice Evaluation with Dr. Aisha Rios","url":"https://evaluland.fireside.fm/16","content_text":"This week I chat with Dr. Aisha Rios to both get to know her a little better and to talk about social justice in evaluation. \n\nTopics \u0026amp; Resources Mentioned:\n\n\nGetting to know Dr. Rios and Coactive Change a little better\nWhat is social justice in evaluation?\nEmergent strategy as guiding Dr. Rios in framing social justice evaluation as about imagining different futures\nAbolition literature as another influence for Dr. Rios\nStudying up vs studying down: \"Up the anthropologist-Perspectives gained from studying up\" by Laura Nader\nAEA session “Illuminating the future context through an equity lens: Why systems evaluators need to use foresight and futures” by Dr. Jen Heeg and Dr. Jewlya Lynn\nAEA session “Evaluation as restorative practice: Exploring how collaborative and participatory methods can promote peace, justice, and healing in Guatemala” by Erica Henderson and Giovanni Dazzo\nImportance of building community and doing this work in relation\nBreathwork with Libby Smith\nCharacteristics of white supremacy culture\nHow to create, cultivate, and protect space for reflection \nAddressing the inadequate budget and time in proposals for appropriate diversity, equity, inclusion, and justice work \nFinding social justice evaluation work\nThinking thoughtfully of evaluation questions and being flexible about the evaluation questions throughout the evaluation process\nApproaches, methods, and reporting in social justice evaluation\nNavigating a capitalistic society as a socialist: ownership, authorship, contracts, money, and more\n\n\nContact:\n\n\nDr. Aisha Rios: Coactive Change \u0026amp; Twitter @AishaRios17\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Dr. Rios:\n\n\"My name is Aisha Rios. I founded Coactive Change in early 2020 after working for several years as an external evaluator with consulting firms functioning at the federal, state, and local levels. My passion for social change and justice permeates my participatory and collaborative approach to working with partners, and these values ground my belief in the power of evaluation as a means to facilitate learning and change. I have engaged in grassroots organizing and community building that focused on issues ranging from the exploitation of adjuncts who are overworked and underpaid, and most recently the abolition of the prison industrial complex. The work I am most proud of has centered on dismantling structural violence by way of social movement and community organizing, both directly and in supporting other change agents.\"\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I chat with Dr. Aisha Rios to both get to know her a little better and to talk about social justice in evaluation. \u003c/p\u003e\n\n\u003ch3\u003eTopics \u0026amp; Resources Mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eGetting to know Dr. Rios and Coactive Change a little better\u003c/li\u003e\n\u003cli\u003eWhat is social justice in evaluation?\u003c/li\u003e\n\u003cli\u003eEmergent strategy as guiding Dr. Rios in framing social justice evaluation as about imagining different futures\u003c/li\u003e\n\u003cli\u003eAbolition literature as another influence for Dr. Rios\u003c/li\u003e\n\u003cli\u003eStudying up vs studying down: \u0026quot;\u003ca href=\"https://upwardanth.files.wordpress.com/2014/06/nader-studyingup.pdf\" rel=\"nofollow\"\u003eUp the anthropologist-Perspectives gained from studying up\u003c/a\u003e\u0026quot; by Laura Nader\u003c/li\u003e\n\u003cli\u003eAEA session “\u003ca href=\"https://aea2020.pathable.co/meetings/virtual/y9wquEeCEFGM4H379\" rel=\"nofollow\"\u003eIlluminating the future context through an equity lens: Why systems evaluators need to use foresight and futures\u003c/a\u003e” by Dr. Jen Heeg and Dr. Jewlya Lynn\u003c/li\u003e\n\u003cli\u003eAEA session “\u003ca href=\"https://aea2020.pathable.co/meetings/virtual/ePj6Rc2rLHdQWuZ2x\" rel=\"nofollow\"\u003eEvaluation as restorative practice: Exploring how collaborative and participatory methods can promote peace, justice, and healing in Guatemala\u003c/a\u003e” by Erica Henderson and Giovanni Dazzo\u003c/li\u003e\n\u003cli\u003eImportance of building community and doing this work in relation\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://workwithlibby.com/breathwork/\" rel=\"nofollow\"\u003eBreathwork\u003c/a\u003e with Libby Smith\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.showingupforracialjustice.org/white-supremacy-culture-characteristics.html\" rel=\"nofollow\"\u003eCharacteristics of white supremacy culture\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eHow to create, cultivate, and protect space for reflection \u003c/li\u003e\n\u003cli\u003eAddressing the inadequate budget and time in proposals for appropriate diversity, equity, inclusion, and justice work \u003c/li\u003e\n\u003cli\u003eFinding social justice evaluation work\u003c/li\u003e\n\u003cli\u003eThinking thoughtfully of evaluation questions and being flexible about the evaluation questions throughout the evaluation process\u003c/li\u003e\n\u003cli\u003eApproaches, methods, and reporting in social justice evaluation\u003c/li\u003e\n\u003cli\u003eNavigating a capitalistic society as a socialist: ownership, authorship, contracts, money, and more\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eDr. Aisha Rios\u003c/strong\u003e: \u003ca href=\"https://www.coactivechange.com/\" rel=\"nofollow\"\u003eCoactive Change\u003c/a\u003e \u0026amp; Twitter \u003ca href=\"https://twitter.com/aisharios17\" rel=\"nofollow\"\u003e@AishaRios17\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Dr. Rios:\u003c/h3\u003e\n\n\u003cp\u003e\u0026quot;My name is Aisha Rios. I founded \u003ca href=\"https://www.coactivechange.com/who-we-are/aisha-rios/\" rel=\"nofollow\"\u003eCoactive Change\u003c/a\u003e in early 2020 after working for several years as an external evaluator with consulting firms functioning at the federal, state, and local levels. My passion for social change and justice permeates my participatory and collaborative approach to working with partners, and these values ground my belief in the power of evaluation as a means to facilitate learning and change. I have engaged in grassroots organizing and community building that focused on issues ranging from the exploitation of adjuncts who are overworked and underpaid, and most recently the abolition of the prison industrial complex. The work I am most proud of has centered on dismantling structural violence by way of social movement and community organizing, both directly and in supporting other change agents.\u0026quot;\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I chat with Dr. Aisha Rios to both get to know her a little better and to talk about social justice in evaluation. ","date_published":"2021-01-19T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/f60e6b66-f735-4726-bc5c-0d7418d1ccb1.mp3","mime_type":"audio/mpeg","size_in_bytes":73180207,"duration_in_seconds":3841}]},{"id":"caa2a3a4-d01a-4750-b2d6-91fef3d1329a","title":"15: Podcasting","url":"https://evaluland.fireside.fm/15","content_text":"I've received multiple questions about my podcasting setup and process. Rather than answer the questions individually, I thought I would podcast about it! I discuss why I got into podcasting, my recording technology and room setup, the audio processing my husband (aka audio engineer) does, podcast hosting, the general timeline for me to create an episode, and some extra few questions. \n\nTechnology\n\n\nOld microphone: FIFINE Plug \u0026amp; Play Home Studio USB Condenser Microphone\nMic stand: Gator Frameworks Short Weighted Base Microphone Stand\nNew microphone: Audio-Technica AT 2020 Cardioid Condenser Studio XLR Microphone\nUSB audio interface: Focusrite Scarlett Solo (3rd Gen) USB Audio Interface\nWindows audio software: Audacity\nBrowser podcasting software: Zencaster (personally, I don't recommend it)\nPodcast hosting: Fireside\n\n\nAlso check out this blog post by Echo Rivera: The Ultimate Guide to Microphones\n\nContact\n\n\nWebsite: https://evaluland.fireside.fm/\nTwitter: https://twitter.com/evaluland (@EvaluLand)\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eI\u0026#39;ve received multiple questions about my podcasting setup and process. Rather than answer the questions individually, I thought I would podcast about it! I discuss why I got into podcasting, my recording technology and room setup, the audio processing my husband (aka audio engineer) does, podcast hosting, the general timeline for me to create an episode, and some extra few questions. \u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eTechnology\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eOld microphone: \u003ca href=\"https://www.amazon.com/gp/product/B01D4HTIOY\" rel=\"nofollow\"\u003eFIFINE Plug \u0026amp; Play Home Studio USB Condenser Microphone\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eMic stand: \u003ca href=\"https://www.amazon.com/gp/product/B00BPELU68\" rel=\"nofollow\"\u003eGator Frameworks Short Weighted Base Microphone Stand\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eNew microphone: \u003ca href=\"https://www.amazon.com/gp/product/B0006H92QK/\" rel=\"nofollow\"\u003eAudio-Technica AT 2020 Cardioid Condenser Studio XLR Microphone\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eUSB audio interface: \u003ca href=\"https://www.amazon.com/gp/product/B07QR6Z1JB/\" rel=\"nofollow\"\u003eFocusrite Scarlett Solo (3rd Gen) USB Audio Interface\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eWindows audio software: \u003ca href=\"https://www.audacityteam.org/\" rel=\"nofollow\"\u003eAudacity\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eBrowser podcasting software: \u003ca href=\"https://zencastr.com/\" rel=\"nofollow\"\u003eZencaster\u003c/a\u003e (personally, I don\u0026#39;t recommend it)\u003c/li\u003e\n\u003cli\u003ePodcast hosting: \u003ca href=\"https://fireside.fm/\" rel=\"nofollow\"\u003eFireside\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eAlso check out this blog post by Echo Rivera: \u003ca href=\"https://www.echorivera.com/blog/good-mic\" rel=\"nofollow\"\u003eThe Ultimate Guide to Microphones\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eContact\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eWebsite: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003ehttps://evaluland.fireside.fm/\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eTwitter: \u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003ehttps://twitter.com/evaluland\u003c/a\u003e (@EvaluLand)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"I've received multiple questions about my podcasting setup and process. Rather than answer the questions individually, I thought I would podcast about it!","date_published":"2021-01-05T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/caa2a3a4-d01a-4750-b2d6-91fef3d1329a.mp3","mime_type":"audio/mpeg","size_in_bytes":28099176,"duration_in_seconds":1460}]},{"id":"bc69b7c6-da9c-403e-a299-08054f3e9e60","title":"14: Coalition Evaluation","url":"https://evaluland.fireside.fm/14","content_text":"This episode I chat with Ann Webb Price and Susan Wolfe about coalition evaluation, partnering together in evaluation, the independent consulting TIG of AEA, and so much more! \n\nTopics \u0026amp; Resources Mentioned:\n\n\nHow Ann and Susan started working together\nWhat is coalition evaluation?\nHow coalition evaluation uses a systems approach\nAdvice for doing coalition evaluation, including not just \"but why?\" but \"but why here?\"\nCommunity Coalition Action Theory, which one book they recommend is Ignite!\nTearless logic model approach\nHow they are adapting their approaches to Covid-19\nWorkshops on coalitions and evaluation\nA new partnership: Positive Impact Consultants\nThe independent consulting TIG of the American Evaluation Association\n\n\nContact:\n\n\nAnn Price: Community Evaluation Solutions, Positive Impact Consultants, and Twitter (@AnnWPrice) \nSusan Wolfe: Susan Wolfe and Associates or email susan@susanwolfeandassociates.com/ \nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout the guests:\n\nAnn Webb Price: Ann Price is a community psychologist and evaluator based in Georgia. She helps community coalitions, and nonprofit and foundation leaders identify the root causes of social problems and harness their evidence in order to create real community change. Ann is active in AEA, mentors new and emerging evaluators through her office hours and the Independent Consulting IC Chats, and speaks and trains on evaluation and community coalitions. Ann blogs regularly about community coalitions, evaluation use, and evaluation for non-evaluators and in 2021 will launch her new podcast called Community Possibilities.\n\nSusan Wolfe: Susan Wolfe enjoys evaluation work when it is complex and challenging while focusing on equity and social justice. She has been a Community Consultant with Susan Wolfe and Associates since 2009 where much of her work focuses on community coalitions. In 2020 she teamed up with Ann Webb Price and Kyrah K. Brown to co-edit an issue of New Directions for Evaluation – Evaluating Community Coalitions and Collaboratives.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis episode I chat with Ann Webb Price and Susan Wolfe about coalition evaluation, partnering together in evaluation, the independent consulting TIG of AEA, and so much more! \u003c/p\u003e\n\n\u003ch3\u003eTopics \u0026amp; Resources Mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eHow Ann and Susan started working together\u003c/li\u003e\n\u003cli\u003eWhat is coalition evaluation?\u003c/li\u003e\n\u003cli\u003eHow coalition evaluation uses a systems approach\u003c/li\u003e\n\u003cli\u003eAdvice for doing coalition evaluation, including not just \u0026quot;but why?\u0026quot; but \u0026quot;but why here?\u0026quot;\u003c/li\u003e\n\u003cli\u003eCommunity Coalition Action Theory, which one book they recommend is \u003ca href=\"https://www.amazon.com/Ignite-Getting-Community-Coalition-Change/dp/1491810122/\" rel=\"nofollow\"\u003eIgnite!\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.gjcpp.org/en/tool.php?issue=7\u0026tool=9\" rel=\"nofollow\"\u003eTearless logic model\u003c/a\u003e approach\u003c/li\u003e\n\u003cli\u003eHow they are adapting their approaches to Covid-19\u003c/li\u003e\n\u003cli\u003eWorkshops on coalitions and evaluation\u003c/li\u003e\n\u003cli\u003eA new partnership: \u003ca href=\"https://positiveimpactconsultants.com/\" rel=\"nofollow\"\u003ePositive Impact Consultants\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eThe \u003ca href=\"https://comm.eval.org/independentconsulting/home\" rel=\"nofollow\"\u003eindependent consulting TIG\u003c/a\u003e of the American Evaluation Association\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eAnn Price\u003c/strong\u003e: \u003ca href=\"https://www.communityevaluationsolutions.com/\" rel=\"nofollow\"\u003eCommunity Evaluation Solutions\u003c/a\u003e, \u003ca href=\"https://positiveimpactconsultants.com/\" rel=\"nofollow\"\u003ePositive Impact Consultants\u003c/a\u003e, and Twitter (\u003ca href=\"https://twitter.com/annwprice?lang=en\" rel=\"nofollow\"\u003e@AnnWPrice\u003c/a\u003e) \u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eSusan Wolfe\u003c/strong\u003e: \u003ca href=\"https://susanwolfeandassociates.com/\" rel=\"nofollow\"\u003eSusan Wolfe and Associates\u003c/a\u003e or email \u003ca href=\"mailto:susan@susanwolfeandassociates.com\" rel=\"nofollow\"\u003esusan@susanwolfeandassociates.com\u003c/a\u003e/ \u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout the guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eAnn Webb Price\u003c/strong\u003e: Ann Price is a community psychologist and evaluator based in Georgia. She helps community coalitions, and nonprofit and foundation leaders identify the root causes of social problems and harness their evidence in order to create real community change. Ann is active in AEA, mentors new and emerging evaluators through her office hours and the Independent Consulting IC Chats, and speaks and trains on evaluation and community coalitions. Ann blogs regularly about community coalitions, evaluation use, and evaluation for non-evaluators and in 2021 will launch her new podcast called Community Possibilities.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eSusan Wolfe\u003c/strong\u003e: Susan Wolfe enjoys evaluation work when it is complex and challenging while focusing on equity and social justice. She has been a Community Consultant with Susan Wolfe and Associates since 2009 where much of her work focuses on community coalitions. In 2020 she teamed up with Ann Webb Price and Kyrah K. Brown to co-edit an issue of \u003ca href=\"https://onlinelibrary.wiley.com/toc/1534875x/2020/2020/165\" rel=\"nofollow\"\u003eNew Directions for Evaluation – Evaluating Community Coalitions and Collaboratives\u003c/a\u003e.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This episode I chat with Ann Webb Price and Susan Wolfe about coalition evaluation, partnering together in evaluation, the independent consulting TIG of AEA, and so much more!","date_published":"2020-12-08T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/bc69b7c6-da9c-403e-a299-08054f3e9e60.mp3","mime_type":"audio/mpeg","size_in_bytes":79023265,"duration_in_seconds":3503}]},{"id":"c7e7e324-9a86-4dea-b9bb-27291b125251","title":"13: Out-of-School-Time Evaluation","url":"https://evaluland.fireside.fm/13","content_text":"In this episode, I chat with Aasha Joshi and Hannah Lantos about their recent chapter \"Demystifying data: Strategies and tools for making data more meaningful in OST programs\" in the recently released book Measure, Use, Improve! Data Use in Out-of-School Time, edited by Christina Russell and Corey Newhouse. The book will be particularly useful to leadership-level staff in out-of-school time organizations that are thinking about deepening their own learning and evaluation systems, yet aren’t sure where to start.\n\nWe talked about:\n\n\nWhat it means to demystify data in OST programs\nHow OST program evaluation is unique\nHow they and their OST programs are responding to the Covid-19 pandemic\n\n\nContact:\n\n\nAasha Joshi: http://www.claritywritingandresearch.com/\nHannah Lantos: hlantos@childtrends.org\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout the guests:\n\nAasha Joshi: Aasha’s work is guided by three questions: What’s being done? Is it working? And how can we make it work better? For 15 years, she has been advising, designing, conducting, managing, and integrating robust research and evaluation in organizations so that they can improve their processes, services, and products to meet their goals and make a positive difference in people’s lives. Aasha earned her PhD in Social Psychology from the University of Cambridge (UK), studying social interactions and knowledge sharing, and is a co-founder of Clarity Writing and Research, a company formed with a commitment to helping people achieve better outcomes in the education and social sectors.\n\nHannah Lantos: Hannah Lantos, Ph.D., is a Research Scientist in the Youth Development research area at Child Trends. She has served as project director on both large and small projects that have focused on social and emotional learning, teen pregnancy prevention, protective factors for youth involved in the justice system, and integrating a positive youth development approach into job skills training programs for young adults. She completed her Ph.D. in Public Health with a focus on social and behavioral trends in adolescent health from Johns Hopkins University in 2015. Her work broadly aims to explore how the social and physical environments that adolescents live in affect their health and well-being. Adolescence is a time of amazing growth, skill-building, and navigating challenges. Learning how to navigate challenges in ways that promote learning, kindness, and health drive her work. In particular, she is interested in how contexts can strengthen adolescents’ resiliency as they learn about and engage in healthy decision-making. She has worked with both large, national datasets and small, evaluations and with both quantitative and qualitative data in both domestic and international settings. Before her graduate studies at Johns Hopkins, where she wrote a dissertation comparing adolescent’s experiences with violence in Baltimore and Johannesburg, she worked primarily in international settings. She served as a Peace Corps Volunteer in northern Zambia before receiving a Masters of Public Administration in International Development (MPA-ID) and speaks Arabic, Hebrew, Spanish and can still say hello in Bemba (one of the languages spoken in northern Zambia!). She is passionate about applied, multidisciplinary research on adolescent health, well-being, positive development, and in considering the “whole child” as we do research and evaluation on programs that serve young people.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eIn this episode, I chat with Aasha Joshi and Hannah Lantos about their recent chapter \u0026quot;Demystifying data: Strategies and tools for making data more meaningful in OST programs\u0026quot; in the recently released book \u003ca href=\"https://www.infoagepub.com/products/Measure-Use-Improve\" rel=\"nofollow\"\u003eMeasure, Use, Improve! Data Use in Out-of-School Time\u003c/a\u003e, edited by Christina Russell and Corey Newhouse. The book will be particularly useful to leadership-level staff in out-of-school time organizations that are thinking about deepening their own learning and evaluation systems, yet aren’t sure where to start.\u003c/p\u003e\n\n\u003ch3\u003eWe talked about:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eWhat it means to demystify data in OST programs\u003c/li\u003e\n\u003cli\u003eHow OST program evaluation is unique\u003c/li\u003e\n\u003cli\u003eHow they and their OST programs are responding to the Covid-19 pandemic\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eAasha Joshi\u003c/strong\u003e: \u003ca href=\"http://www.claritywritingandresearch.com/\" rel=\"nofollow\"\u003ehttp://www.claritywritingandresearch.com/\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eHannah Lantos\u003c/strong\u003e: \u003ca href=\"mailto:hlantos@childtrends.org\" rel=\"nofollow\"\u003ehlantos@childtrends.org\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout the guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eAasha Joshi\u003c/strong\u003e: Aasha’s work is guided by three questions: What’s being done? Is it working? And how can we make it work better? For 15 years, she has been advising, designing, conducting, managing, and integrating robust research and evaluation in organizations so that they can improve their processes, services, and products to meet their goals and make a positive difference in people’s lives. Aasha earned her PhD in Social Psychology from the University of Cambridge (UK), studying social interactions and knowledge sharing, and is a co-founder of Clarity Writing and Research, a company formed with a commitment to helping people achieve better outcomes in the education and social sectors.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eHannah Lantos\u003c/strong\u003e: Hannah Lantos, Ph.D., is a Research Scientist in the Youth Development research area at Child Trends. She has served as project director on both large and small projects that have focused on social and emotional learning, teen pregnancy prevention, protective factors for youth involved in the justice system, and integrating a positive youth development approach into job skills training programs for young adults. She completed her Ph.D. in Public Health with a focus on social and behavioral trends in adolescent health from Johns Hopkins University in 2015. Her work broadly aims to explore how the social and physical environments that adolescents live in affect their health and well-being. Adolescence is a time of amazing growth, skill-building, and navigating challenges. Learning how to navigate challenges in ways that promote learning, kindness, and health drive her work. In particular, she is interested in how contexts can strengthen adolescents’ resiliency as they learn about and engage in healthy decision-making. She has worked with both large, national datasets and small, evaluations and with both quantitative and qualitative data in both domestic and international settings. Before her graduate studies at Johns Hopkins, where she wrote a dissertation comparing adolescent’s experiences with violence in Baltimore and Johannesburg, she worked primarily in international settings. She served as a Peace Corps Volunteer in northern Zambia before receiving a Masters of Public Administration in International Development (MPA-ID) and speaks Arabic, Hebrew, Spanish and can still say hello in Bemba (one of the languages spoken in northern Zambia!). She is passionate about applied, multidisciplinary research on adolescent health, well-being, positive development, and in considering the “whole child” as we do research and evaluation on programs that serve young people.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this episode, I chat with Aasha Joshi and Hannah Lantos about their recent chapter \"Demystifying data: Strategies and tools for making data more meaningful in OST programs\" in the recently released book Measure, Use, Improve! Data use in out-of-school time, edited by Christina Russell and Corey Newhouse. ","date_published":"2020-11-24T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/c7e7e324-9a86-4dea-b9bb-27291b125251.mp3","mime_type":"audio/mpeg","size_in_bytes":85391616,"duration_in_seconds":3881}]},{"id":"0f5a4a47-d15b-411a-a273-39f50fe8b89c","title":"12: Eval20 Virtual Experience - Post-Conference Reflections","url":"https://evaluland.fireside.fm/12","content_text":"Thank you to everyone who participated in the call-in to share their own reflections about the 2020 AEA virtual experience! \n\nIn this episode, I start with thanking the conference organizers, sharing my own reflections, and then pass it off to the eight people who called in to share their own reflections:\n\n\nRachael Lawrence (@R8chLawrence)\nRakesh Mohan (@RakeshMohanEval)\nAnn Price (@annwprice)\nElizabeth Grim (@ecgrim)\nJeremy Danz (@DanzJeremy)\nVeronica Olazabal (@veroviews)\nTiffany Smith (@Tiffany7001\nLibby Smith (@work_with_libby)\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThank you to everyone who participated in the \u003ca href=\"https://evaluland.fireside.fm/voicemail\" rel=\"nofollow\"\u003ecall-in\u003c/a\u003e to share their own reflections about the \u003ca href=\"https://www.evaluationconference.org/\" rel=\"nofollow\"\u003e2020 AEA virtual experience\u003c/a\u003e! \u003c/p\u003e\n\n\u003cp\u003eIn this episode, I start with thanking the conference organizers, sharing my own reflections, and then pass it off to the eight people who called in to share their own reflections:\u003c/p\u003e\n\n\u003col\u003e\n\u003cli\u003eRachael Lawrence (\u003ca href=\"https://twitter.com/R8chLawrence\" rel=\"nofollow\"\u003e@R8chLawrence\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eRakesh Mohan (\u003ca href=\"https://twitter.com/RakeshMohanEval\" rel=\"nofollow\"\u003e@RakeshMohanEval\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eAnn Price (\u003ca href=\"https://twitter.com/annwprice\" rel=\"nofollow\"\u003e@annwprice\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eElizabeth Grim (\u003ca href=\"https://twitter.com/ecgrim\" rel=\"nofollow\"\u003e@ecgrim\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eJeremy Danz (\u003ca href=\"https://twitter.com/DanzJeremy\" rel=\"nofollow\"\u003e@DanzJeremy\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eVeronica Olazabal (\u003ca href=\"https://twitter.com/veroviews\" rel=\"nofollow\"\u003e@veroviews\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eTiffany Smith (\u003ca href=\"https://twitter.com/Tiffany7001\" rel=\"nofollow\"\u003e@Tiffany7001\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eLibby Smith (\u003ca href=\"https://twitter.com/work_with_libby\" rel=\"nofollow\"\u003e@work_with_libby\u003c/a\u003e)\u003c/li\u003e\n\u003c/ol\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this episode, eight evaluators and I share thoughts and reflections after AEA 2020 virtual experience. ","date_published":"2020-11-10T06:00:00.000-06:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/0f5a4a47-d15b-411a-a273-39f50fe8b89c.mp3","mime_type":"audio/mpeg","size_in_bytes":55349664,"duration_in_seconds":2075}]},{"id":"fd9241eb-1387-45e5-a65f-710496916fcf","title":"11: Eval20 Virtual Experience - Pre-Conference Reflections","url":"https://evaluland.fireside.fm/11","content_text":"Thank you to everyone who participated in the call-in to share their own reflections about the 2020 AEA virtual experience! After the conference, please sure your own thoughts and reflections by calling in. It's very similar to leaving a voicemail! \n\nIn this episode, I start with my own reflection about the conference, how I'm going to make the most of the conference, and what I am personally excited about. Then, we get to hear from nine other evaluators (in no particular order):\n\n\nTom Archibald, associate professor at Virgina Tech (@tgarchibald)\nBianca Montrosse-Moorhead, associate professor at University of Connecticut (@b_mmoorhead)\nDanielle Murillo, at the Claremont After School Program (@happyeval)\nKathleen Doll, independent evaluation consultant (part-time at the Chan-Zuckerberg Initiative and part-time at Intention 2 Impact)\nChristian Lucchesi, project manager with Catalyst at University of Wisconsin-Stout (@luccheesey)\nNina Sabarre, founder and principal of Intention 2 Impact (@ninasabarre)\nAkihiko Ashimoto, National Institute for Educational Policy Research in Japan\nElizabeth Grim, director of community impact from the Connecticut Data Collaborative (@ecgrim)\nLibby Smith, evaluator and educator (@work_with_libby)\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThank you to everyone who participated in the \u003ca href=\"https://evaluland.fireside.fm/call-in\" rel=\"nofollow\"\u003ecall-in\u003c/a\u003e to share their own reflections about the \u003ca href=\"https://www.evaluationconference.org/\" rel=\"nofollow\"\u003e2020 AEA virtual experience\u003c/a\u003e! After the conference, please sure your own thoughts and reflections by \u003ca href=\"https://evaluland.fireside.fm/call-in\" rel=\"nofollow\"\u003ecalling in\u003c/a\u003e. It\u0026#39;s very similar to leaving a voicemail! \u003c/p\u003e\n\n\u003cp\u003eIn this episode, I start with my own reflection about the conference, how I\u0026#39;m going to make the most of the conference, and what I am personally excited about. Then, we get to hear from nine other evaluators (in no particular order):\u003c/p\u003e\n\n\u003col\u003e\n\u003cli\u003eTom Archibald, associate professor at Virgina Tech (\u003ca href=\"https://twitter.com/tgarchibald\" rel=\"nofollow\"\u003e@tgarchibald\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eBianca Montrosse-Moorhead, associate professor at University of Connecticut (\u003ca href=\"https://twitter.com/b_mmoorhead\" rel=\"nofollow\"\u003e@b_mmoorhead\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eDanielle Murillo, at the Claremont After School Program (\u003ca href=\"https://twitter.com/happyeval\" rel=\"nofollow\"\u003e@happyeval\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eKathleen Doll, independent evaluation consultant (part-time at the Chan-Zuckerberg Initiative and part-time at \u003ca href=\"https://www.intention2impact.com/\" rel=\"nofollow\"\u003eIntention 2 Impact\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eChristian Lucchesi, project manager with Catalyst at University of Wisconsin-Stout (\u003ca href=\"https://twitter.com/luccheesey\" rel=\"nofollow\"\u003e@luccheesey\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eNina Sabarre, founder and principal of \u003ca href=\"https://www.intention2impact.com/\" rel=\"nofollow\"\u003eIntention 2 Impact\u003c/a\u003e (\u003ca href=\"https://twitter.com/ninasabarre\" rel=\"nofollow\"\u003e@ninasabarre\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eAkihiko Ashimoto, National Institute for Educational Policy Research in Japan\u003c/li\u003e\n\u003cli\u003eElizabeth Grim, director of community impact from the Connecticut Data Collaborative (\u003ca href=\"https://twitter.com/ecgrim\" rel=\"nofollow\"\u003e@ecgrim\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eLibby Smith, evaluator and educator (\u003ca href=\"https://twitter.com/work_with_libby\" rel=\"nofollow\"\u003e@work_with_libby\u003c/a\u003e)\u003c/li\u003e\n\u003c/ol\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"In this episode, nine evaluators and I share thoughts and reflections about the upcoming AEA 2020 virtual experience. ","date_published":"2020-10-27T00:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/fd9241eb-1387-45e5-a65f-710496916fcf.mp3","mime_type":"audio/mpeg","size_in_bytes":61217184,"duration_in_seconds":2420}]},{"id":"8037b04a-8fb8-4b14-bf62-c89ab690a3d4","title":"10: Nonprofit Evaluation and Music with Chari Smith","url":"https://evaluland.fireside.fm/10","content_text":"This week, Chari Smith joins me to talk about nonprofit evaluation, how to build a culture of evaluation, the relationship between music and evaluation, and the AEA conference. \n\nChari Smith wrote a book! Nonprofit Program Evaluation Made Simple: Get your Data. Show your Impact. Improve your Programs. Sign up for the mailing list to learn more about the book, including the launch date.\n\nResources \u0026amp; People Mentioned:\n\n\nIn 4 All blog post on adapting to Covid-19\nManaging applied social research by Russ-eft and colleagues (2017)\nEnhancing the effectiveness of logic models by Jones et al. (2020)\nNorthwest Housing Alternatives concept paper: Program Evaluation and Data Culture in Resident Services\nGraphic mentioned - NW Housing Alternatives: Housing Stability Status: This graphic was created as a result of the evaluation planning session with Resident Service Coordinator staff. We wanted to visually depict where their program activities fell on a spectrum of residents that are at a high risk of losing housing to a low risk of losing housing. This graphic was included in their program evaluation plan.\nData into Dollars: The Intersection of Program Evaluation \u0026amp; Fundraising blog post\nChari's presidential strand session with AEA president Aimee White on Tuesday, October 27\nNew Directions for Evaluation: Organizational Capacity to Do and Use Evaluation\nTwo people mentioned: Michael Quinn Patton and Stephanie Evergreen\n\n\nContact:\n\n\nChari Smith: chari@evaluationintoaction.com\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Chari:\n\nChari Smith believes evaluation should be accessible, practical and usable. She founded Evaluation into Action, located in Portland, Oregon, to help nonprofit professionals create realistic and meaningful program evaluation processes. She has taught several workshops helping nonprofit professionals understand the value and use of program evaluation. Her book comes out fall 2020: Nonprofit Program Evaluation Made Simple: Get Your Data. Show Your Impact. Improve Your Programs.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week, Chari Smith joins me to talk about nonprofit evaluation, how to build a culture of evaluation, the relationship between music and evaluation, and the AEA conference. \u003c/p\u003e\n\n\u003cp\u003eChari Smith wrote a book! \u003ca href=\"https://evaluationintoaction.com/book/\" rel=\"nofollow\"\u003eNonprofit Program Evaluation Made Simple: Get your Data. Show your Impact. Improve your Programs\u003c/a\u003e. Sign up for the mailing list to learn more about the book, including the launch date.\u003c/p\u003e\n\n\u003ch3\u003eResources \u0026amp; People Mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://evaluationintoaction.com/2020/09/30/covid-19-cant-stop-progress-spotlight-on-education-and-evaluation/\" rel=\"nofollow\"\u003eIn 4 All\u003c/a\u003e blog post on adapting to Covid-19\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.wiley.com/en-us/Managing+Applied+Social+Research%3A+Tools%2C+Strategies%2C+and+Insights-p-9781118105474\" rel=\"nofollow\"\u003eManaging applied social research\u003c/a\u003e by Russ-eft and colleagues (2017)\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://journals.sagepub.com/doi/full/10.1177/1098214018824417\" rel=\"nofollow\"\u003eEnhancing the effectiveness of logic models\u003c/a\u003e by Jones et al. (2020)\u003c/li\u003e\n\u003cli\u003eNorthwest Housing Alternatives concept paper: \u003ca href=\"https://evaluationintoaction.com/resources/\" rel=\"nofollow\"\u003eProgram Evaluation and Data Culture in Resident Services\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eGraphic mentioned - \u003ca href=\"https://www.dropbox.com/s/pz6lw09dncsce8v/NWHousingAlt%20-%20Housing%20Stability%20Status.jpg?dl=0\" rel=\"nofollow\"\u003eNW Housing Alternatives: Housing Stability Status\u003c/a\u003e: This graphic was created as a result of the evaluation planning session with Resident Service Coordinator staff. We wanted to visually depict where their program activities fell on a spectrum of residents that are at a high risk of losing housing to a low risk of losing housing. This graphic was included in their program evaluation plan.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://evaluationintoaction.com/2020/01/13/data-into-dollars/\" rel=\"nofollow\"\u003eData into Dollars: The Intersection of Program Evaluation \u0026amp; Fundraising\u003c/a\u003e blog post\u003c/li\u003e\n\u003cli\u003eChari\u0026#39;s \u003ca href=\"https://www.evaluationconference.org/p/cm/ld/fid=794\" rel=\"nofollow\"\u003epresidential strand session\u003c/a\u003e with AEA president Aimee White on Tuesday, October 27\u003c/li\u003e\n\u003cli\u003eNew Directions for Evaluation: \u003ca href=\"https://onlinelibrary.wiley.com/toc/1534875x/2014/2014/141\" rel=\"nofollow\"\u003eOrganizational Capacity to Do and Use Evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eTwo people mentioned: \u003ca href=\"https://www.utilization-focusedevaluation.org/our-team\" rel=\"nofollow\"\u003eMichael Quinn Patton\u003c/a\u003e and \u003ca href=\"https://stephanieevergreen.com/\" rel=\"nofollow\"\u003eStephanie Evergreen\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eChari Smith\u003c/strong\u003e: \u003ca href=\"mailto:chari@evaluationintoaction.com\" rel=\"nofollow\"\u003echari@evaluationintoaction.com\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Chari:\u003c/h3\u003e\n\n\u003cp\u003eChari Smith believes evaluation should be accessible, practical and usable. She founded Evaluation into Action, located in Portland, Oregon, to help nonprofit professionals create realistic and meaningful program evaluation processes. She has taught several workshops helping nonprofit professionals understand the value and use of program evaluation. Her book comes out fall 2020: \u003ca href=\"https://evaluationintoaction.com/book\" rel=\"nofollow\"\u003eNonprofit Program Evaluation Made Simple: Get Your Data. Show Your Impact. Improve Your Programs.\u003c/a\u003e\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week, Chari Smith joins me to talk about nonprofit evaluation, how to build a culture of evaluation, the relationship between music and evaluation, and the AEA conference. ","date_published":"2020-10-13T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/8037b04a-8fb8-4b14-bf62-c89ab690a3d4.mp3","mime_type":"audio/mpeg","size_in_bytes":89275349,"duration_in_seconds":3954}]},{"id":"128fb7f0-9e49-4284-8e78-2602d46b49db","title":"9: R with David Keyes","url":"https://evaluland.fireside.fm/9","content_text":"This week I am joined by David Keyes. We talked about R, why evaluators should learn R, tips for teaching courses, and more!\n\nInterested in getting started with R? Check out David's free course! \n\nInterested in learning how to do inferential statistics in R? Check our our new course! \n\nResources:\n\nBlog posts\n\n\nDana's R journey\nWhat is a tidyverse-centric approach?\nHow to make beautiful tables in R\nHow to make functions in R\nHow to evaluate R packages\nUsing Word reference documents with R Markdown to create custom reports\nIf you care about equity, use R\n\n\nOther resources\n\n\nDaniel Lakens' course Improving your statistical inference\nMy manuscript written entirely in R\nTodoist\nSavical and Calendly\nFigma\nQuickBooks\nWordPress and SquareSpace\nEvaluation Jobs\nTeachable\nStreamlabs\n\n\nSome packages: tidyverse, beepr, praise, janitor, gt, gtsummary, lavaan, ggplot, rstatix, papaja\n\nContact:\n\n\nDavid Keyes: Twitter @dgkeyes and @RfortheRest and email david@rfortherestofus.com\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout David:\n\nDavid Keyes is the founder of R for the Rest of Us. Through online courses and custom trainings, he helps people and organizations learn R, the most powerful tool for data analysis and visualization (which also happens to be free).\n\nIn addition to training folks to use R, David does consulting work with research and evaluation organizations, foundations, and others. David's creates high-quality data visualization, helps organizations to use R to improve their workflow, and much more.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I am joined by David Keyes. We talked about R, why evaluators should learn R, tips for teaching courses, and more!\u003c/p\u003e\n\n\u003cp\u003eInterested in getting started with R? Check out David\u0026#39;s \u003ca href=\"https://rfortherestofus.com/courses/getting-started/\" rel=\"nofollow\"\u003efree course\u003c/a\u003e! \u003c/p\u003e\n\n\u003cp\u003eInterested in learning how to do inferential statistics in R? Check our our \u003ca href=\"https://rfortherestofus.com/courses/inferential-statistics/\" rel=\"nofollow\"\u003enew course\u003c/a\u003e! \u003c/p\u003e\n\n\u003ch3\u003eResources:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eBlog posts\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://rfortherestofus.com/2019/03/my-r-journey-dana-wanzer/\" rel=\"nofollow\"\u003eDana\u0026#39;s R journey\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rfortherestofus.com/2019/06/what-is-a-tidyverse-centric-approach/\" rel=\"nofollow\"\u003eWhat is a tidyverse-centric approach?\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rfortherestofus.com/2019/11/how-to-make-beautiful-tables-in-r/\" rel=\"nofollow\"\u003eHow to make beautiful tables in R\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rfortherestofus.com/2019/10/how-to-make-functions-in-r/\" rel=\"nofollow\"\u003eHow to make functions in R\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rfortherestofus.com/2020/07/how-to-evaluate-r-packages/\" rel=\"nofollow\"\u003eHow to evaluate R packages\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rfortherestofus.com/2020/07/word-reference-documents-rmarkdown/\" rel=\"nofollow\"\u003eUsing Word reference documents with R Markdown to create custom reports\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://rfortherestofus.com/2019/07/equity/\" rel=\"nofollow\"\u003eIf you care about equity, use R\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eOther resources\u003c/strong\u003e\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eDaniel Lakens\u0026#39; course \u003ca href=\"https://www.coursera.org/learn/statistical-inferences\" rel=\"nofollow\"\u003eImproving your statistical inference\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eMy manuscript \u003ca href=\"https://osf.io/a3zfj/\" rel=\"nofollow\"\u003ewritten entirely in R\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://todoist.com/\" rel=\"nofollow\"\u003eTodoist\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://savvycal.com/\" rel=\"nofollow\"\u003eSavical\u003c/a\u003e and \u003ca href=\"https://calendly.com/\" rel=\"nofollow\"\u003eCalendly\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.figma.com/\" rel=\"nofollow\"\u003eFigma\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://quickbooks.intuit.com/\" rel=\"nofollow\"\u003eQuickBooks\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://wordpress.com/\" rel=\"nofollow\"\u003eWordPress\u003c/a\u003e and \u003ca href=\"https://www.squarespace.com/\" rel=\"nofollow\"\u003eSquareSpace\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://evaluationjobs.org/\" rel=\"nofollow\"\u003eEvaluation Jobs\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://teachable.com/\" rel=\"nofollow\"\u003eTeachable\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://streamlabs.com/\" rel=\"nofollow\"\u003eStreamlabs\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003e\u003cstrong\u003eSome packages\u003c/strong\u003e: \u003ca href=\"https://www.tidyverse.org/\" rel=\"nofollow\"\u003etidyverse\u003c/a\u003e, \u003ca href=\"https://cran.r-project.org/web/packages/beepr/index.html\" rel=\"nofollow\"\u003ebeepr\u003c/a\u003e, \u003ca href=\"https://cran.r-project.org/web/packages/praise/index.html\" rel=\"nofollow\"\u003epraise\u003c/a\u003e, \u003ca href=\"https://garthtarr.github.io/meatR/janitor.html\" rel=\"nofollow\"\u003ejanitor\u003c/a\u003e, \u003ca href=\"https://gt.rstudio.com/\" rel=\"nofollow\"\u003egt\u003c/a\u003e, \u003ca href=\"https://github.com/ddsjoberg/gtsummary\" rel=\"nofollow\"\u003egtsummary\u003c/a\u003e, \u003ca href=\"https://lavaan.ugent.be/\" rel=\"nofollow\"\u003elavaan\u003c/a\u003e, \u003ca href=\"https://ggplot2.tidyverse.org/reference/ggplot.html\" rel=\"nofollow\"\u003eggplot\u003c/a\u003e, \u003ca href=\"https://rpkgs.datanovia.com/rstatix/\" rel=\"nofollow\"\u003erstatix\u003c/a\u003e, \u003ca href=\"https://crsh.github.io/papaja_man/\" rel=\"nofollow\"\u003epapaja\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eDavid Keyes\u003c/strong\u003e: Twitter \u003ca href=\"https://twitter.com/dgkeyes\" rel=\"nofollow\"\u003e@dgkeyes\u003c/a\u003e and \u003ca href=\"https://twitter.com/rfortherest\" rel=\"nofollow\"\u003e@RfortheRest\u003c/a\u003e and email \u003ca href=\"mailto:david@rfortherestofus.com\" rel=\"nofollow\"\u003edavid@rfortherestofus.com\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout David:\u003c/h3\u003e\n\n\u003cp\u003eDavid Keyes is the founder of R for the Rest of Us. Through online courses and custom trainings, he helps people and organizations learn R, the most powerful tool for data analysis and visualization (which also happens to be free).\u003c/p\u003e\n\n\u003cp\u003eIn addition to training folks to use R, David does consulting work with research and evaluation organizations, foundations, and others. David\u0026#39;s creates high-quality data visualization, helps organizations to use R to improve their workflow, and much more.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I chat with David Keyes about R and our new course on inferential statistics with R. ","date_published":"2020-09-29T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/128fb7f0-9e49-4284-8e78-2602d46b49db.mp3","mime_type":"audio/mpeg","size_in_bytes":76385832,"duration_in_seconds":3919}]},{"id":"26841182-0e43-44f0-b1a0-5194e5347d88","title":"8: Solopreneurship with Ann K. Emery","url":"https://evaluland.fireside.fm/8","content_text":"ThisThis week I am joined by Ann K. Emery about her journeys in evaluation and entrepreneurship. Ann K. Emery is an internationally-acclaimed speaker who equips organizations to get their data out of dusty spreadsheets and into real-world conversations. She now runs Depict Data Studio.\n\nIf you’d rather watch this talk, you can do so on YouTube here.\n\nTopics \u0026amp; Resources Mentioned:\n\n\n#EvalTwitter hashtag on Twitter (also follow #eval and #dataviz)\nCompany of One by Paul Jarvis\nNina Sabarre presentation on getting into independent consulting\nIndependent consulting vs. entrepreneurship\nTeaching (and blogging and YouTube-ing) as a way to give back to the community\nMultiple references to Chris Lysy\nYour Money or Your Life by Vicki Robin\nAll the books by Octavia Butler, and the podcast on her parables by Adrienne maree brown \u0026amp; Toshi Reagon with Kat Aaron\nRethinking consulting from a mindset of abundance, not scarcity\nFarnoosh Torabi on Instagram\n99 Tips for Creating Simple and Sustainable Educational Videos by Karen Costa\nSoar Beyond the Dusty Shelf Report course\n\n\nContact:\n\n\nAnn K. Emery: Instagram and Website\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Ann:\n\nAnn K. Emery is an internationally-acclaimed speaker who equips organizations to get their data out of dusty spreadsheets and into real-world conversations.\n\nEach year, she delivers over 50 keynotes, workshops, and webinars with the aim of equipping organizations to visualize data more effectively.\n\nShe has been invited to speak in more than 30 states and 10 countries; more than 3,200 people have enrolled in her online training academy; and she has consulted to more than 150 organizations, including the United Nations, Centers for Disease Control, and Harvard University.\n\nShe earned a Bachelor’s degree from the University of Virginia and a Master’s degree from George Mason University.\n\nAnn resides in Florida along with her husband and two daughters.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThisThis week I am joined by Ann K. Emery about her journeys in evaluation and entrepreneurship. Ann K. Emery is an internationally-acclaimed speaker who equips organizations to get their data out of dusty spreadsheets and into real-world conversations. She now runs \u003ca href=\"https://depictdatastudio.com/\" rel=\"nofollow\"\u003eDepict Data Studio\u003c/a\u003e.\u003c/p\u003e\n\n\u003cp\u003eIf you’d rather watch this talk, you can do so on YouTube \u003ca href=\"https://youtu.be/v1aRlVOnx0g\" rel=\"nofollow\"\u003ehere\u003c/a\u003e.\u003c/p\u003e\n\n\u003ch3\u003eTopics \u0026amp; Resources Mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e#EvalTwitter hashtag on Twitter (also follow #eval and #dataviz)\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://ofone.co/\" rel=\"nofollow\"\u003eCompany of One\u003c/a\u003e by Paul Jarvis\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.gotostage.com/channel/546a35201d924876a61df57d3b0d2259/recording/28b91d4463d843c1a78a4a97c3da8b80/watch?tos=true\u0026ticket=eyJhbGciOiJIUzI1NiJ9.eyJzdWIiOiI4MDMwMjYyNjg5OTMwMjE3OTg5IiwiYXVkIjoiMTAxIiwibHMiOiJkNTEzMzI0ZC0yMjBkLTQzMTEtYWJiOC1iYmE0Y2U5MDUxMTkiLCJvZ24iOiJsaSIsImV4cCI6MTU5MDU4MjcxOSwidHlwZSI6IjEiLCJqdGkiOiJlYWIzZTE1Yi03ZWNmLTQ5YTYtOGM5MC0wY2E5YWRjM2VhYTYiLCJ0ZW5hbnQiOiIkZGVmYXVsdCIsImxvYSI6MiwidGd0ZXhwIjoxNTkwNTkzMzM5fQ.ryQP2302VMRhftv8W_hjH20TsNwjcfMzWihCkUH2fvE\" rel=\"nofollow\"\u003eNina Sabarre\u003c/a\u003e presentation on getting into independent consulting\u003c/li\u003e\n\u003cli\u003eIndependent consulting vs. entrepreneurship\u003c/li\u003e\n\u003cli\u003eTeaching (and blogging and YouTube-ing) as a way to give back to the community\u003c/li\u003e\n\u003cli\u003eMultiple references to \u003ca href=\"https://freshspectrum.com/\" rel=\"nofollow\"\u003eChris Lysy\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://yourmoneyoryourlife.com/book/\" rel=\"nofollow\"\u003eYour Money or Your Life\u003c/a\u003e by Vicki Robin\u003c/li\u003e\n\u003cli\u003eAll the books by \u003ca href=\"https://www.fantasticfiction.com/b/octavia-e-butler/\" rel=\"nofollow\"\u003eOctavia Butler\u003c/a\u003e, and the \u003ca href=\"https://podcasts.apple.com/us/podcast/octavias-parables/id1519024926\" rel=\"nofollow\"\u003epodcast\u003c/a\u003e on her parables by Adrienne maree brown \u0026amp; Toshi Reagon with Kat Aaron\u003c/li\u003e\n\u003cli\u003eRethinking consulting from a mindset of abundance, not scarcity\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.instagram.com/farnooshtorabi\" rel=\"nofollow\"\u003eFarnoosh Torabi\u003c/a\u003e on Instagram\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://styluspub.presswarehouse.com/browse/book/9781642670851/99-Tips-for-Creating-Simple-and-Sustainable-Educational-Videos\" rel=\"nofollow\"\u003e99 Tips for Creating Simple and Sustainable Educational Videos\u003c/a\u003e by Karen Costa\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://depictdatastudio.teachable.com/p/soar-beyond-the-dusty-shelf-report\" rel=\"nofollow\"\u003eSoar Beyond the Dusty Shelf Report\u003c/a\u003e course\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eAnn K. Emery\u003c/strong\u003e: \u003ca href=\"https://www.instagram.com/annkemery/?hl=en\" rel=\"nofollow\"\u003eInstagram\u003c/a\u003e and \u003ca href=\"https://depictdatastudio.com/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Ann:\u003c/h3\u003e\n\n\u003cp\u003eAnn K. Emery is an internationally-acclaimed speaker who equips organizations to get their data out of dusty spreadsheets and into real-world conversations.\u003c/p\u003e\n\n\u003cp\u003eEach year, she delivers over 50 keynotes, workshops, and webinars with the aim of equipping organizations to visualize data more effectively.\u003c/p\u003e\n\n\u003cp\u003eShe has been invited to speak in more than 30 states and 10 countries; more than 3,200 people have enrolled in her online training academy; and she has consulted to more than 150 organizations, including the United Nations, Centers for Disease Control, and Harvard University.\u003c/p\u003e\n\n\u003cp\u003eShe earned a Bachelor’s degree from the University of Virginia and a Master’s degree from George Mason University.\u003c/p\u003e\n\n\u003cp\u003eAnn resides in Florida along with her husband and two daughters.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I am joined by Ann K. Emery about her journeys in evaluation and entrepreneurship. Ann K. Emery is an internationally-acclaimed speaker who equips organizations to get their data out of dusty spreadsheets and into real-world conversations. She now runs Depict Data Studio.","date_published":"2020-09-15T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/26841182-0e43-44f0-b1a0-5194e5347d88.mp3","mime_type":"audio/mpeg","size_in_bytes":79360460,"duration_in_seconds":3876}]},{"id":"671a9f3e-b921-4979-b1d2-8406fbdbcceb","title":"7: Trust and Numbers with Anjie Rosga","url":"https://evaluland.fireside.fm/7","content_text":"This week, we’re chatting with AnnJanette, or Anjie, Rosga about objectivity, trust and numbers, truth and power, and more. \n\nAnnJanette (Anjie) Rosga, PhD, co-directs the small, Berkeley-based consulting firm Informing Change which works to support strategic learning initiatives in the social sector. Most of Anjie’s projects involve facilitating strategy development, promoting equity and participatory research, and leading evaluation for hard-to-measure initiatives that cross disciplines, sectors, geographies, and/or cultures.\n\nThis episode centers around Anjie's 3-part Medium series on  Trust \u0026amp; Numbers. Read the 3-part series here: Part 1, Part 2, and Part 3\n\nSome resources, quotes, etc. mentioned:\n\n\nPower as electricity metaphor - Understanding \"New Power\" by Jeremy Heimans and Henry Timms\nRethinking objectivity by Allan Megill\nMariana Valverde: Truth as a \"pragmatic ethical choice\" (In Law's Dream of a Common Knowledge, page 10)\nDecolonizing Wealth by Edgar Villanueva\nLevel Up: Growing Your Approach to Participatory Evaluation (AEA365) by Elizabeth DiLuzio\nGrace Jones in I'll Never Write My Memoirs: \"If you are a fan of doing the unexpected, and I am, then it is an advantage to be highly skilled at changing your mind. If you do not want to limit yourself, then be prepared to change your mind—often.\"\nCultivating trust on Twitter - NYT Daily Podcast\n\n\nContact:\n\n\nAnjie Rosga: Contact her through the Informing Change website\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Anjie:\n\nAnnJanette (Anjie) Rosga, co-directs the small, Berkeley-based consulting firm Informing Change which foregrounds strategic learning for equity, participatory research, and complex systems change. Most of Anjie’s projects involve facilitating strategy development and leading evaluation for hard-to-measure initiatives that cross disciplines, sectors, geographies, and/or cultures. In her prior professional lives, she worked as an independent consultant to human rights NGOs and United Nations agencies, as an advocate for international women, peace \u0026amp; security, and as an academic: first at Knox College in Illinois, and later the University of Colorado, Boulder. Her independent research began with an ethnography of anti-hate crime groups and the police in the US and later evolved into a multinational study of human rights training for police in emerging democracies. She holds a PhD in the History of Consciousness, an interdisciplinary program combining humanities and social sciences. She grew up in Minneapolis, MN, and Louisville, KY and makes her home in Oakland, CA.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week, we’re chatting with AnnJanette, or Anjie, Rosga about objectivity, trust and numbers, truth and power, and more. \u003c/p\u003e\n\n\u003cp\u003e\u003ca href=\"https://informingchange.com/about/team/annjanette-rosga/\" rel=\"nofollow\"\u003eAnnJanette (Anjie) Rosga, PhD\u003c/a\u003e, co-directs the small, Berkeley-based consulting firm \u003ca href=\"https://informingchange.com\" rel=\"nofollow\"\u003eInforming Change\u003c/a\u003e which works to support strategic learning initiatives in the social sector. Most of Anjie’s projects involve facilitating strategy development, promoting equity and participatory research, and leading evaluation for hard-to-measure initiatives that cross disciplines, sectors, geographies, and/or cultures.\u003c/p\u003e\n\n\u003cp\u003eThis episode centers around Anjie\u0026#39;s 3-part Medium series on  Trust \u0026amp; Numbers. Read the 3-part series here: \u003ca href=\"https://medium.com/@arosga/trust-in-numbers-bf585010224e\" rel=\"nofollow\"\u003ePart 1\u003c/a\u003e, \u003ca href=\"https://medium.com/@arosga/trust-numbers-part-2-8c4a8509f82f\" rel=\"nofollow\"\u003ePart 2\u003c/a\u003e, and \u003ca href=\"https://medium.com/@arosga/trust-numbers-part-2-8c4a8509f82f\" rel=\"nofollow\"\u003ePart 3\u003c/a\u003e\u003c/p\u003e\n\n\u003ch3\u003eSome resources, quotes, etc. mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003ePower as electricity metaphor - \u003ca href=\"https://hbr.org/2014/12/understanding-new-power\" rel=\"nofollow\"\u003eUnderstanding \u0026quot;New Power\u0026quot;\u003c/a\u003e by Jeremy Heimans and Henry Timms\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.dukeupress.edu/rethinking-objectivity\" rel=\"nofollow\"\u003eRethinking objectivity\u003c/a\u003e by Allan Megill\u003c/li\u003e\n\u003cli\u003eMariana Valverde: Truth as a \u0026quot;pragmatic ethical choice\u0026quot; (In Law\u0026#39;s Dream of a Common Knowledge, page 10)\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.decolonizingwealth.com/thebook\" rel=\"nofollow\"\u003eDecolonizing Wealth\u003c/a\u003e by Edgar Villanueva\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://aea365.org/blog/level-up-growing-your-approach-to-participatory-evaluation-by-elizabeth-diluzio/\" rel=\"nofollow\"\u003eLevel Up: Growing Your Approach to Participatory Evaluation (AEA365)\u003c/a\u003e by Elizabeth DiLuzio\u003c/li\u003e\n\u003cli\u003eGrace Jones in \u003cem\u003eI\u0026#39;ll Never Write My Memoirs\u003c/em\u003e: \u0026quot;If you are a fan of doing the unexpected, and I am, then it is an advantage to be highly skilled at changing your mind. If you do not want to limit yourself, then be prepared to change your mind—often.\u0026quot;\u003c/li\u003e\n\u003cli\u003eCultivating trust on Twitter - \u003ca href=\"https://www.nytimes.com/2020/08/07/podcasts/the-daily/Jack-dorsey-twitter-trump.html\" rel=\"nofollow\"\u003eNYT Daily Podcast\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eAnjie Rosga\u003c/strong\u003e: Contact her through the \u003ca href=\"https://informingchange.com/about/team/annjanette-rosga/\" rel=\"nofollow\"\u003eInforming Change\u003c/a\u003e website\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Anjie:\u003c/h3\u003e\n\n\u003cp\u003eAnnJanette (Anjie) Rosga, co-directs the small, Berkeley-based consulting firm Informing Change which foregrounds strategic learning for equity, participatory research, and complex systems change. Most of Anjie’s projects involve facilitating strategy development and leading evaluation for hard-to-measure initiatives that cross disciplines, sectors, geographies, and/or cultures. In her prior professional lives, she worked as an independent consultant to human rights NGOs and United Nations agencies, as an advocate for international women, peace \u0026amp; security, and as an academic: first at Knox College in Illinois, and later the University of Colorado, Boulder. Her independent research began with an ethnography of anti-hate crime groups and the police in the US and later evolved into a multinational study of human rights training for police in emerging democracies. She holds a PhD in the History of Consciousness, an interdisciplinary program combining humanities and social sciences. She grew up in Minneapolis, MN, and Louisville, KY and makes her home in Oakland, CA.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week, we’re chatting with AnnJanette, or Anjie, Rosga about objectivity, trust and numbers, truth and power, and more. ","date_published":"2020-09-01T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/671a9f3e-b921-4979-b1d2-8406fbdbcceb.mp3","mime_type":"audio/mpeg","size_in_bytes":63576641,"duration_in_seconds":3960}]},{"id":"a72c01b9-a0cb-426c-b783-70df57807213","title":"6: Research Roundup","url":"https://evaluland.fireside.fm/6","content_text":"This week I discuss some of the latest Research on Evaluation (RoE) articles that have come out in 2020. \n\nArticles Mentioned:\n\n\nAt the beginning I mention the RoE TIG’s definition of RoE, which is summarized here.\nEvaluation Journal of Australasia – Special Issue on Values in Evaluation\n\n\nVol 19, Issue 4: Guest Editors: Keryn Hassall, Kelly Hannum, Amy Gullickson and Mathea Roorda\nVol 20, Issue 2: Guest Editors: Ayesha S Boyce, Amy M Gullickson, Keryn Hassall and Kelly Hannum\n\nNew Directions for Evaluation Volume 2020, Issue 166 - Examining issues facing communities of color today: The role of evaluation to incite change: Issue Editors: Leah C. Neubauer Dominica McBride Andrea D. Guajardo Wanda D. Casillas Melvin E. Hall\n\n\nNeubauer, McBride, Guajardo, Casillas, \u0026amp; Hall (2020) Examining issues facing communities of color today: The role of evaluation to incite change\nHall (2020) Blest be the tie that binds\nReid, Boyce, Adetogun, Moller, \u0026amp; Avent (2020) If not us, then who? Evaluators of color and social change\nGhanbarpour, Mercado, \u0026amp; Palotai (2020) A language justice framework for culturally responsive and equitable evaluation\nDhaliwal, Casey, Aceves-Iniguez, \u0026amp; Dean-Coffey (2020) Radical inquiry—liberatory praxis for research and evaluation\nGuajardo, Robles-Schrader, Aponte-Soto, \u0026amp; Neubauer (2020) LatCrit theory as a framework for social justice evaluation: Considerations for evaluation and evaluators\nMoss \u0026amp; Crewe (2020) The Black perspective: A framework for culturally competent health related evaluations for African Americans\nLemos \u0026amp; Garcia (2020) Promoting culturally responsive and equitable evaluation with Latinx immigrants\nBowman (2020) Nation-to-nation in evaluation: Utilizing an indigenous evaluation model to frame systems and government evaluations\nMcBride, Casilla, \u0026amp; LoPiccolo (2020) Inciting social change through evaluation\nNeubauer \u0026amp; Hall (2020) Is inciting social change something evaluators can do? Should do?\n\nLemire, Peck, \u0026amp; Porowski (2020) The growth of the evaluation tree in the policy analysis forest\nHurteau, Rahmanian, Houle, \u0026amp; Marchand (2020) The role of intuition in evaluative judgment and decision\nBrown \u0026amp; Di Lallo (2020) Talking circles: A culturally responsive evaluation practice\nMERL Tech State of the Field Series\nEngage R\u0026amp;D (2020) Listening for change: Evaluators of color speak out about experiences with foundations and evaluation firms\n\n\nContact:\n\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I discuss some of the latest Research on Evaluation (RoE) articles that have come out in 2020. \u003c/p\u003e\n\n\u003ch3\u003eArticles Mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eAt the beginning I mention the \u003ca href=\"http://comm.eval.org/researchonevaluation/home\" rel=\"nofollow\"\u003eRoE TIG\u003c/a\u003e’s definition of RoE, which is summarized \u003ca href=\"https://danawanzer.com/whatisroe/\" rel=\"nofollow\"\u003ehere\u003c/a\u003e.\u003c/li\u003e\n\u003cli\u003eEvaluation Journal of Australasia – Special Issue on Values in Evaluation\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://journals.sagepub.com/toc/evja/19/4\" rel=\"nofollow\"\u003eVol 19, Issue 4\u003c/a\u003e: Guest Editors: Keryn Hassall, Kelly Hannum, Amy Gullickson and Mathea Roorda\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://journals.sagepub.com/toc/evja/20/2\" rel=\"nofollow\"\u003eVol 20, Issue 2\u003c/a\u003e: Guest Editors: Ayesha S Boyce, Amy M Gullickson, Keryn Hassall and Kelly Hannum\u003c/li\u003e\n\u003c/ul\u003e\u003c/li\u003e\n\u003cli\u003eNew Directions for Evaluation Volume 2020, Issue 166 - \u003ca href=\"https://onlinelibrary.wiley.com/toc/1534875x/2020/2020/166\" rel=\"nofollow\"\u003eExamining issues facing communities of color today: The role of evaluation to incite change\u003c/a\u003e: Issue Editors: Leah C. Neubauer Dominica McBride Andrea D. Guajardo Wanda D. Casillas Melvin E. Hall\n\n\u003cul\u003e\n\u003cli\u003eNeubauer, McBride, Guajardo, Casillas, \u0026amp; Hall (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20406\" rel=\"nofollow\"\u003eExamining issues facing communities of color today: The role of evaluation to incite change\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eHall (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20414\" rel=\"nofollow\"\u003eBlest be the tie that binds\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eReid, Boyce, Adetogun, Moller, \u0026amp; Avent (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20407\" rel=\"nofollow\"\u003eIf not us, then who? Evaluators of color and social change\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eGhanbarpour, Mercado, \u0026amp; Palotai (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20412\" rel=\"nofollow\"\u003eA language justice framework for culturally responsive and equitable evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eDhaliwal, Casey, Aceves-Iniguez, \u0026amp; Dean-Coffey (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20415\" rel=\"nofollow\"\u003eRadical inquiry—liberatory praxis for research and evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eGuajardo, Robles-Schrader, Aponte-Soto, \u0026amp; Neubauer (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20409\" rel=\"nofollow\"\u003eLatCrit theory as a framework for social justice evaluation: Considerations for evaluation and evaluators\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eMoss \u0026amp; Crewe (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20413\" rel=\"nofollow\"\u003eThe Black perspective: A framework for culturally competent health related evaluations for African Americans\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eLemos \u0026amp; Garcia (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20410\" rel=\"nofollow\"\u003ePromoting culturally responsive and equitable evaluation with Latinx immigrants\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eBowman (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20411\" rel=\"nofollow\"\u003eNation-to-nation in evaluation: Utilizing an indigenous evaluation model to frame systems and government evaluations\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eMcBride, Casilla, \u0026amp; LoPiccolo (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20405\" rel=\"nofollow\"\u003eInciting social change through evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eNeubauer \u0026amp; Hall (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/10.1002/ev.20408\" rel=\"nofollow\"\u003eIs inciting social change something evaluators can do? Should do?\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\u003c/li\u003e\n\u003cli\u003eLemire, Peck, \u0026amp; Porowski (2020) \u003ca href=\"https://onlinelibrary.wiley.com/doi/full/10.1111/psj.12387\" rel=\"nofollow\"\u003eThe growth of the evaluation tree in the policy analysis forest\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eHurteau, Rahmanian, Houle, \u0026amp; Marchand (2020) \u003ca href=\"https://journals.sagepub.com/doi/10.1177/1098214020908211\" rel=\"nofollow\"\u003eThe role of intuition in evaluative judgment and decision\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eBrown \u0026amp; Di Lallo (2020) \u003ca href=\"https://journals.sagepub.com/doi/full/10.1177/1098214019899164\" rel=\"nofollow\"\u003eTalking circles: A culturally responsive evaluation practice\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://merltech.org/the-state-of-the-field-of-merl-tech/\" rel=\"nofollow\"\u003eMERL Tech State of the Field Series\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eEngage R\u0026amp;D (2020) \u003ca href=\"https://www.engagerd.com/blog/listening-for-change\" rel=\"nofollow\"\u003eListening for change: Evaluators of color speak out about experiences with foundations and evaluation firms\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I discuss some of the latest Research on Evaluation (RoE) articles that have come out in 2020. ","date_published":"2020-08-18T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/a72c01b9-a0cb-426c-b783-70df57807213.mp3","mime_type":"audio/mpeg","size_in_bytes":47953379,"duration_in_seconds":3025}]},{"id":"c26a09b4-c0bc-4b7b-9a95-35f3b19c63ac","title":"5: MS in Applied Psychology - Evaluation Reflections","url":"https://evaluland.fireside.fm/5","content_text":"\n“If you are someone who is interested in bringing change, or making the world a better place, or if you would like the results of your work to get used, evaluation is something that you might be interested in.”\n\n\nThis episode is a bit different. I asked three of my students to reflect on their experiences in the MS in Applied Psychology program at University of Wisconsin-Stout, as well as their experiences in the two evaluation courses. Emma, Omar, and Jade share their thoughts and reflections. \n\nClick here to learn more about the MS in Applied Psychology program. \n\nIf you have feedback about this episode, any previous episode, or the podcast in general, please email me at podcast@danawanzer.com or go to our website https://evaluland.fireside.fm.\n\nAbout the guests:\n\nEmma Frenn: My name is Emma Frenn, I am 24 years old and I am originally from Milwaukee Wisconsin (go bucks!) and moved to Eau Claire Wisconsin for my undergrad career. I graduated with a major in a psychology and minor in biology. I currently attend UW-Stout graduate program Applied Psychology. I am the youngest of six and as of recent I picked up on rollerblading as a fun hobby.\n\nJade: Jade is a student a UW Stout who is majoring in evaluation and I/O psych. She has a passion for creating surveys and reports, and enjoys learning new things from her peers and professors.\n\nOmar Albaraidi: Omar is an M.S. in Applied Psychology graduate student with a primary concentration in Industrial \u0026amp; Organizational Psychology. He is interested in bringing psychology to the workplace to stimulate organizational growth, overcome obstacles, and make data-driven decisions.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cblockquote\u003e\n\u003cp\u003e“If you are someone who is interested in bringing change, or making the world a better place, or if you would like the results of your work to get used, evaluation is something that you might be interested in.”\u003c/p\u003e\n\u003c/blockquote\u003e\n\n\u003cp\u003eThis episode is a bit different. I asked three of my students to reflect on their experiences in the MS in Applied Psychology program at University of Wisconsin-Stout, as well as their experiences in the two evaluation courses. Emma, Omar, and Jade share their thoughts and reflections. \u003c/p\u003e\n\n\u003cp\u003e\u003ca href=\"https://www.uwstout.edu/programs/ms-applied-psychology\" rel=\"nofollow\"\u003eClick here to learn more about the MS in Applied Psychology program\u003c/a\u003e. \u003c/p\u003e\n\n\u003cp\u003eIf you have feedback about this episode, any previous episode, or the podcast in general, please email me at \u003ca href=\"mailto:podcast@danawanzer.com\" rel=\"nofollow\"\u003epodcast@danawanzer.com\u003c/a\u003e or go to our website \u003ca href=\"https://evaluland.fireside.fm\" rel=\"nofollow\"\u003ehttps://evaluland.fireside.fm\u003c/a\u003e.\u003c/p\u003e\n\n\u003ch3\u003eAbout the guests:\u003c/h3\u003e\n\n\u003cp\u003e\u003cstrong\u003eEmma Frenn\u003c/strong\u003e: My name is Emma Frenn, I am 24 years old and I am originally from Milwaukee Wisconsin (go bucks!) and moved to Eau Claire Wisconsin for my undergrad career. I graduated with a major in a psychology and minor in biology. I currently attend UW-Stout graduate program Applied Psychology. I am the youngest of six and as of recent I picked up on rollerblading as a fun hobby.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eJade\u003c/strong\u003e: Jade is a student a UW Stout who is majoring in evaluation and I/O psych. She has a passion for creating surveys and reports, and enjoys learning new things from her peers and professors.\u003c/p\u003e\n\n\u003cp\u003e\u003cstrong\u003eOmar Albaraidi\u003c/strong\u003e: Omar is an M.S. in Applied Psychology graduate student with a primary concentration in Industrial \u0026amp; Organizational Psychology. He is interested in bringing psychology to the workplace to stimulate organizational growth, overcome obstacles, and make data-driven decisions.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"After my first year teaching at UW-Stout in the MS in Applied Psychology program, three of my students reflected on their experiences in the program in general and in the evaluation courses specifically. ","date_published":"2020-08-04T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/c26a09b4-c0bc-4b7b-9a95-35f3b19c63ac.mp3","mime_type":"audio/mpeg","size_in_bytes":24631729,"duration_in_seconds":1537}]},{"id":"d833b914-ecd5-43ac-b7c8-ef0fd56725ca","title":"4: Teaching Evaluation and Supporting Students and Colleagues of Color with Ayesha Boyce","url":"https://evaluland.fireside.fm/4","content_text":"This week I am joined by Dr. Ayesha Boyce, assistant professor of educational research methodology at the University of North Carolina at Greensboro, to discuss teaching evaluation and supporting students and colleagues of color. \n\nTopics Covered:\n\n\nReflections on five years of teaching evaluation\nThe -ologies: ontology, epistemology, and axiology beyond just methodology\nFavorite evaluation activity (of course, it’s the evaluating the cookie activity!)\nMentoring students of color. Five keys from Ayesha (see upcoming CJPE article):\n\n\n Consider impact of vicarious trauma\n Assist with facilitation peer mentors/squads\n Respect, honor, and celebrate students’ culture, religion, and family\n Be vigilant of microaggressions, and practice microvalidation\n Develop mentoring competence\n\nSupporting colleagues of color: helpful actions, silence as complicity, listening in, getting comfortable being uncomfortable\nApproaching institutional leaders about actions for supporting students, faculty, and staff of color\nSpeaking out on the tenure track\nHaving a family and being exceptional at work simultaneously (Ayesha encourages us all that it IS possible!)\n\n\nResources mentioned:\n\n\nBoyce \u0026amp; McGowan (2018) article “An exploration of two novice evaluation educators’ experiences developing and implementing introduction to evaluation courses”\nEvaluating the cookie activity in Preskill \u0026amp; Russ-Eft’s Building Evaluation Capacity book\nUpcoming issue in CJPE on evaluator education\nIbram X. Kendi\nLetter from Dr. Boyce and students and faculty of color to their department\nLetter from Dr. Boyce and other black UNCG faculty\nNDE upcoming issue on evaluator education\n\n\nContact:\n\n\nAyesha Boyce: Twitter @AyeshaBoyce and ayesha.boyce@uncg.edu\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Dr. Boyce:\n\nDr. Ayesha S. Boyce is an assistant professor of Educational Research Methodology at UNC Greensboro. She is a program evaluation teacher, scholar, and practitioner. Before pursuing her Ph.D., she was an education research associate (evaluator) for the Arizona Department of Education. She is the Co-Director of the UNCG Office of Assessment, Evaluation, and Research Services (OAERS). Her research focuses on attending to value stances and issues related to diversity, equity, inclusion, access, cultural responsiveness, and social justice within evaluation—especially multi-site, STEM, and contexts with historically marginalized populations. She also examines teaching, mentoring, and learning in evaluation. She has evaluated over 40 programs funded by the National Science Foundation (NSF), US Department of Education, National Institutes of Health, and Spencer and Teagle foundations. She is currently the external evaluator for five NSF funded projects and a Co-Principal Investigator on four NSF funded projects. She is a Co-PI on the recently funded 1 million-dollar NSF grant, Spartans ADVANCE: Adaptations of Practices For Faculty Equity, Diversity, and Inclusion at The UNCG. Dr. Boyce is a co-chair of the American Evaluation Association Multiethnic Issues in Evaluation Topic Interest Group, a member of the editorial board for the Canadian Journal of Program Evaluation and teaches classes in program evaluation and research methodology where she emphasizes good practice with mindful attentiveness to theoretical roots. She encourages students to develop a strong methodological foundation, conduct studies based on democratic principles, and promote equity, fairness, inclusivity, and diversity. She is a 2019 UNCG School of Education Distinguished Research Scholar Award recipient and a 2019 American Evaluation Association Marcia Guttentag Promising New Evaluator Awardee.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I am joined by Dr. Ayesha Boyce, assistant professor of educational research methodology at the University of North Carolina at Greensboro, to discuss teaching evaluation and supporting students and colleagues of color. \u003c/p\u003e\n\n\u003ch3\u003eTopics Covered:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eReflections on five years of teaching evaluation\u003c/li\u003e\n\u003cli\u003eThe -ologies: ontology, epistemology, and axiology beyond just methodology\u003c/li\u003e\n\u003cli\u003eFavorite evaluation activity (of course, it’s the evaluating the cookie activity!)\u003c/li\u003e\n\u003cli\u003eMentoring students of color. Five keys from Ayesha (see upcoming CJPE article):\n\n\u003col\u003e\n\u003cli\u003e Consider impact of vicarious trauma\u003c/li\u003e\n\u003cli\u003e Assist with facilitation peer mentors/squads\u003c/li\u003e\n\u003cli\u003e Respect, honor, and celebrate students’ culture, religion, and family\u003c/li\u003e\n\u003cli\u003e Be vigilant of microaggressions, and practice microvalidation\u003c/li\u003e\n\u003cli\u003e Develop mentoring competence\u003c/li\u003e\n\u003c/ol\u003e\u003c/li\u003e\n\u003cli\u003eSupporting colleagues of color: helpful actions, silence as complicity, listening in, getting comfortable being uncomfortable\u003c/li\u003e\n\u003cli\u003eApproaching institutional leaders about actions for supporting students, faculty, and staff of color\u003c/li\u003e\n\u003cli\u003eSpeaking out on the tenure track\u003c/li\u003e\n\u003cli\u003eHaving a family and being exceptional at work simultaneously (Ayesha encourages us all that it IS possible!)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eResources mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eBoyce \u0026amp; McGowan (2018) article “\u003ca href=\"https://journals.sagepub.com/doi/10.1177/1098214018778812\" rel=\"nofollow\"\u003eAn exploration of two novice evaluation educators’ experiences developing and implementing introduction to evaluation courses\u003c/a\u003e”\u003c/li\u003e\n\u003cli\u003eEvaluating the cookie activity in Preskill \u0026amp; Russ-Eft’s \u003ca href=\"https://us.sagepub.com/en-us/nam/building-evaluation-capacity/book241833\" rel=\"nofollow\"\u003eBuilding Evaluation Capacity book\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eUpcoming issue in CJPE on evaluator education\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.ibramxkendi.com/\" rel=\"nofollow\"\u003eIbram X. Kendi\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://twitter.com/AyeshaBoyce/status/1273662617035452419\" rel=\"nofollow\"\u003eLetter\u003c/a\u003e from Dr. Boyce and students and faculty of color to their department\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://racialequity.uncg.edu/letter-from-black-uncg-faculty/\" rel=\"nofollow\"\u003eLetter\u003c/a\u003e from Dr. Boyce and other black UNCG faculty\u003c/li\u003e\n\u003cli\u003eNDE \u003ca href=\"https://drive.google.com/file/d/16A60D7b7Rqajib1-Egx4FAh4TdQVdkne/view\" rel=\"nofollow\"\u003eupcoming issue on evaluator education\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eAyesha Boyce\u003c/strong\u003e: \u003ca href=\"https://twitter.com/AyeshaBoyce\" rel=\"nofollow\"\u003eTwitter @AyeshaBoyce\u003c/a\u003e and \u003ca href=\"mailto:ayesha.boyce@uncg.edu\" rel=\"nofollow\"\u003eayesha.boyce@uncg.edu\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Dr. Boyce:\u003c/h3\u003e\n\n\u003cp\u003eDr. Ayesha S. Boyce is an assistant professor of Educational Research Methodology at UNC Greensboro. She is a program evaluation teacher, scholar, and practitioner. Before pursuing her Ph.D., she was an education research associate (evaluator) for the Arizona Department of Education. She is the Co-Director of the UNCG Office of Assessment, Evaluation, and Research Services (OAERS). Her research focuses on attending to value stances and issues related to diversity, equity, inclusion, access, cultural responsiveness, and social justice within evaluation—especially multi-site, STEM, and contexts with historically marginalized populations. She also examines teaching, mentoring, and learning in evaluation. She has evaluated over 40 programs funded by the National Science Foundation (NSF), US Department of Education, National Institutes of Health, and Spencer and Teagle foundations. She is currently the external evaluator for five NSF funded projects and a Co-Principal Investigator on four NSF funded projects. She is a Co-PI on the recently funded 1 million-dollar NSF grant, Spartans ADVANCE: Adaptations of Practices For Faculty Equity, Diversity, and Inclusion at The UNCG. Dr. Boyce is a co-chair of the American Evaluation Association Multiethnic Issues in Evaluation Topic Interest Group, a member of the editorial board for the Canadian Journal of Program Evaluation and teaches classes in program evaluation and research methodology where she emphasizes good practice with mindful attentiveness to theoretical roots. She encourages students to develop a strong methodological foundation, conduct studies based on democratic principles, and promote equity, fairness, inclusivity, and diversity. She is a 2019 UNCG School of Education Distinguished Research Scholar Award recipient and a 2019 American Evaluation Association Marcia Guttentag Promising New Evaluator Awardee.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I am joined by Dr. Ayesha Boyce, assistant professor of educational research methodology at the University of North Carolina at Greensboro, to discuss teaching evaluation and supporting students and colleagues of color. ","date_published":"2020-07-21T07:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/d833b914-ecd5-43ac-b7c8-ef0fd56725ca.mp3","mime_type":"audio/mpeg","size_in_bytes":43594122,"duration_in_seconds":2818}]},{"id":"b58c7910-8f20-456c-bfca-89b2a7396897","title":"3: Evaluation Education and Data Cleaning with Jennifer Ann Morrow","url":"https://evaluland.fireside.fm/3","content_text":"This week I am joined by Dr. Jennifer Ann Morrow, the program coordinator of the Evaluation Statistics and Measurement doctoral program (soon to be named \"Evaluation Statistics and Methodology) at the University of Tennessee-Knoxville. We talked about teaching evaluation and data cleaning in evaluation.\n\nTopics Covered:\n\n\nJennifer’s background, philosophy, and experience in teaching evaluation (01:58)\nOur favorite evaluation activities: evaluating cookies, one-pages on hot topics and people in evaluation, evaluation failures, self-reflection journals, practical experience outside of class (11:33)\nPersonal professional development in data visualization and R (32:00)\nWhat’s giving Jennifer life in evaluation right now (38:40)\nData cleaning book proposal by Jennifer and Gary Skolits (44:13)\nWhat’s next for Jennifer (50:55)\n\n\nResources mentioned:\n\n\nPreskill \u0026amp; Russ-Eft (2015) Building Evaluation Capacity: Activities for Teaching and Training\nWanzer (2020) What is evaluation paper (preprint)\nHutchinson (2018) Evaluation Failures: 22 Tales of Mistakes Made and Lessons Learned\nJennifer’s student’s blog on user experience for Ann K. Emery\nGreat Graphs with Ann K. Emery](https://depictdatastudio.com/)\nR for the Rest of Us with David Keyes](https://rfortherestofus.com/)\nAmy Cesal Play-Doh data visualization activity\nBianca Montrosse-Moorhead’s research on what ought to be included in the curriculum for master’s and doctoral eval programs\nJennifer’s handout on the 12 steps to data cleaning](http://comm.eval.org/qual/viewdocument/cbd146-a-brief-intr-1)\n\n\nContact:\n\n\nJennifer Ann Morrow: @evaluationdiva on Twitter and jamorrow@utk.edu\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Jennifer:\n\nDr. Jennifer Ann Morrow is currently the program coordinator of the Evaluation Statistics and Measurement doctoral program at the University of Tennessee-Knoxville. Her main areas of research are higher education assessment and evaluation and effective strategies for teaching methodology. She has been teaching evaluation and methodology courses for the past 22 years. She is passionate about evaluation and assessment and regularly tweets on these topics (@evaluationdiva). In her spare time she loves to travel and explore the beautiful towns and mountains of Tennessee.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I am joined by Dr. Jennifer Ann Morrow, the program coordinator of the \u003ca href=\"https://epc.utk.edu/evaluation-statistics-measurement/\" rel=\"nofollow\"\u003eEvaluation Statistics and Measurement doctoral program\u003c/a\u003e (soon to be named \u0026quot;Evaluation Statistics and Methodology) at the University of Tennessee-Knoxville. We talked about teaching evaluation and data cleaning in evaluation.\u003c/p\u003e\n\n\u003ch3\u003eTopics Covered:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eJennifer’s background, philosophy, and experience in teaching evaluation (01:58)\u003c/li\u003e\n\u003cli\u003eOur favorite evaluation activities: evaluating cookies, one-pages on hot topics and people in evaluation, evaluation failures, self-reflection journals, practical experience outside of class (11:33)\u003c/li\u003e\n\u003cli\u003ePersonal professional development in data visualization and R (32:00)\u003c/li\u003e\n\u003cli\u003eWhat’s giving Jennifer life in evaluation right now (38:40)\u003c/li\u003e\n\u003cli\u003eData cleaning book proposal by Jennifer and Gary Skolits (44:13)\u003c/li\u003e\n\u003cli\u003eWhat’s next for Jennifer (50:55)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eResources mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003ePreskill \u0026amp; Russ-Eft (2015) \u003ca href=\"https://us.sagepub.com/en-us/nam/building-evaluation-capacity/book241833\" rel=\"nofollow\"\u003eBuilding Evaluation Capacity: Activities for Teaching and Training\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eWanzer (2020) \u003ca href=\"https://osf.io/c9pf7/\" rel=\"nofollow\"\u003eWhat is evaluation paper (preprint)\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eHutchinson (2018) \u003ca href=\"https://us.sagepub.com/en-us/nam/evaluation-failures/book260109\" rel=\"nofollow\"\u003eEvaluation Failures: 22 Tales of Mistakes Made and Lessons Learned\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eJennifer’s student’s \u003ca href=\"https://depictdatastudio.com/three-takeaways-from-the-user-experience-ux-field-to-up-your-data-viz-game/\" rel=\"nofollow\"\u003eblog on user experience for Ann K. Emery\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eGreat Graphs with Ann K. Emery](\u003ca href=\"https://depictdatastudio.com/\" rel=\"nofollow\"\u003ehttps://depictdatastudio.com/\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eR for the Rest of Us with David Keyes](\u003ca href=\"https://rfortherestofus.com/\" rel=\"nofollow\"\u003ehttps://rfortherestofus.com/\u003c/a\u003e)\u003c/li\u003e\n\u003cli\u003eAmy Cesal \u003ca href=\"https://www.amycesal.com/day-doh-viz-all\" rel=\"nofollow\"\u003ePlay-Doh data visualization activity\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eBianca Montrosse-Moorhead’s \u003ca href=\"https://www.researchgate.net/publication/337032339_Evaluator_education_curriculum_What_ought_to_be_taught_in_master\u0026#x27;s_and_doctoral_programs\" rel=\"nofollow\"\u003eresearch on what ought to be included in the curriculum for master’s and doctoral eval programs\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eJennifer’s handout on the 12 steps to data cleaning](\u003ca href=\"http://comm.eval.org/qual/viewdocument/cbd146-a-brief-intr-1\" rel=\"nofollow\"\u003ehttp://comm.eval.org/qual/viewdocument/cbd146-a-brief-intr-1\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eJennifer Ann Morrow\u003c/strong\u003e: \u003ca href=\"https://twitter.com/evaluationdiva\" rel=\"nofollow\"\u003e@evaluationdiva on Twitter\u003c/a\u003e and \u003ca href=\"mailto:jamorrow@utk.edu\" rel=\"nofollow\"\u003ejamorrow@utk.edu\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Jennifer:\u003c/h3\u003e\n\n\u003cp\u003eDr. Jennifer Ann Morrow is currently the program coordinator of the Evaluation Statistics and Measurement doctoral program at the University of Tennessee-Knoxville. Her main areas of research are higher education assessment and evaluation and effective strategies for teaching methodology. She has been teaching evaluation and methodology courses for the past 22 years. She is passionate about evaluation and assessment and regularly tweets on these topics (@evaluationdiva). In her spare time she loves to travel and explore the beautiful towns and mountains of Tennessee.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I am joined by Dr. Jennifer Ann Morrow, the program coordinator of the Evaluation Statistics and Measurement doctoral program at the University of Tennessee-Knoxville. We talked about teaching evaluation and data cleaning in evaluation.","date_published":"2020-07-07T07:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/b58c7910-8f20-456c-bfca-89b2a7396897.mp3","mime_type":"audio/mpeg","size_in_bytes":53542049,"duration_in_seconds":3325}]},{"id":"73d12b0b-b1b4-4a88-b815-dc968c52c34b","title":"2: Meta-Evaluation, Research on Evaluation, \u0026 Evaluation Theory with Zach Tilton","url":"https://evaluland.fireside.fm/2","content_text":"This week I am joined by Zach Tilton, a Doctoral Research Associate at the Interdisciplinary PhD in Evaluation Program at Western Michigan University. We discussed research on evaluation and meta-evaluation. \n\nTopics Covered:\n\n\nHow Zach got into evaluation and at Western Michigan University (01:12)\nWhat peacebuilding evaluation is (03:52)\nEvaluation specialists vs generalists (05:45)\nResearch on evaluation and meta-evaluation (09:50)\nPrescriptive vs descriptive theories (22:35)\nEvaluation theory (25:00)\nZach’s dissertation: RoE on peacebuilding evaluation (35:50)\nAdjusting to life amidst Covid-19 (40:10)\nWhat’s next for Zach (46:00)\nWhat’s giving life for Zach (50:55)\n\n\nResources mentioned:\n\n\nWestern Michigan University Interdisciplinary PhD in Evaluation, including Michael Harnar and Chris Coryn\nEPP article on knowledge syntheses\nAEA Research on Evaluation TIG\nBlog describing working group’s updated RoE definition\nWeaver \u0026amp; Cousins article on participatory evaluation\nAEA Integrating Technology into Evaluation TIG\nMERL Tech conference\nEveryday Peace Indicators\nDigital Impact Alliance\nEvaluation Practice Reconsidered by Thomas Schwandt\nEvalCentral Unwebinars, Blogs, and Discussion Forum\nEquitable Evaluation Initiative\nEval4Action Campaign\nBlack youth-led movements: Black Visions Collective Reclaim the Block, The Twin Cities Coalition for Justice for Jamar, and Minnesota Freedom Fund\n\n\nContact:\n\n\nZach Tilton: @ZachTilton on Twitter and zachary.d.tilton@wmich.edu\nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Zach:\n\nZach Tilton is a Doctoral Research Associate at the Interdisciplinary PhD in Evaluation Program at Western Michigan University where he is setting and pursuing an agenda for research on peacebuilding evaluation. He holds a BS in Peacebuilding and Business Management from Brigham Young University-Hawaii and an MA in Peace Studies from the University of Bradford. Along with peacebuilding evaluation, he researches technology-enabled evaluation, meta-evaluation, and participatory and collaborative evaluation. He is a Returned Peace Corps Volunteer, a Rotary Peace Fellow, an Institute for Economics and Peace Ambassador, and has worked as an evaluation practitioner for various international peacebuilding organizations. He is also currently an Evaluation Consultant for the Digital Impact Alliance at the United Nations Foundation, an Associate at Everyday Peace Indicators, and the Co-chair for the Topical Interest Group for Integrating Technology into Evaluation and the EvalYouth representative to the American Evaluation Association.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I am joined by Zach Tilton, a Doctoral Research Associate at the Interdisciplinary PhD in Evaluation Program at Western Michigan University. We discussed research on evaluation and meta-evaluation. \u003c/p\u003e\n\n\u003ch3\u003eTopics Covered:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eHow Zach got into evaluation and at Western Michigan University (01:12)\u003c/li\u003e\n\u003cli\u003eWhat peacebuilding evaluation is (03:52)\u003c/li\u003e\n\u003cli\u003eEvaluation specialists vs generalists (05:45)\u003c/li\u003e\n\u003cli\u003eResearch on evaluation and meta-evaluation (09:50)\u003c/li\u003e\n\u003cli\u003ePrescriptive vs descriptive theories (22:35)\u003c/li\u003e\n\u003cli\u003eEvaluation theory (25:00)\u003c/li\u003e\n\u003cli\u003eZach’s dissertation: RoE on peacebuilding evaluation (35:50)\u003c/li\u003e\n\u003cli\u003eAdjusting to life amidst Covid-19 (40:10)\u003c/li\u003e\n\u003cli\u003eWhat’s next for Zach (46:00)\u003c/li\u003e\n\u003cli\u003eWhat’s giving life for Zach (50:55)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eResources mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://wmich.edu/evaluationphd\" rel=\"nofollow\"\u003eWestern Michigan University Interdisciplinary PhD in Evaluation\u003c/a\u003e, including \u003ca href=\"https://wmich.edu/evaluationphd/directory/harnar\" rel=\"nofollow\"\u003eMichael Harnar\u003c/a\u003e and \u003ca href=\"https://wmich.edu/evaluationphd/directory/coryn\" rel=\"nofollow\"\u003eChris Coryn\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.sciencedirect.com/science/article/abs/pii/S0149718919302605?via%3Dihub\" rel=\"nofollow\"\u003eEPP article on knowledge syntheses\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://comm.eval.org/researchonevaluation/home\" rel=\"nofollow\"\u003eAEA Research on Evaluation TIG\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://danawanzer.com/whatisroe/\" rel=\"nofollow\"\u003eBlog describing working group’s updated RoE definition\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/144\" rel=\"nofollow\"\u003eWeaver \u0026amp; Cousins article on participatory evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eAEA Integrating Technology into Evaluation TIG\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://merltech.org/\" rel=\"nofollow\"\u003eMERL Tech conference\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://everydaypeaceindicators.org/\" rel=\"nofollow\"\u003eEveryday Peace Indicators\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://digitalimpactalliance.org/\" rel=\"nofollow\"\u003eDigital Impact Alliance\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.worldcat.org/title/evaluation-practice-reconsidered/oclc/47200552\" rel=\"nofollow\"\u003eEvaluation Practice Reconsidered by Thomas Schwandt\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eEvalCentral \u003ca href=\"https://www.crowdcast.io/e/evalcentral/\" rel=\"nofollow\"\u003eUnwebinars\u003c/a\u003e, \u003ca href=\"https://blog.evalcentral.com/\" rel=\"nofollow\"\u003eBlogs\u003c/a\u003e, and \u003ca href=\"https://evalcentral.com/\" rel=\"nofollow\"\u003eDiscussion Forum\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.equitableeval.org/\" rel=\"nofollow\"\u003eEquitable Evaluation Initiative\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://www.eval4action.org/\" rel=\"nofollow\"\u003eEval4Action Campaign\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eBlack youth-led movements: \u003ca href=\"https://www.blackvisionsmn.org/\" rel=\"nofollow\"\u003eBlack Visions Collective\u003c/a\u003e \u003ca href=\"https://www.reclaimtheblock.org/home\" rel=\"nofollow\"\u003eReclaim the Block\u003c/a\u003e, \u003ca href=\"https://www.facebook.com/TCC4J/\" rel=\"nofollow\"\u003eThe Twin Cities Coalition for Justice for Jamar\u003c/a\u003e, and \u003ca href=\"https://minnesotafreedomfund.org/\" rel=\"nofollow\"\u003eMinnesota Freedom Fund\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eZach Tilton\u003c/strong\u003e: \u003ca href=\"https://twitter.com/zachtilton\" rel=\"nofollow\"\u003e@ZachTilton on Twitter\u003c/a\u003e and \u003ca href=\"mailto:zachary.d.tilton@wmich.edu\" rel=\"nofollow\"\u003ezachary.d.tilton@wmich.edu\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Zach:\u003c/h3\u003e\n\n\u003cp\u003eZach Tilton is a Doctoral Research Associate at the Interdisciplinary PhD in Evaluation Program at Western Michigan University where he is setting and pursuing an agenda for research on peacebuilding evaluation. He holds a BS in Peacebuilding and Business Management from Brigham Young University-Hawaii and an MA in Peace Studies from the University of Bradford. Along with peacebuilding evaluation, he researches technology-enabled evaluation, meta-evaluation, and participatory and collaborative evaluation. He is a Returned Peace Corps Volunteer, a Rotary Peace Fellow, an Institute for Economics and Peace Ambassador, and has worked as an evaluation practitioner for various international peacebuilding organizations. He is also currently an Evaluation Consultant for the Digital Impact Alliance at the United Nations Foundation, an Associate at Everyday Peace Indicators, and the Co-chair for the Topical Interest Group for Integrating Technology into Evaluation and the EvalYouth representative to the American Evaluation Association.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I am joined by Zach Tilton, a Doctoral Research Associate at the Interdisciplinary PhD in Evaluation Program at Western Michigan University. We discussed research on evaluation and meta-evaluation. ","date_published":"2020-06-23T06:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/73d12b0b-b1b4-4a88-b815-dc968c52c34b.mp3","mime_type":"audio/mpeg","size_in_bytes":52265876,"duration_in_seconds":3358}]},{"id":"42911f0d-84a5-4bd3-ad75-4c1d5d3d39e7","title":"1: Strategic Evaluation with Kathleen Doll","url":"https://evaluland.fireside.fm/1","content_text":"This week I am joined by Kathleen Doll, who recently completed her PhD at Claremont Graduate University. We discuss her dissertation on strategic planning in evaluation design. \n\nTopics Covered:\n\n\nWhy did Kathleen choose to get a PhD in evaluation at Claremont Graduate University? (02:12)\nHow did Kathleen get to her dissertation topic of strategic evaluation? (05:09)\nDissertation design (07:56)\nWhat is strategic evaluation planning? (09:25)\nResults! What are the benefits of strategic evaluation planning? (10:44)\nWho should be doing strategic evaluation planning? (16:22)\nHow does strategic evaluation planning align with developmental evaluation? (19:20)\nHow does this work with funders? (21:47)\nHow Kathleen’s work has been impacted by Covid-19 (23:34)\nTopics in evaluation giving Kathleen life: trauma-informed evaluation, research on evaluation working group, and working on an NDE volume (27:30)\nWhat’s next for Kathleen after the PhD (35:52)\n\n\nResources mentioned:\n\n\nKathleen's dissertation handout on Strategic Evaluation\nMartha Brown’s eStudy on Trauma Informed Evaluation\nJ. Bradley Cousins’ webinar on Getting RoE Published\n\n\nContact:\n\n\nKathleen Doll: LinkedIn \u0026amp; kathleendoll101@gmail.com \nEvaluLand: Website \u0026amp; Twitter (@EvaluLand)\n\n\nAbout Kathleen:\n\nKathleen recently completed her PhD in Evaluation and Applied Research Methods at Claremont Graduate University in Southern California. She is passionate about democratic approaches to evaluation, mixed methodologies, infusing strategic planning into evaluation design, and building evaluation capacity. Kathleen is an enthusiastic member of the American Evaluation Association (AEA) and serves as the Research on Evaluation (RoE) Program Co-Chair. When Kathleen is not dabbling in the wonderful world of evaluation, she enjoys outdoorsy adventures in her majestic homeland of Colorado, experimenting in the kitchen, and long-distance running.\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eThis week I am joined by Kathleen Doll, who recently completed her PhD at Claremont Graduate University. We discuss her dissertation on strategic planning in evaluation design. \u003c/p\u003e\n\n\u003ch3\u003eTopics Covered:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eWhy did Kathleen choose to get a PhD in evaluation at Claremont Graduate University? (02:12)\u003c/li\u003e\n\u003cli\u003eHow did Kathleen get to her dissertation topic of strategic evaluation? (05:09)\u003c/li\u003e\n\u003cli\u003eDissertation design (07:56)\u003c/li\u003e\n\u003cli\u003eWhat is strategic evaluation planning? (09:25)\u003c/li\u003e\n\u003cli\u003eResults! What are the benefits of strategic evaluation planning? (10:44)\u003c/li\u003e\n\u003cli\u003eWho should be doing strategic evaluation planning? (16:22)\u003c/li\u003e\n\u003cli\u003eHow does strategic evaluation planning align with developmental evaluation? (19:20)\u003c/li\u003e\n\u003cli\u003eHow does this work with funders? (21:47)\u003c/li\u003e\n\u003cli\u003eHow Kathleen’s work has been impacted by Covid-19 (23:34)\u003c/li\u003e\n\u003cli\u003eTopics in evaluation giving Kathleen life: trauma-informed evaluation, research on evaluation working group, and working on an NDE volume (27:30)\u003c/li\u003e\n\u003cli\u003eWhat’s next for Kathleen after the PhD (35:52)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eResources mentioned:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003eKathleen\u0026#39;s dissertation \u003ca href=\"https://tinyurl.com/drdoll2020\" rel=\"nofollow\"\u003ehandout on Strategic Evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eMartha Brown’s \u003ca href=\"https://www.pathlms.com/aea/courses/15601\" rel=\"nofollow\"\u003eeStudy on Trauma Informed Evaluation\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eJ. Bradley Cousins’ webinar on \u003ca href=\"http://comm.eval.org/researchonevaluation/tigresources\" rel=\"nofollow\"\u003eGetting RoE Published\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eContact:\u003c/h3\u003e\n\n\u003cul\u003e\n\u003cli\u003e\u003cstrong\u003eKathleen Doll\u003c/strong\u003e: \u003ca href=\"https://www.linkedin.com/in/kathleenmkdoll\" rel=\"nofollow\"\u003eLinkedIn\u003c/a\u003e \u0026amp; \u003ca href=\"mailto:kathleendoll101@gmail.com\" rel=\"nofollow\"\u003ekathleendoll101@gmail.com\u003c/a\u003e \u003c/li\u003e\n\u003cli\u003e\u003cstrong\u003eEvaluLand\u003c/strong\u003e: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eWebsite\u003c/a\u003e \u0026amp; Twitter (\u003ca href=\"https://twitter.com/evaluland\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e)\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003ch3\u003eAbout Kathleen:\u003c/h3\u003e\n\n\u003cp\u003eKathleen recently completed her PhD in Evaluation and Applied Research Methods at Claremont Graduate University in Southern California. She is passionate about democratic approaches to evaluation, mixed methodologies, infusing strategic planning into evaluation design, and building evaluation capacity. Kathleen is an enthusiastic member of the American Evaluation Association (AEA) and serves as the Research on Evaluation (RoE) Program Co-Chair. When Kathleen is not dabbling in the wonderful world of evaluation, she enjoys outdoorsy adventures in her majestic homeland of Colorado, experimenting in the kitchen, and long-distance running.\u003c/p\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"This week I am joined by Kathleen Doll, who recently completed her PhD at Claremont Graduate University. We discuss her dissertation on strategic planning in evaluation design. ","date_published":"2020-06-09T09:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/42911f0d-84a5-4bd3-ad75-4c1d5d3d39e7.mp3","mime_type":"audio/mpeg","size_in_bytes":36252260,"duration_in_seconds":2296}]},{"id":"cf4cdf12-f3d9-47dc-a04f-0b95dff6e583","title":"Introducing EvaluLand","url":"https://evaluland.fireside.fm/teaser","content_text":"Welcome to EvaluLand! This episode is a brief introduction to the podcast and to me, your host, Dana Linnell Wanzer.\n\nIf you’d like to learn more about the podcast, check us out!\n\n\nWebsite: evaluland.fireside.fm\nTwitter: @EvaluLand\nEmail: podcast@danawanzer.com\n\n\nMusic by Matt Ingelson, http://www.mattingelsonmusic.com/","content_html":"\u003cp\u003eWelcome to EvaluLand! This episode is a brief introduction to the podcast and to me, your host, Dana Linnell Wanzer.\u003c/p\u003e\n\n\u003cp\u003eIf you’d like to learn more about the podcast, check us out!\u003c/p\u003e\n\n\u003cul\u003e\n\u003cli\u003eWebsite: \u003ca href=\"https://evaluland.fireside.fm/\" rel=\"nofollow\"\u003eevaluland.fireside.fm\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eTwitter: \u003ca href=\"https://twitter.com/EvaluLand\" rel=\"nofollow\"\u003e@EvaluLand\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003eEmail: \u003ca href=\"mailto:podcast@danawanzer.com\" rel=\"nofollow\"\u003epodcast@danawanzer.com\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\n\u003cp\u003eMusic by Matt Ingelson, \u003ca href=\"http://www.mattingelsonmusic.com/\" rel=\"nofollow\"\u003ehttp://www.mattingelsonmusic.com/\u003c/a\u003e\u003c/p\u003e","summary":"Welcome to EvaluLand! ","date_published":"2020-06-01T09:00:00.000-05:00","attachments":[{"url":"https://aphid.fireside.fm/d/1437767933/d78430de-3c9f-4c6b-83c5-c0881bf2bff7/cf4cdf12-f3d9-47dc-a04f-0b95dff6e583.mp3","mime_type":"audio/mpeg","size_in_bytes":1590830,"duration_in_seconds":78}]}]}