The conference began on Wednesday, at 2.30 PM, with a welcome from the AEA24 President, awards of the AEA 24 Recipients and a Plenary opening session, titled: ‘Learning from the Life and Legacy of Ricardo Millet: Mentor, Scholar, Field Builder’. This was a tribute to the late Ricardo Millet from David Chavis, Rodney Hopson, and Maria Montenegro. Dr Ricardo Millet was a friend to many and focused his professional life to creating a community in Evaluation and shaping the lives and careers of evaluators and practitioners of color who were often unseen and had not found their way/ place in the AEA and the broader field of Evaluation. Dr. Millet was honored and will be greatly missed. After the plenary session, I went to another session; Engaging Youth as Leaders as DRG & Evaluative Practice: Cross-TIG, Cross-Cultural & MultiLinguistic Lessons Learned in the U.S. and African Contexts to Amplify and Empower Youth Voices in Evaluation. The session was a roundtable presentation, Chaired by Julie Poncelet, and the presenters being Dr Awuor Ponge, EvalIndigeous member, who spoke on behalf of AfrEA, and was joined by Ian Hopwood, Denise Baer, Safyatou Diallo. They were all in support of engaging the Young Emerging Evaluators (YEEs) in the organizational level or the Voluntary Organization of Professional Evaluators (VOPES), since the YEES are the future/ innovators of Evaluation, and the change makers with their fresh perspectives and innovative minds. On Thursday, I attended a plenary Session: Generative AI: Navigating Pthe Ethical Frontier in Evaluation, moderated by Meredith Blair Pearlman- of the David and Lucile Packard Foundation. He was joined by Olivia Delch, Linda Raftree, Dr. Aileen M. Reid, and Zach Tilton. Their presentation sought to identify the transformative impacts of Generative AI on the evaluation practices, the opportunities and the challenges brought by AI in evaluation. They shared their personal insights about integrating AI in Evaluation, and having a balance between the risks associated and the benefits AI brings in Evaluation. On Friday, the day began with a plenary session: ‘Participatory MEL and MEL Tech- Friends or Frenemies’, presented by EvalIndigenous member Eddah Kanini, Hanna Camp, and Josh Dewald. The session focused on elevating the voices of the voiceless and emphasizing the need for involving program participants in the design, implementation and evaluation of program MEL and accountability processes. Eddah Kanini, a passionate advocate of the marginalized talked about empowering the voices of the voiceless/ already silenced voices. This includes those with hearing and vision impairments, and other disabilities, who may be sidelined by the use of MEL tech technologies in evaluation. Eddah Kanini was able to outline the balance between missing people out and the advantages that MEL brings to evaluation field. After the plenary session, I made a presentation with my Co- presenter, Dr. Awuor Ponge on ‘Amplifying and Empowering Voices of the Indigenous Communities in Evaluation in Kenya: Case of the Indigenous Ogiek and the Mijikenda of Kenya.’ Our presentation was drawn from two studies conducted among the indigenous communities in Kenya, namely the Mijikenda and the Ogiek. The studies were funded by the Ford Foundation under the auspices of the EvalIndigenous Global Network. Our presentation highlighted the importance of engaging the indigenous voices in the evaluation process, and fostering a meaningful partnerships between evaluators and indigenous communities. It was such an honor making this presentation as a YEE. I’m looking forward to making more presentations at AEA Conferences to come. Big thank you to everyone who attended and listened to my presentation. That meant a lot to me.
The climax of the AEA 2024 Conference was the closing plenary session by Prof Bagele Chilisa; ‘Breaking the Echo Chamber: Amplifying Marginalized Voices to Resonate with the Dominant Narrative.’ The session was very engaging and mind blowing as Prof. Bagele shared her lif and academic journey, and the lessons learnt along the way about paradigms and the need for the inclusion of an Indigenous evaluation paradigm in any evaluation taxonomy. She emphasized on the need for evaluators to include Indigenous knowledge in evaluation and acknowledge the importance of Indigenous evaluation methodologies in the hope that evaluation will not only be evaluation but evaluation in service of Indigenous peoples.
1 Comment
Fiona Cram shares about some of her experiences at the American Evaluation Association Conference, Portland Oregon, 21-26 October 2024 I arrived ready for the AEA Conference on Wednesday 23 October, and it began at 2:30pm with a welcome, awards ceremony, and opening plenary. This opening plenary was a tribute to our beloved colleague, Ricardo Millett who had passed away. It was entitled ‘Learning from the Life and Legacy of Ricardo Millett: Mentor, Scholar, Field Builder’ and included tributes from David Chavis, Rodney Hopson, Maria Montenegro and other friends and colleagues of Ricardo. He will be much missed. I then went to the session on ‘Engaging Youth as Leaders as DRG & Evaluative Practice: Cross-TIG, Cross-Cultural & MultiLinguistic Lessons Learned in the U.S. and African Contexts to Amplify and Empower Youth Voices in Evaluation.’ EvalIndigenous member Dr Awuor Ponge spoke on behalf of AfrEA, and was joined by Ian Hopwood, Denise Baer, Safyatou Diallo and others. They all spoke with passion about the importance of investing in the capacity of young and emerging evaluators (YEEs). These YEEs are and will be the innovators and change-makers in our field I presented on Thursday afternoon on behalf of Phuntsho Choden, in a roundtable session entitled ‘How do we evaluate the contribution of development initiatives to Gross National Happiness (GNH)’. Phuntsho and I have been talking together for the past 5-6 years. The AEA conference was a great opportunity to catch people up with the development of the Wholesome Evaluation (WE) framework from Bhutan, to get their feedback, and to pick their brains about the outcomes for the GNH Domains and the WE principles. I am very grateful for people’s feedback. Friday’s plenary was ‘Participatory MEL and MEL Tech – Friends or Frenemies’. EvalIndigenous member Eddah Kanini spoke about the importance of not further marginalising those whose voices are already silenced or who are considered ‘hard-to-reach’. This includes those with hearing and vision impairments, and other disabilities, who may be sidelined by the use of MEL tech technologies in evaluation. She is a passionate advocate who understands the advantages that MEL brings to evaluation, but who is able to balance this with words of caution about missing people out. EvalIndigenous members Dr Ponge and Grace Wanjiru Murigo presented their work on ‘Amplifying and Empowering Voices of the Indigenous Communities in Evaluation in Kenya: Case of the Indigenous Ogiek and the Mijikenda of Kenya.’ It was good to see them present at AEA and their paper was well-received. Another standout panel on Friday was a panel that included EvalIndigenous member Gladys Rowe, along with Natalie Nicholson, Pearl Walker-Swaney, Millicent Simenson (via video clips) and Roxanne Johnson from Mewinzha Ondaadiziike Wiigaming. Their session, entitled ‘Crafting an Anishinaabe Evaluation Framework: Co-Creation, Iteration, and Community Alignment in Evaluation Practices’, provided wonderful insights into the provision of tribal health services that are of the community and what this then means for culturally responsive evaluation. I presented with my wonderful colleagues Joan LaFrance, Pālama Lee and Kathy Tibbetts on Friday afternoon. Our session on ‘Lifting the Voices of ʻĀina (Land, Sky, Ocean) in Evaluation: Three Indigenous Perspectives’ reflected on our relations – the Land, Sky and Ocean – and how we need to include them in our evaluation if our work is to be in the service of decolonisation. My many thanks for those who attended this session for your attentiveness and ensuring our session was well held in ceremony.
On Saturday morning I attended Monique Liston and Drew Koleros, about ‘The Evaluative Power Fellowship Model: Demonstrating Dignity-based Data Collection to Empower and Amplify Voices in Evaluation’. This was a powerful session about the importance of engaging with community housing advocates to build’ social movements’ power while ensuring completeness and fidelity in our data collection process.’ The finale of the conference was Saturday’s plenary by Bagele Chilisa, ‘Breaking the Echo Chamber: Amplifying Marginalized Voices to Resonate with the Dominant Narrative.’ This did not disappoint. Bagele shared story about her academic journey and the lessons she learned along the way about paradigms and the need for the inclusion of an Indigenous evaluation paradigm in any evaluation taxonomy. She encouraged us to include Indigenous knowledge in our evaluation and acknowledge the importance of Indigenous evaluation methodologies. She uplifted us and left us feeling hopeful that the messages she shared will help ensure that evaluation is in the service of Indigenous peoples. As always, this conference was about the opportunities to catch up with old friends, to meet new colleagues, to eat together, and to hear messages of provocation, encouragement and resistance. Dr Ponge also ended on a note of thanks from AfrEA and an invitation to the next AfrEA conference. Kia ora koutou – greetings to you all.
My participation at the Australian Evaluation Society (AES) 2024 Conference in Melbourne /Naarm, Australia, 17 – 20 September 2024, was made possible through the generous support from the EvalIndigenous Global Network, through the support from EvalPartners and the International Organization for Collaboration in Evaluation (IOCE). Additional support for conference registration was obtained from AES and from Katoa Limited.
The first Keynote address at the AES 2024 International Evaluation Conference in Melbourne, was delivered by June Oscar AO, a proud Bunuba woman from Fitzroy Crossing in Western Australia's Kimberley region. She is the Inaugural Chair of The Wiyi Yani U Thangani Institute for First Nations Gender Justice. June Oscar is known for her work on First Nations gender justice and women's voices. Her keynote address was titled: “Re-imagining evaluation with a gender justice lens." Her address touched on themes related to Indigenous rights, gender equality, and the importance of incorporating First Nations perspectives in evaluation practices. She shared the voices of the women from First Nations women whom she had spoken to during her term as Aboriginal and Torres Strait Islander Social Justice Commissioner. Some of the notable quotes include:
The second keynote address was delivered by Prof. James Copestake. He is a Professor of International Development at the University of Bath in the UK. He has background in international development and evaluation. Prof. Copestake addressed two key points: promoting useful forward-looking evaluative practice, and exploring examples of forward-looking evaluative practice. He then made suggestions on specific approaches for forward-looking evaluation that included increased use of causal mapping and more backcasting. He argues for a shift towards more forward-looking evaluative practices that integrate anticipation and backcasting into evaluation processes. He also emphasised the need for evaluators to adopt a transformational role, moving beyond conventional methods that focus primarily on past outcomes. Ultimately, Prof. Copestake advocates for a more inclusive and anticipatory evaluative practice that can inspire radical change and enhance the impact of evaluations on public action. His keynote address also touched on themes related to impact evaluation, mixed methods approaches; and the Qualitative Impact Protocol (QuIP) which he has worked on extensively.
The other paper in the session where I presented was by Steven Legg, Associate Director, NSW Treasury and Eugenia Marembo, a NSW Treasury, Senior Analyst, First Nations Economic Wellbeing. Their presentation was titled: “Culturally Responsive Initiatives: Introducing the First Nations Investment Framework.” In their presentation, they argued that there is a need for practical guidance to improve capability across the sector in evaluating and implementing initiatives that impact First Nations people and communities. They mentioned that the First Nations Investment Framework had been developed to address this need. The framework provides structured guidance across several key areas, including foundations for genuine relationships, partnership for shared decision-making, community-led design, data collection and analysis, and transparency and accountability. They concluded their presentation by asserting that implementing culturally responsive approaches can lead to tangible positive impacts for First Nations people and communities. I attended a presentation by Dr. Sandra Ayoo and Stacy Huff titled: “Evaluating Meta-Evaluations: Addressing Social Justice in Program Evaluation.” The presentation focused on the importance of integrating social justice into program evaluation, particularly through the lens of meta-evaluation. It highlighted the current lack of consensus on standards for conducting meta-evaluations and emphasised that addressing social justice is context-dependent rather than based on fixed guidelines. The findings shared advocate for evaluators to prioritise social justice in their designs and methodologies, while also selecting quality assurance tools that align with their specific evaluation contexts. The presentation underscored the shared commitment of organisations like the United Nations and the American Evaluation Association (AEA) to enhance evaluation quality by embedding social justice considerations throughout the evaluation process, aiming to ensure that evaluations benefit both individuals and society at large. On Day 2 of the Conference, Thursday, 19 September 2024, the first Keynote address was delivered by Elizabeth Hoffecker. The presentation was titled: “Wayfinding Tools for Learning and Evaluation in Complex Systems.” The presenter talked of the context for a systems-aware evaluation, mentioned the key systems components as: elements – whether living or non-living, relationships and purpose and function. She also talked of the need for capacity development – which is a learning-focused activity and research. The presenter then addressed the navigational strategies and tools for systems-aware evaluation. The strategies included:
Dr. Ellie Taylor and Ellen Hays made a presentation titled: "Nothing about us, without us": Developing evaluation framework alongside victim-survivors of modern slavery using representative participatory approaches.” The presentation outlined the development and implementation of an evaluation framework for the Lived Experience Engagement Program (LEEP), which aims to involve survivors of modern slavery in shaping policies and responses to this issue. Using a representative participatory action research approach, the evaluation sought to understand the program's impact on stakeholders, particularly survivors, while adhering to principles of trauma-informed, strengths-based, and culturally safe practices. Key findings highlighted the program's success in facilitating survivors' transition from lived experience to lived expertise, increasing confidence, fostering peer connections, and developing knowledge and skills. The evaluation process itself emphasised sustainability, fairness, and respect for human rights principles, while allowing for iterative improvements and the integration of diverse perspectives from survivors, staff, and government stakeholders. On Day 3 of the Conference, on Friday, 20 September 2024, the keynote address was delivered by Indy Joharon the topic: “Addressing transitions through risk and uncertainties.” Indy is a celebrated personality, who is a RIBA register architect, serial social entrepreneur, and Good Growth Advisor to the Mayor of London, UK. He is a co-founder of Dark Matter Labs and of the RIBA award winning architecture and urban practice Architecture00. Indy emphasised the need for large-scale, systemic transitions to address planetary-scale challenges. He argues that we're moving from small experiments to "micro-massive" swarms of interventions happening simultaneously. He therefore concluded his speech by advocating for the development of new capabilities to build and coordinate these distributed interventions, rather than relying on top-down, centralised approaches. Mitchell Rice-Brading, a Consultant with ARTD Consulting Australia made a presentation titled: “Involving children and young people in evaluations: Equity through active participation” The presentation addressed three key issues regarding involving children and young people in evaluations. It explored the ethical considerations of balancing risks and rights, emphasising the tension between protecting children from unnecessary risks and respecting their right to participate in matters affecting them. The importance of careful ethical protocols and informed consent was equally highlighted. The presentation also discussed recruitment challenges, including obtaining approvals, limited participant pools, and low confidence among potential participants, while suggesting strategies for strong engagement and obtaining consent. Lastly, it outlined the approaches to data collection and engagement, emphasising person-centered and strengths-based principles. This presentation provided practical suggestions for age-appropriate data collection methods, such as focus groups, adapted surveys, and interactive activities, while stressing the importance of making participants feel comfortable and addressing power imbalances. Julian King and Adrian Field made a presentation titled: “Evaluation and Value for Money – Value propositions: clearing the path from theory of change to rubrics.” The presentation discussed key issues related to value propositions in program evaluation. It touched on the distinction between impact and value, emphasising that a theory of change should explicitly address value creation. Impact refers to changes caused by a program, while value relates to what matters to different stakeholders. It also discussed the usefulness of value propositions in bridging the gap between theories of change and evaluation rubrics. They mentioned that by articulating to whom a program is valuable and in what ways, value propositions add depth to theories of change and facilitate the development of clearer evaluation criteria. Lastly, they highlighted the process of developing a value proposition, which involves answering questions about stakeholders, resource investments, ways of working, equity considerations, and factors affecting value creation. This approach helps evaluators define context-specific aspects of good resource use and value creation, leading to more meaningful evaluation criteria. The closing keynote address was delivered by John Gargani. He is the President of Gargani + Company and a former President of the American Evaluation Association (AEA). His areas of expertise include impact evaluation, scaling impact, value for money, and the use of AI in evaluation. His address was titled: “Finding our way to the future profession of evaluation”. His address focused on impact evaluation and scaling impact. He discussed how evaluators will need to focus more on assessing and helping scale the impact of programs and innovations; the need for integration of AI and technology in evaluation practice and developing new methods for evaluating "value for money" from multiple perspectives and more nuanced ways of assessing value beyond just monetary measures. He also argued that quantitative methods can deepen qualitative understanding of impacts, thereby stressing on the importance of continued use of mixed method approaches in evaluation. At the close of the event, by AES President Kiri Parata, the 2024 Conference Organising Committee officially handed over to the next Conference Organising Committee for aes25 to be held in the Australian Capital City of Canberra / Ngambri. All in all, this was a wonderful event full of learning in the ever-evolving field of evaluation practice! Canberra 2025, here we come!
Attending the Indigenous Evaluation Gathering and Canadian Evaluation Society Conference 2024 (CES 24) from May 4th to 8th in Fredericton, New Brunswick, Canada, was an exceptional experience. Organized by EvalIndigenous, the Canadian Evaluation Society, and the Atlantic Indigenous Evaluation Stewardship Circle, the event offered unique opportunities to engage with Indigenous communities and evaluation professionals.
One of the highlights was participating in a Sweat Lodge ceremony led by a First Nation Chief. It was a deeply spiritual and novel experience. This event underscored the communal sharing of experiences, joy, sorrow, and reverence for ancestors. The Indigenous Gathering provided a platform for sharing personal journeys and organizational roles in Indigenous evaluations. Hearing firsthand accounts from North American Indigenous evaluators broadened my understanding and highlighted the challenges they face, offering a comparative perspective to the Asia Pacific Region. The conference featured diverse sessions, including presentations, experience sharing sessions, nature walks, indigenous cultural events and acted as a great platform for networking. Alongside my colleagues from Asia Pacific Evaluation Association, we presented EvalIndigenous initiatives and the Toolkit for Indigenous Evaluations in the Asia Pacific in the conference. Sharing our work and engaging in discussions during the Q&A session was gratifying, highlighting the impact and appreciation from an international audience. In conclusion, the Indigenous Evaluation Gathering and CES 24 were not just conferences but transformative experiences. They provided unparalleled networking opportunities, a chance to showcase our own efforts, and a rich learning environment. I extend my heartfelt gratitude to EvalIndigenous for this valuable opportunity, which has significantly enriched my professional and personal journey. I am grateful for the support given by EvalIndigenous for me to attend the Indigenous Evaluation
Gathering and the Canadian Evaluation Society (CES) Conference at Fredericton, New Brunswick, Canada from May 3rd 2024 to May 9th, 2024. Our team members from Asia Pacific Evaluation Association (APEA) had the honour of presenting at the CES Conference for the session titled “Amplifying Indigenous V oices: Advancing Equity and Inclusion in Evaluation Practices.” During this session, the APEA team presented the Toolkit for Indigenous Evaluations in the Asia Pacific Region and on the seed grant projects supported by EvalIndigenous. Also, attending the Indigenous Evaluation Gathering was a life-changing experience for my personal & professional life. It opened my eye and broaden my knowledge on self-love, appreciation, gratefulness & mindfulness. Also, it further deepened my appreciation for the resilience, knowledge, and strength of Indigenous communities. Seeing their commitment to preserving and revitalizing nature, their cultures and languages & practices was incredibly a remarkable experience. Therefore, I learned that as evaluators we need to respect their cultural beliefs, practices, while working with indigenous communities regardless of their origin, social & economical background. Finally, I am thankful & grateful for all those beautiful new friends I met & the new connections I made during the conference. Celeste GhianoArgentina. Past-President of ReLAC Los pasados 4 al 8 de mayo de 2024, varios colegas de la comunidad hemos tenido la maravillosa oportunidad de experimentar otra forma de aprender e intercambiar sobre las capacidades en evaluación pero también sobre las capacidades de aplicación de esos conocimientos en el territorio, y adaptados a las necesidades y contextos. Iniciamos los días 4 y 5 reuniéndonos entre ritos y ceremonias, con la Comunidad Sitansik Wolastoqiyik (St. Mary’s) First Nation, para compartirnos muy generosamente su “modo de ser y estar en el mundo”. Nunca dejo de sorprenderme sobre la cantidad de modos en que aun podemos entender y entonces transformar los procesos evaluativos para que sean realmente legítimos y útiles para las comunidades en las que queremos contribuir a transformar. El recorrido inició con una verdadera inmersión en la perspectiva de esta comunidad a través de la participación en una Sweat Lodge, que con otros nombres también se realiza en otras comunidades de diferentes latitudes del mundo (en Latinoamérica la llamamos Temazcal). Limpiar (el espíritu, la mente, el cuerpo), sanar, reconciliar, pedir, perdonar, y ser conscientes de todas nuestras relaciones (no solo con seres humanos, sino con la naturaleza, otros seres, etc). Continuamos con ceremonias donde el fuego siempre estuvo presente, así como el agua, en el marco del Rio Saint John – originalmente río Wolastoq- para recordarnos que “todos estamos conectados”, como las arterias y las venas. Tuvimos la posibilidad de utilizar todos los sentidos, si, también nuestras manos elaborando tambores, como los instrumentos que nos conectan con nuestros ancestros y llaman a los espíritus para acompañarnos. Sin importar cuáles eran nuestras diferentes – pero allí conectadas- creencias. También vivimos en carne propia el marchar, en el marco del Red Day Dress, un recordatorio y reclamo por las vidas perdidas de mujeres indígenas luchadoras. Es indescriptible la fuerza que allí se sentía, lo más parecido a una madre dando a luz, y la compañía de todas esas mujeres que aún están muy presentes. Con todas estas experiencias en la piel, en la mente, en el corazón comenzamos a transitar la Conferencia de la Sociedad Canadiense de Evaluación, no casualmente este año llamada “Renewal and Confluence: Navigating the future of Evaluation” . Un grupo de unas 30 personas pudimos asistir, intercambiar, dialogar y también confrontar algunas perspectivas tradicionales de evaluación, ofreciendo una mirada culturalmente responsiva desde las propuestas de los pueblos ancestrales pero también desde la protección contra la todavía persistente discriminación por raza y etnia, en un increíble evento con unas 500 personas de diferentes latitudes y pertenencias. Cerramos la semana produciendo nuestra Declaración para una Evaluación Indígena sentida y útil, entendiendo que nuestro propio proceso evaluativo es una ofrenda. Soy una promotora muy insistente sobre la necesidad de cambiar los modos en que transmitimos los conocimientos y experiencias. Hemos sido pioneros en la Conferencia ReLAC 2022 realizando rituales para ofrecer y compartir los saberes en el campo de la evaluación, buscando generar consciencia sobre la legitimidad y uso de nuestras evaluaciones. Lo hemos comprobado también en el intercambio en la Conferencia AfrEA 2024 (vinculando saberes entre Latinoamérica y África). Regreso de Canadá con la convicción de que aprendemos con los sentidos. Los míos regresan completos y listos para seguir transmitiendo de este modo para crecer colectiva y solidariamente, con la seguridad de que, así, seguimos todos conectados… NOTA: Especiales gracias a nuestros guías Fiona Cram y Serge Eric Yakeu-Dijam y nuestra anfitriona Andraealisa Belzer por la oportunidad.
Randika De Mel, Manager of Asia Pacific Evaluation AssociationDAY 1 I took part in the session “A Picture is Worth 1000 Words: Intro to photo Elicitation on for Evaluation Planning, Data Collection, and Reflective Practices” by Maya Lefkowich and Jennica Nichols. This is a new art-based method I learnt on how to use pictures to gather stories during interviews and FGDs. I hope to use this new innovative method in order to gather stories during data collection.
I also learnt that behind each individual there is a life story and the importance of building a relationship with your interviewee. Further, through this workshop I learnt the importance of listening, respect, and patience when gathering stories. DAY 2 I was one of the presenters with my teammates from APEA on the session titled “Amplifying Indigenous Voices: Advancing Equity and Inclusion in Evaluation Practices.” This session was held on Tuesday, May 7th at 2.00 PM Canadian time. Around 25 participants took part in this session. The moderator and presenters for the session were as follows:
In this session, we explained that to capture the key learnings from these activities, a toolkit on Indigenous evaluations specifically for the Asia Pacific region was developed to serve as a practical guide that consolidates the existing knowledge and experiences of selected Indigenous communities and evaluators working with Indigenous communities in Asia Pacific and as an advocacy tool that seeks to promote culturally responsive evaluations in the region. The main aim of this session was to amplify Indigenous evaluation project practices by bringing together Indigenous knowledge holders and Indigenous evaluators and global national evaluation systems and policies to increasingly recognize and support Indigenous. During my presentations, I spoke about the five lessons from the data gathered from Indigenous knowledge holders and evaluators in the Asia Pacific Region: ● Lesson 1: Honor and respect the cultural traditions and norms of the Indigenous community ● Lesson 2. Secure approval and consent from key stakeholders before the start of an evaluation or research ● Lesson 3. Plan to involve the community in the evaluation process ● Lesson 4. Decolonize evaluation/research approaches and methodologies ● Lesson 5. Engage Indigenous communities in the dissemination of evaluation findings During the Q&A session with the audience, we discussed the importance of respect and building the relationship and trust when working with the Indigenous community. Also, we discussed the importance of sharing our interview questions and survey questions in order to get their feedback to ensure the data collection tools are culturally appropriate before the start of the study. DAY 3 During the plenary session, on “Questioning and Navigating Ethics in Evaluation,” I was able to learn about the code of ethics standards developed by CES and reflect on how I can use it in my evaluation work. Additionally, I was able to observe similarities between the CES code of ethics and the APEA code of ethics for evaluation that was developed for evaluators in the Asia Pacific Region.
Conferencia de la Sociedad Canadiense de Evaluación(CES) 2024: de los territorios a la práctica.6/6/2024 La propia presentación de la Conferencia, fue un preámbulo de lo que estaba por venir: C2024 Fredericton – Eqpahak Renewal and Confluence: Navigating the future of Evaluation. Presentación que incluye en el propio nombre del evento una palabra, que más que un vocablo, es una forma de reconocer el espacio habitado, y con ello los saberes y las personas que lo conforman. Eqpahak significa "donde las aguas dejan de entrar", solamente esa palabra marcó la diferencia. Desde el primer momento pude entender donde estábamos y que este lugar donde las aguas ya no entran, es una forma de comprender la vida. Las palabras son importantes. La variedad y riqueza de contenido de los paneles y actividades, empezando por ceremonias indígenas junto al río y o el fuego, hasta experiencias ancestrales como la Cabaña de Sudor, fueron la introducción perfecta para el cuerpo y la mente de cara a una semana de aprendizajes y conocimientos compartidos. Durante los 3 días de la Conferencia, se abordaron numerosos temas y experiencias evaluativas desde diversas perspectivas, destacando los desafíos enfrentados en el quehacer evaluativo y también analizando enfoques transformadores, tanto teóricos como metodológicos. A partir de esta idea, quisiera plantear dos de mis aprendizajes. África, Asia Pacífico y América: Distintas Regiones Hallazgos Comunes.
Si bien los aprendizajes son muchísimos, creo que, a partir de estas dos ideas particulares se evidencia cómo, a través del ejemplo de una comunidad de evaluación, es posible afianzar las convicciones sobre el camino andado y sobre la ruta hacia el futuro, porque además del conocimiento adquirido, el ambiente de compañerismo y camaradería fue excepcional, haciéndome sentir valorada y con un sentido de pertenencia, a pesar de ser la primera vez que nos veíamos y la primera vez en ese territorio. Replicando lo aprendidoMi conciencia como mujer evaluadora mestiza aumentó, derivando en un mayor entendimiento y conocimiento sobre prácticas de evaluación integrales y en los primeros acercamientos a las formas en las que es posible ir uniendo y fusionando epistemologías y metodologías. Experiencia que sin duda ha fortalecido mis capacidades para asumir retos evaluativos desde una perspectiva amplia y respetuosa.
Lo maravilloso de este conocimiento es que cada una de las personas que estuvimos ahí llevamos con nosotros y nosotras estos aprendizajes y con él la posibilidad de compartirlo en el entorno y contexto de nuestros países y regiones, es decir son aprendizajes que serán replicados alrededor del mundo aumentando exponencialmente su alcance. En mi caso a través de las VOPES de las que formo parte: Relac, RedEvalCR y EvalYouth CR, espacios valiosos para la réplica y multiplicación de lo aprendido, e inclusive nos permite pensar en otro tipo de lugares compartidos entre países de la región. Para concluir, quisiera hacerlo con la idea que estos aprendizajes son posibles gracias al intercambio entre personas de forma presencial y a las actividades que se salen de los espacios tradicionales y nos ponen en contacto directo con la tierra. Es mi deseo que este texto sirva como estímulo para que se animen a participar de la próxima conferencia y sean parte de esta hermosa reunión, aprovechando la oportunidad de experimentarlo en primera persona.
It was a wonderful experience taking part in the Canadian Evaluation Society (CES) Conference 2024 held in the beautiful city of Fredericton that boasts of the nick-name Eqpahak. The Maliseet word 'Eqpahak' means 'the place where the tide stops.’ The Wolastoqiyik (Maliseet) who are the indigenous peoples in Canada stay along the Saint John River Valley, which goes by the name Wolastoq, meaning “the beautiful and bounteous river” in the Maliseet language, while Wolastoqiyik means “the People of the Beautiful River”. The Wolastoqey Nation are members of the Wabanaki Confederacy, (People of the Dawn). It was great learning all this beautiful history so as to be able to derive similarities with the histories of the indigenous people of Africa. This was my fifth visit to Canada and each time I’m mesmerised by the acknowledgment of the owners of the lands on which events take place. I have been to Ottawa, Halifax, Vancouver, Quebec City and this time round in Fredericton, the capital city of the Canadian Province of New Brunswick. Before the start of every speech or event, the speakers had to acknowledge the owners of the land. In her opening greetings to the participants to the Conference, Andrealisa Belzer, the President of CES had this to say: “The Canadian Evaluation Society is grateful to Sakom (Chief) Polchies of Sitansik (St. Mary’s First Nation) for welcoming us to convene in Eqpahak (Fredericton) on the beautiful and bountiful Wolastoq (St. John`s) river on the traditional lands of the Maliseet-Passamaquoddy speaking peoples of the Wolastoqiyik (Maliseet) and Wabanaki (Dawnland Confederacy) Communities. We acknowledge that this territory, and all of New Brunswick, are covered by Peace and Friendship Treaties which recognized Wolastoqiyik (Maliseet), Mi’kmaq and Passamaquoddy title and established the rules for what was to be an ongoing relationship between nations.” It was worth noting that the President of CES, Andrealisa Belzer, who incidentally works for Indigenous Services Canada, has been at the forefront in working for a close collaboration with indigenous Canadians and the global indigenous community, which has seen a working relationship between the CES and the EvalIndigenous Global Network. The first of such was seen in Halifax, Nova Scotia during a CES Conference in 2019 and this had gained momentum to the climax at the Fredericton event. As a pre-conference event, EvalIndigenous and CES organised an Indigenous event that started with the indigenous healing experience of the ‘Sweat Lodge’ which was held at the St. Mary’s First Nation and conducted by Chris Brooks. This was a wonderful endurance and healing experience that made one literally connect with the Creator and the Earth. At one of the endurance sessions, I was overwhelmed and had to ask to be allowed out briefly. But this was certainly an experience never to be forgotten. On Sunday, 5 May 2024, being the second day of the pre-Conference was a mix of activities, starting with an EvaIndigenous gathering to share some of the works done by the Network through the support of Ford Foundation among others. The next activity was a match of the global indigenous community in solidarity with the indigenous Canadians, to celebrate the Red Dress Day in commemoration of the Missing and Murdered Indigenous Women and Girls (MMIWG) and to create space for their loved ones to heal, with a message of ‘Missing but never forgotten’ and with an overall call for the provincial and federal governments to provide more support for First Nations banishing individuals. I was privileged to be part of this historic event, with the match from the Legislature of Fredericton to the Hidden Burial Ground which marked the climax of the event. The Sakom (Chief) Allan Polchies Jr., Chief of St. Mary's First Nation and one of the six Wolastoqey chiefs had this to say: “We no longer need a Band-Aid. We need a solution, we need legislation, and we need a law. That's what we need as Indigenous people.” The Conference was officially opened on the evening of Sunday 5 May 2024, with an opening reception addressed by the leadership of CES as well as the Sakom (Chief) himself, Allan Polchies Jr. On Monday, 6 May 2024, having been inspired by the Sweat Lodge experience, I made a presentation dubbed: “The Knots that Bind Us Together… The Confluencing Value in Evaluation Practice: Lessons Learned from the Wolastoqey Sweat Lodge Ceremony.” In my presentation, I highlighted the key similarities between the Canadian Sweat Lodge experience and the indigenous African similar healing experience. Of importance, the following stood out:
On Tuesday, 7 May 2024, I made a presentation on: “Global Perspective of Indigenous EvaluationPractice: Lessons Learned from the Kenyan Experience”, in which I shared some of the work that I have done as part of EvalIndigenous funded activities. These were:
On Wednesday, 8 May 2024, I made a presentation on: “Navigating Choppy Waters in Indigenous Evaluation in Kenya: Case of the Indigenous Ogiek and the Mijikenda of Kenya – Promoting a Culture of Respect, Collaboration and Learning Together.” This was to be a joint presentation with my Mentee, Grace Wanjiru Murigo, who unfortunately was unable to get a VISA to travel to Canada, in what is emerging as a systemic racist attitude of the Canadian Government to deny VISAs to Africans, Asians and Latin Americans. Our presentation was drawn from two studies we conducted among the indigenous communities in Kenya namely the Ogiek and the Mijikenda. The studies were funded by the Ford Foundation under the auspices of the EvalIndigenous Global Network. The presentation discussed the complexities and challenges involved in conducting evaluations or assessments within indigenous communities in Kenya, using the Ogiek and Mijikenda groups as case studies. The concluding message of navigating the choppy waters was that the Indigenous communities have distinct cultural beliefs, practices, and worldviews that differ significantly from mainstream society or Western evaluation frameworks. Evaluators need to be sensitive to these cultural contexts and adapt their approaches accordingly. At the conclusion of the 5-day packed event, on Wednesday 8 May 2024, there was a concluding Indigenous Evaluation gathering called by the leadership of the EvalIndigenous Global Network, Dr. Fiona Cram and Serge Eric Yakeu-Djiam and the CES President, Andrealisa Belzer, with a view to come up with the ‘Wolastoq Declaration’. The participants gathered in the afternoon after the closure of the CES Conference in Fredericton to share their learnings and take-aways and to lay the foundation for a declaration in honour of the Wolastoq river, which was our host for this gathering.
Randika De MelManager of Asia Pacific Evaluation Association Through the generous support of EvalIndigenous, I was able to attend the Indigenous Evaluation Gathering organized by EvalIndigenous, the Canadian Evaluation Society and the Atlantic Indigenous Evaluation Stewardship Circle and I was able to attend the Canadian Evaluation Society (CES) Conference at Fredericton, New Brunswick, Canada from May 3rd 2024 to May 9th, 2024. This post outlines the key learnings and highlights from my participation at the Indigenous Evaluation Gathering. Day 1. 4 May 2024Personally, for me to take part in the sweat lodge ceremony with the First Nations people was a rewarding experience. This experience helped me learn about the cultural practices of the First Nations people and the importance of the sweat lodge ceremony is for them. Furthermore, during the sweat lodge ceremony, I learnt about the importance of conserving the environment is for the First Nations people in Canada. Overall, the sweat lodge ceremony taught me to be patient during the extreme heart, to be mindful, and to focus on myself in my daily life. During the Indigenous gathering for dinner and stories, I learnt about the different cultural rituals and practices of the Indigenous people in Canada and also the problems they face. The problems the Indigenous people in Canada face are somewhat similar to the problems that the Indigenous people face in Sri Lanka such as land displacement, discrimination and marginalization, climate change and environmental degradation etc. Also, it was shocking and heart breaking for me to learn about the missing and murdered Indigenous women and girls in Canada. Further, during this gathering, I was able to share the work done by APEA and EvalIndigenous in the Asia Pacific Region in order to promote Indigenous evaluation practices. Day 3. 5 May 2024During the keynote speech, Fiona Cram, Co-Chair of EvalIndigenous highlighted the work undertaken by EvalIndigenous in Asia Pacific, Africa, and Latin America. I was able to learn about the work been carried out by my peers in Africa and Latin America. And the areas where APEA might be able to collaborate for learning opportunities with other regions in relation to Indigenous evaluation.
Additionally, I was able to share with other participants on the work that was conducted by APEA for the EvalIndigenous Ford Foundation grant. Especially, the participants were interested to learn about the Indigenous Evaluation toolkit developed by APEA. Moreover, I took part in the “Red Dress Day” in order to support the missing and murdered Indigenous women and girls and their families. For the “Red Dress Day,” we walked from the legislature to the Old Burial grounds at Fredericton. During this ceremony, it was sad to learn about the recently murdered Indigenous chief sister. Taking part in this march taught me that more steps and initiatives are needed to be taken to protect the lives of Indigenous women and girls in Canada. |