​My participation at the Australian Evaluation Society (AES) 2024 Conference in Melbourne /Naarm, Australia, 17 – 20 September 2024, was made possible through the generous support from the EvalIndigenous Global Network, through the support from EvalPartners and the International Organization for Collaboration in Evaluation (IOCE). Additional support for conference registration was obtained from AES and from Katoa Limited.

The first Keynote address at the AES 2024 International Evaluation Conference in Melbourne, was delivered by June Oscar AO, a proud Bunuba woman from Fitzroy Crossing in Western Australia's Kimberley region. She is the Inaugural Chair of The Wiyi Yani U Thangani Institute for First Nations Gender Justice. June Oscar is known for her work on First Nations gender justice and women's voices. Her keynote address was titled: “Re-imagining evaluation with a gender justice lens." Her address touched on themes related to Indigenous rights, gender equality, and the importance of incorporating First Nations perspectives in evaluation practices. She shared the voices of the women from First Nations women whom she had spoken to during her term as Aboriginal and Torres Strait Islander Social Justice Commissioner. Some of the notable quotes include:

• "Women are the social fabric of communities and the glue that holds everything together." 
• "We are the ones that are the backbone that everyone depends on to get things done." 
• "What keeps me strong is my grandmothers. They didn't have the power to have a voice and I am bloody determined to make sure my girls have a voice.”

​The other paper in the session where I presented was by Steven Legg, Associate Director, NSW Treasury and Eugenia Marembo, a NSW Treasury, Senior Analyst, First Nations Economic Wellbeing. Their presentation was titled: “Culturally Responsive Initiatives: Introducing the First Nations Investment Framework.” In their presentation, they argued that there is a need for practical guidance to improve capability across the sector in evaluating and implementing initiatives that impact First Nations people and communities. They mentioned that the First Nations Investment Framework had been developed to address this need. The framework provides structured guidance across several key areas, including foundations for genuine relationships, partnership for shared decision-making, community-led design, data collection and analysis, and transparency and accountability. They concluded their presentation by asserting that implementing culturally responsive approaches can lead to tangible positive impacts for First Nations people and communities.

​I attended a presentation by Dr. Sandra Ayoo and Stacy Huff titled: “Evaluating Meta-Evaluations: Addressing Social Justice in Program Evaluation.” The presentation focused on the importance of integrating social justice into program evaluation, particularly through the lens of meta-evaluation. It highlighted the current lack of consensus on standards for conducting meta-evaluations and emphasised that addressing social justice is context-dependent rather than based on fixed guidelines. The findings shared advocate for evaluators to prioritise social justice in their designs and methodologies, while also selecting quality assurance tools that align with their specific evaluation contexts. The presentation underscored the shared commitment of organisations like the United Nations and the American Evaluation Association (AEA) to enhance evaluation quality by embedding social justice considerations throughout the evaluation process, aiming to ensure that evaluations benefit both individuals and society at large.

On Day 2 of the Conference, Thursday, 19 September 2024, the first Keynote address was delivered by Elizabeth Hoffecker. The presentation was titled: “Wayfinding Tools for Learning and Evaluation in Complex Systems.” The presenter talked of the context for a systems-aware evaluation, mentioned the key systems components as: elements – whether living or non-living, relationships and purpose and function. She also talked of the need for capacity development – which is a learning-focused activity and research. The presenter then addressed the navigational strategies and tools for systems-aware evaluation.  The strategies included:

• Getting the lay of the land – a systems mapping and stakeholder analysis;
• Orienting inquiry with frameworks;
• Navigating change with middle-range theory – what are the middle-level causal mechanisms?
• Probing to learn with pilots and learning questions;
• Course-correcting with reflective practice – action-learning; collaboratoive sense-making and simple After-Action-Reviews (AAR);
• Identifying Change and results at the systems level, using systems-aware methodologies such as Outcome Mapping, Outcome Harvesting and Contribution Analysis, to mention just but a few.

​Dr. Ellie Taylor and Ellen Hays made a presentation titled: "Nothing about us, without us": Developing evaluation framework alongside victim-survivors of modern slavery using representative participatory approaches.” The presentation outlined the development and implementation of an evaluation framework for the Lived Experience Engagement Program (LEEP), which aims to involve survivors of modern slavery in shaping policies and responses to this issue. Using a representative participatory action research approach, the evaluation sought to understand the program's impact on stakeholders, particularly survivors, while adhering to principles of trauma-informed, strengths-based, and culturally safe practices. Key findings highlighted the program's success in facilitating survivors' transition from lived experience to lived expertise, increasing confidence, fostering peer connections, and developing knowledge and skills. The evaluation process itself emphasised sustainability, fairness, and respect for human rights principles, while allowing for iterative improvements and the integration of diverse perspectives from survivors, staff, and government stakeholders.

​On Day 3 of the Conference, on Friday, 20 September 2024, the keynote address was delivered by Indy Joharon the topic: “Addressing transitions through risk and uncertainties.” Indy is a celebrated personality, who is a RIBA register architect, serial social entrepreneur, and Good Growth Advisor to the Mayor of London, UK. He is a co-founder of Dark Matter Labs and of the RIBA award winning architecture and urban practice Architecture00. Indy emphasised the need for large-scale, systemic transitions to address planetary-scale challenges. He argues that we're moving from small experiments to "micro-massive" swarms of interventions happening simultaneously. He therefore concluded his speech by advocating for the development of new capabilities to build and coordinate these distributed interventions, rather than relying on top-down, centralised approaches.

​Mitchell Rice-Brading, a Consultant with ARTD Consulting Australia made a presentation titled: “Involving children and young people in evaluations: Equity through active participation” The presentation addressed three key issues regarding involving children and young people in evaluations. It explored the ethical considerations of balancing risks and rights, emphasising the tension between protecting children from unnecessary risks and respecting their right to participate in matters affecting them. The importance of careful ethical protocols and informed consent was equally highlighted. The presentation also discussed recruitment challenges, including obtaining approvals, limited participant pools, and low confidence among potential participants, while suggesting strategies for strong engagement and obtaining consent. Lastly, it outlined the approaches to data collection and engagement, emphasising person-centered and strengths-based principles. This presentation provided practical suggestions for age-appropriate data collection methods, such as focus groups, adapted surveys, and interactive activities, while stressing the importance of making participants feel comfortable and addressing power imbalances.

​The closing keynote address was delivered by John Gargani. He is the President of Gargani + Company and a former President of the American Evaluation Association (AEA). His areas of expertise include impact evaluation, scaling impact, value for money, and the use of AI in evaluation. His address was titled: “Finding our way to the future profession of evaluation”. His address focused on impact evaluation and scaling impact. He discussed how evaluators will need to focus more on assessing and helping scale the impact of programs and innovations; the need for integration of AI and technology in evaluation practice and developing new methods for evaluating "value for money" from multiple perspectives and more nuanced ways of assessing value beyond just monetary measures. He also argued that quantitative methods can deepen qualitative understanding of impacts, thereby stressing on the importance of continued use of mixed method approaches in evaluation.

​At the close of the event, by AES President Kiri Parata, the 2024 Conference Organising Committee officially handed over to the next Conference Organising Committee for aes25 to be held in the Australian Capital City of Canberra / Ngambri. All in all, this was a wonderful event full of learning in the ever-evolving field of evaluation practice! Canberra 2025, here we come!

​On Saturday, 7 September 2024, we travelled to Kilifi County in the Coastal region of Kenya to complete our study on the Mijikenda Kayas. The Study was titled: ‘Traditional Decision-Making as Evaluation: Developing Indigenous Evaluation Methodologies with Kenyan Communities’ and was part of the second phase of the Ford Foundation funding for EvalIndigenous Global Network through the International Organization for Collaboration in Evaluation (IOCE).

​The Chenda Chenda 2024 Celebrations at Kaya Fungo Giriama represented a mix of cultural pride, environmental awareness, and community challenges, reflecting the multi-faceted nature of contemporary Mijikenda society, while still retaining the indigenous nature of the society. The celebrations were marked by several significant highlights. The Chenda Chenda festival is usually held annually on September 9 (Nine-Nine or Kenda Kenda in Kiswahili, Chenda Chenda in Mijikenda, representing the nine tribes oof the Mijikenda) is a crucial event for the Mijikenda community. It serves as a platform to celebrate and preserve the rich cultural heritage of the nine Mijikenda tribes. The nine Mijikenda tribes are: Chonyi, Duruma, Digo, Giriama, Jibana, Kambe, Kauma, Rabai and Ribe.

​The theme for the 2024 festival was "Our Culture is Our Pillar". This theme was chosen to emphasize the importance of cultural values and to address the concern that many youths are not familiar with their cultural roots. The festival aimed to educate younger generations about their heritage and traditions. A key highlight of the 2024 celebrations was the focus on environmental conservation. The Kaya elders had set a goal to plant 20 million trees, though they managed to plant 10 million. This initiative was part of their efforts to raise awareness about climate change and the importance of environmental preservation.

In the lead-up to the 2024 festival, there were strong calls for unity within the Mijikenda community. This emphasis on unity was particularly significant as there had been attempts by some leaders to organize parallel festivals, which the Kaya elders strongly discouraged. Unfortunately, the 2024 celebrations were not without controversy. Some chaos erupted during the festival, with political rifts overshadowing the cultural celebrations. This underscores the complex interplay between cultural events and political dynamics in the region.

​The Chenda Chenda celebrations demonstrated traditional decision-making as part of evaluation processes. The festival was spearheaded by the Coastal Kaya elders, who used the occasion to address crucial issues and outline plans for regional development. This reflects the traditional role of elders in community decision-making and planning.

​The celebrations aimed to bring together the nine Mijikenda sub-tribes, fostering unity. This reflects traditional methods of using cultural gatherings to evaluate inter-tribal relationships and make decisions about cooperation. Trees were planted as part of the festival, showing how traditional events are used to evaluate environmental needs and make decisions about conservation efforts.