Skip to content
Skip to main content

About this free course

Become an OU student

Share this free course

Global challenges in practice: designing a development intervention
Global challenges in practice: designing a development intervention

Start this free course now. Just create an account and sign in. Enrol and complete the course for a free statement of participation or digital badge if available.

8 Arts-based research and evaluation that can challenge dynamics

The following video is produced by the international NGO Christian Aid and two organisations local to Guatemala, Caja Lúdica and Metáfora. It focuses on the impact of a programme that aims to bring about social transformation through the arts. As you watch, you may wish to make notes about the different effects the programme has had, and to consider to what extent do you think the video serves as an effective form of evaluation.

Download this video clip.Video player: Video 1
Copy this transcript to the clipboard
Print this transcript
Show transcript | Hide transcript
Video 1
Interactive feature not available in single page view (see it in standard view).

In this case study you can see how a particular approach and methods were chosen to suit the topic, and to challenge oppressive power relations. Christian Aid wanted to better understand the impact of their governance work in Guatemala where they were supported by two partner organisations – Metafora and Caja Ludica.

A key part of the partners’ work was to engage with policy makers to encourage the development of cultural policy and to fund the development of community cultural centres. Violence is high in areas of Guatemala, but bringing the arts to these places can disrupt the violence and encourage new conversations. There is a specific focus on young people in the project who are frequently stigmatised, excluded and the victims of violence.

To explore the impact of their work the research team wanted to capture the spirit of the project through art, focusing on amplifying marginalised voices. The research took the form of a participatory video project, with the programme participants playing an active role in deciding how to frame the research, what to film, and how to edit the film (Carrol and Newman, 2020).

Now complete the next activity.

Activity 4

Timing: Allow around 20 minutes

After watching the video, take a moment to consider the following questions:

  • What do you think of this video approach to evaluation?
  • Do you feel the film offered insights into the outcomes and impact of the project?
  • How do you think donors would respond to this type of evidence for evaluation?

Note your thoughts in the box below.

To use this interactive functionality a free OU account is required. Sign in or register.
Interactive feature not available in single page view (see it in standard view).

Discussion

The video is engaging. However, you may have wondered about the insights into impact and outcomes that it offers. What's not clear is whether the project is reducing crime (its stated aim) as well as empowering and energising young people. This is what is valued by donors. So while the video is engaging and informative, donors might not value it highly as evidence. They might, however, think it has utility for marketing and publicity.

Perhaps there is also a concern around confidentiality. You must be careful to only show the faces of those who consent to this.

Participatory and creative approaches to evaluation are unlikely to be used as the sole pillar of evaluation. They are popular with practitioners as they are inclusive, and speak to development discourse around community involvement, rights based approaches, empowerment and action research.

However, donors require more rigid methodological approaches. Consequently, the best that can often be hoped for is a mixed approach, involving both quantitative and qualitative methods.