This is an Eval Central archive copy, find the original at evalacademy.com.

Recently, Jennica Nichols and Maya Lefkowich (of AND Implementation) hosted a Canadian Evaluation Society (CES) webinar about using art as a data collection method. The webinar was fun and interactive and included (you guessed it) hands-on examples of how to use arts-based techniques and how to modify them for an online audience. Without rehashing the entire webinar (CES members can re-watch it here: Using Art in Creative Data Collection and Evaluation), I wanted to share the most salient points and how we, here at Eval Academy and Three Hive Consulting, have and will put them to use.

Why

Arts-based techniques can be used to get audiences to open-up or explore topics that can be hard to put into words. Jennica and Maya suggested using art-based methods for exploring relational meaning. In other words, they are important when: a) exploring concepts in context is important; b) needing to make connections between two distinct ideas (e.g. how the social determinants of health may mediate a program’s impacts), or; c) exploring emotions or experiences that are hard to put into words. They also noted that arts-based methods allow for many ways of knowing, moving beyond text and words to think about how things are connected in space or time or can be represented in a tactile manner.

Arts-based methods also allow participants to make more spontaneous or out-of-the-box associations between ideas. They push us out of our comfort zones and encourage different forms of expression.

What

Arts-based data collection techniques are inherently participatory methods, involving the artist in the creation and interpretation of data. They are inductive techniques, meaning that they are meant to be used for exploring ideas or describing concepts. These techniques start with observations (the art!) then work with the participants to understand the meanings and conclusions that can be drawn from the art.

There are 5 main arts-based data collection techniques:

Literary (e.g. poetry)
Performative (e.g. interpretive dance, theatre)
Visual (e.g. pictures, collage)
Audiovisual (e.g. film, video)
Multimedia (e.g. graphic novel, art installation)

Multimethod techniques make use of two or more arts-based methods.

In the webinar, Maya and Jennica stressed that arts-based data collection techniques are not art nor art therapy, as they aim to answer specific questions and take the information outside of the data collection space to inform decisions. In arts-based data collection techniques the description or explanation of the art is used as data, rather than the art itself.

How

Like other data collection techniques, arts-based methods require consent from participants. Because participants won’t know what they’ve created and how they feel about it being used before they’ve made it, Maya and Jennica suggest obtaining consent before the data collection begins and again once it is completed. They also suggest creating a clear consent checklist to provide participants options for how their art is used, including a discussion of if/how the participant want to be credited for what they’ve created (authorship). Check out Eval Academy’s information sheets and consent forms in our tools section – they can be downloaded and modified for this! Because the narrative behind the art is what is being evaluated, it is important to present the description alongside the art.

Before diving into creating art, it is important to develop a solid foundation with the participants. Give participants permission to be silly and creative. Maya and Jennica suggested setting the tone from the beginning of the session, tell a joke and set appropriate boundaries. Discuss the purpose of the session, let participants know what is expected of them, and how the art they create will be used. Before starting the activity, provide participants with clear prompts or questions they are to focus on when creating their art and set appropriate amounts of time for each of the activities. Too much time can cause participants to become stressed about adding more details or filling the space. Consider providing visual or auditory reminders of the prompt or question during the session to re-focus participants.

Once participants have created their artwork, the important work begins. Remember, when using arts-based data collection, the narrative or description behind the art is the data we are seeking to collect. Follow up with interviews or focus groups to understand the meaning or outcomes that came from the process of creating. Ask questions to illuminate underlying connections, assumptions, values, or ideas.

After the process is complete, revisit consent with each of the participants. Check if and how they are ok with you sharing their art and the narrative that goes along with it. Be clear about how and where the information will be shared.

Organization Tips:

Make sure you have all the tools you need before your session
Don’t assume that participants have access to items such as cameras, markers, glue, or other supplies
Prepare your questions and test the timing of your activities in advance

Tips for conducting online sessions:

Consider supplying the questions and supplies in advance of the session. Mail participants packages or provide the log in information for online platforms so that people can become familiar with them in advance
Build in extra time to orient people to using the online software.
Use Zoom polls or break out rooms to encourage reflection
Consider whether to follow up in groups or one-on-one; much like deciding between a focus group and an interview, the nature of the data you wish to collect should drive your decision

How We’ve Used Art-Based Techniques

Here at Eval Academy and Three Hive Consulting, we are big fans of using creative approaches in our evaluation practice. Our core values include being creative in our work, both to engage our clients and evaluation participants, and as a way to generate new ideas.

To get un-stuck and re-imagine the evaluation experience for our clients.

Recently, we opened our annual team retreat with an activity designed to help us channel our inner four-year-old to get silly and lower our creative inhibitions. Next, we doodled our way through a visioning exercise to help us re-imagine the evaluation experience for our clients. While a small flood prevented us from completing the second half of the exercise, we gained a pretty clear picture of the barriers to evaluation our clients might face.

As part of focus-groups and workshops.

We’re also a big fan of using the At My Best strengths cards which have pictures on the front and a single word on the back to do photo-elicitation techniques. We’ve used them in workshops to get participants to open up, to help jumpstart the outcome mapping process with program funders, and with health partners to develop an approach for complex patients. Interestingly, in our experiences using these cards, in every session at least one person can’t get the idea of using the photo and must flip the card over to use the words.

To understand the impacts of a program on children.

We used visual data collection methods in a feedback session with children and youth, allowing participants to give visual and verbal feedback. Children rotated through a series of flip charts with a question posed at the top. Facilitators helped the children interpret the questions and clarified the meanings of the images. One big thing we learned at these sessions were to use washable markers with children.

How we might be using these methods in the future

In a previous article, we explored using virtual reality tools to augment evaluation, including in data collection (check out: Visual Storytelling Though Augmented and Virtual Reality) and I know we are just waiting for the right project to try this out with.

As we may not be meeting in person any time soon, we can use arts-based data collection techniques to better understand our participant’s experiences. Literary, visual and audiovisual methods can create a starting point to capture and understand participants’ stories in today’s virtual world. Because we can’t be in person to build rapport, arts-based techniques can create a common and safe starting point to explore ideas with participants.

And finally, in a recent team-building effort, we took a few hours off to play Pictionary and some other online drawing games as a team. After the fun and games, we noticed a few of us were in creative and out of the box mindsets and had a pile of new ideas. Using arts-based techniques to break out of our routines and explore new ways to approach our evaluation practice will be a trick we continue to use with our team.

Connect with AND Implementation on social media:

Instagram: @andimplementation | Twitter: @and_implement | Website: andimplementation.ca

Email Address

We respect your privacy.

Thank you!