04-06-2026
How to build a real-life theory of change from your interviews using AI:
a Causal Map 4 training session
Steve Powell, Co-founder and Director, Causal Map Ltd
Gabriele Caldas Cabral, Outreach Coordinator, Causal Map Ltd
What we will do today: explain what is causal mapping and how to do it with AI, turning your text data into a theory of change, and learn to question it. About 90 minutes, with plenty of room for your questions!
You have a stack of interviews
Interviews. Reports. Open survey answers. Pages of people telling you what changed and why.
Somewhere in there is the answer to your question. How do you get it out, in a way you can stand behind?
Hand it to the black box. shortcut 1 “ChatGPT, what does this say?” Fast and fluent, but you cannot see what it leaned on, so you cannot defend the answer.
Read it all yourself. shortcut 2 Thorough, but it does not scale. Three hundred transcripts, and you still have to show your synthesis really reflects what people said.
There is a better way.
One route from your interviews to a theory of change you can defend:
AI does the patient clerical work. You make the judgements.
Why causal mapping
Researchers have been doing causal mapping for 50 years.
You read the text and mark each causal claim as a link from one factor to another.
“The training gave me confidence, and that is why I started the business.”
This becomes training → confidence → started a business, keeping the exact quote and the source on every link.
Do that across all your interviews and the links join up into a map: your theory of change, built from what people actually said.
A link means: this person says X influenced Y.
Maybe X really did influence Y maybe, maybe not.
Twenty people saying so is not proof. It is evidence you can now weigh. Turning that evidence into a conclusion is your job, and we come back to it later.
| Cause | Effect |
|---|---|
| training | confidence |
| confidence | started a business |
| cash grant | more cash |
Anyone can do causal mapping. It is a method, not an app.
Code your text,
list each claim as cause and effect with its quote,
then draw the map, all in tools you already know.
We do not code:
People say “X made Y happen”. They rarely say how strongly. So we do not invent it.
Coding what people actually said is simpler, and that is exactly why AI can do it.
Why use AI for causal mapping
The clerk’s job: find every causal claim, attach a quote. Tireless, exhaustive, cheap.
Your job: decide the question, check the work, judge what it all means.
Humans get bored, and pay uneven attention. The AI does not.
It codes every claim across hundreds of documents, and each one traces back to the sentence it came from. So you capture everything cheaply and quickly.
DuocUC, Chile. 32 student interviews about gender in STEM, coded by AI into 251 links, with sentiment marked: blue for positive, red for negative.
INTRAC needed the big picture from a programme across 13 countries. The AI coded 5,430 causal claims into an overall map and one per country, and drafted the written analysis as a vignette. Read the case study
The workflow, three steps
Before you touch the data, write down what you want to be able to say at the end, and to whom.
Every later choice follows from that one sentence: the data you gather, the labels you use, the maps you make.
Good at yes
Not for no
Pick questions the method can serve.
You write a short instruction for the AI, like a chatbot prompt, and it codes the links for you.
The golden rule: test on a small, varied sample, see exactly where the output is wrong or thin, fix the instruction, then scale up.
And one rule you never break: every link needs a quote. Without it you cannot show your working.
However careful the coding, some links will be wrong.
If there are systematic errors, iterate the prompt until you are satisfied, then code the whole dataset.
Check them again before you analyse.
Using the Causal Map app
Your map is a theory of change you can question
Your links are not a static report. They are a living map you can question, over and over.
You ask a question by filtering. Women only. Everything downstream of training. Stack the filters and you answer a bigger question. The same data gives very different maps, each one just the result of a different question.
“What did the cash transfer lead to?” Filter to that factor, look downstream. Out comes a map of every reported consequence, with counts.
“Do women and men tell different stories?” Split the same map by group. The links each group stresses light up differently.
A pig farmer says the cash grant gave them more cash.
A wheat farmer says more cash let them buy more seed.
So cash grants lead to more seed?
No.
Two people, two stories, stitched into one that nobody told.
The safe move: keep only the sources whose own account runs all the way through.
Behind one tidy map there may still be hundreds of quotes. Does the claim hold up? Do the links really belong to the same context?
The AI can draft a source-by-source commentary on each pathway, doing only what a patient reader could. Treat it as a first draft and edit it.
A real evaluation: the Love Alliance
The official theory of change: a tidy ladder from strategies up to goals. Clear, communicable, fundable. But a ladder cannot draw a loop.
An end-term evaluation across ten African countries, with Southern Hemisphere.
We coded the narrative data for them.
176
documents: 79 country reports, 97 interview transcripts
22,000
causal claims, coded by AI
13,756
kept for the maps
No team could hand-code that and stay fresh. Every link still carries the quote it came from.
A map built from the interviews. The biggest factor, Love Alliance support for advocacy and capacity building, was cited 777 times. The story people told was “we built each other up”, which no ladder predicted.
The movement-building view. Networking is the hub, with reinforcing circles: capacity feeds peer support feeds capacity; networking enables advocacy which feeds more networking.
Partway through, a fair worry surfaced: was the programme’s advocacy provoking a backlash against key populations?
Rather than trade impressions, we put the question to the data and traced it through the 43 sources that raised it. Every account pointed the other way: the support helped communities resist backlash, none named it as the cause.
“also helping to counter the backlash against women’s rights and LGBT rights”
So what
Code “X influenced Y, with a quote”. Capture everything, capture cheaply, let AI do it. Then judge, in the open.
This is not statistical proof. It is a disciplined way to assemble evidence, weigh it transparently, and reach a conclusion you can stand behind.
No interviews yet? QualiaInterviews can gather them. It runs a chat interview that asks people what changed and why, follows up in their own words, in any language.
The answers come back as narrative text, ready to code into a map.
This is how we work at Causal Map Ltd, every day.
If you want to go from a stack of interviews to a theory of change you can defend, come and try it with us at app.causalmap.app.
hello@causalmap.app
App, free for public projects
app.causalmap.app
Knowledge garden
garden.causalmap.app
Powell and Cabral (2025) AI-assisted causal mapping: a validation study. IJSRM.
Powell, Cabral and Mishan (2025) A workflow for collecting and understanding stories at scale. Evaluation.
Powell, Copestake and Remnant (2024) Causal mapping for evaluators. Evaluation.