D4: How to evaluate new housing engagement projects (Part 2)

Biblical/Practical Intro

Luke 19:1-10 Jesus’ encounter with Zacchaeus

But Zacchaeus stood up and said to the Lord, ‘Look, Lord! Here and now I give half of my possessions to the poor, and if I have cheated anybody out of anything, I will pay back four times the amount.’ Jesus said to him, ‘Today salvation has come to this house…’ Luke 19:8-9 NIVUK

Mark 10:17-31 Jesus’ encounter with the Rich Young Ruler

Jesus looked at him and loved him. ‘One thing you lack,’ he said. ‘Go, sell everything you have and give to the poor, and you will have treasure in heaven. Then come, follow me.’ At this the man’s face fell. He went away sad, because he had great wealth. Mark 10:21-22 NIVUK

Luke 10:1-24 Jesus sending out the 72 and evaluating their experience

The seventy-two returned with joy and said, ‘Lord, even the demons submit to us in your name.’ He replied, ‘I saw Satan fall like lightning from heaven.’ Luke 10:17-18 NIVUK

At a glance

Gather both quantitative and qualitative data for a fuller picture of the missional engagement.
In planning and evaluating, be clear by using specialist and agreed terms.
Measure impact using social impact measuring tools.
If ‘church’ is a desired outcome, explore what is meant by the term and what it may look like on a new estate with those not from churched backgrounds.

Key Points

Quantitative versus Qualitative Data

The first issue to address is the use of quantitative and qualitative research methods in order to access the data you require. It can be easy to rely on a quantitative approach as that generates numbers that seem factual and solid. However, this can mean reducing the missional engagement that is happening on the estate to how many people attend a defined ‘church’ gathering or who have become Christians. This can assume a Christendom model of church that may not be culturally relevant to the context and may ignore many ways in which the community as a whole and individuals within it may be undergoing transformation. Qualitative data captures the breadth and complexity of the new housing engagement but can be difficult to analyse and lack the structure needed to evaluate the effectiveness of a project. Those funding can often favour quantitative evaluation whereas those engaging on the ground favour qualitative. This can lead to misunderstanding and even suspicion on both sides.

Ali has noted ways in which the local housing association evaluates the effectiveness of community engagement. The use of a qualitative structure with the integration of numerical data helps to create a more rounded picture of what is happening. Numbers are significant but it is important to count the right things! In a culture where committing to regularly attending an activity is not the norm, measuring the number of friendships, conversations, and people who have engaged spiritually informally will be more significant than the number of people at a church gathering. 40 at a church gathering compared to 15 elsewhere might look impressive. But if the 40 are the only people on the estate with whom the team or pioneer have a relationship, compared to 300 that the team with 15 who gather have, a different picture emerges. Lythan names the importance of stories when evaluating the effectiveness of the missional engagement. Qualitative stories are essential for unpacking the truth behind the quantitative numbers.

Understanding the Language

It is helpful to understand the difference between inputs, activities, outputs, outcomes and impact – the blog in the links below simply unpacks the definitions. Using specific and agreed terms is helpful when setting up the project to reduce confusion when evaluating projects.

Measuring Impact

Those engaging in new areas will often experience transformation and know that something good is happening, but find it hard to articulate. Measuring impact using social impact measurement methodology can highlight the change that is happening within the community and within individuals. Lythan notes the importance of people making friends within the community, thus reducing isolation. ‘When I have helped people meet, I know I have done something good’. It is hard to quantify the practical or spiritual impact of such encounters. Social impact measurement can highlight a journey of change or discipleship before any measurable signs, such as baptism or attendance at faith gatherings. See the links below for ways to evaluate using social impact measurement methods.

A word about ‘church’

‘Church’ is often cited as a desired outcome from new housing engagement. Ali and John both note the complexity of this seemingly simple word. If contextually and culturally relevant ‘church’ is to be allowed to emerge in these new communities, it is important to engage with the meaning of the word. Churches that emerge amongst those with no church background are unlikely to look like inherited churches. Both John and Ali are intentionally being church on their new estate, which is as important to their missional engagement as gatherings. John states, ‘Some people think I don’t do church, but Sunday community breakfast is church and Sunday’s fun run is church’. Although churches emerging from local communities are unlikely to look like more established models of church, they will change and evolve over time. Knowing where a church is in its life cycle is helpful.

Part 1 of this guide explores the evaluation theologically.

Learning Points

Evaluating missional work is a hugely sensitive area and something that is problematic for both those being evaluated and those evaluating. It can be hurtful and damaging. An openness and willingness to listen and learn from one another is essential. Seeing evaluation as part of spiritual discernment, within a context of hearing God speak, acknowledges that mission is not simply a human activity.

Engaging With New Housing