The NFER blog

Evidence for excellence in education

Is evidence good for absolutely nothing?

2 Comments

By Ben Durbin

“What is evidence good for?  Absolutely nothing!”  This was one of the memorable moments from Campbell Collaboration CEO Howard White’s opening speech at the What Works Global Summit this week (quickly followed by the qualification: “Unless it gets into policy and practice”)

This set the tone perfectly for the conference that followed, with a rich array of sessions covering topics ranging from evaluating catch-up interventions in India to the lack of evidence supporting many non-school literacy interventions in developing countries to the challenges of ensuring major development donors embed evidence into the funding decisions.

The conference had a particular resonance for me personally.  For the past three-and-a-half years, I have led NFER’s Impact Team. As an education research foundation, we came to the same conclusion as Howard White – unless we were as successful at engaging policymakers and practitioners as we were at producing high quality research, then we would be good for nothing.

That was certainly the theory, and what followed was an iterative process of learning from others and learning by doing. In 2014 we published a literature review examining the evidence on effective approaches to mobilising knowledge for the classroom. We have worked closely with the Education Endowment Foundation (who received lots of favourable references at this week’s conference) on approaches to conceptualising and measuring research engagement, and to developing and evaluating interventions to mobilise research knowledge in schools. Through discussion with a range of stakeholders we’ve developed guidance and practical support addressing both the school-level cultural and leadership practices needed and the systemic and institutional changes required to enable a truly research-engaged education system.

We’ve also learned lessons about how to successfully influence policy with research. Many of these seem obvious, and there are lots of good examples of where these principles are followed, but this is by no means universal:

  1. Ask the right questions – what’s interesting to an academic may not also be useful to a policymaker.
  1. Engage early – don’t wait until your research is ready to publish before reaching out to policymakers and other stakeholders. Involve them in defining the problem, shaping the research questions (see 1), and throughout the life of the research (one of the conference sessions included a fascinating discussion of how DfID and the EPPI centre do this with their systematic reviews)
  1. Engage widely – map all of the stakeholders at the start of the research, focussing particularly on primary stakeholders with a direct ability to effect change (who are unlikely to move in academic circles) and the wider group an influence over them (also unlikely to be academics). Develop a differentiated strategy for how to engage each group.
  1. Communicate clearly – work hard at drawing out clear messages for policymakers, even (or especially) where these are nuanced. Communicate your findings using media suited to each stakeholder group (research summaries, practitioner toolkits, through social or traditional media).

I have now taken up a new role at NFER, as Head of International Education. My team is looking to bring NFER’s 70 year track record in high quality educational assessment, analysis, evaluation and reviews – and successful policy and practice influence – to bear in meeting global education opportunities and challenges.

I don’t know whether to be downcast or encouraged this week to realise quite how widespread the evidence challenges are, with common issues faced in all countries. But it does give me confidence that NFER has an important role to play in undertaking research that successfully engages with international policy and practice.  We’re ready to meet Howard White’s challenge.

Ben Durbin is Head of International Education at NFER. He can be contacted at b.durbin@nfer.ac.uk or via Twitter @benpdurbin

Author: thenferblog

National Foundation for Educational Research

2 thoughts on “Is evidence good for absolutely nothing?

  1. Thanks Ben.

    “Unless it gets into policy and practice”… I couldn’t agree more. I like this OECD definition of research too. Research is the “… creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this stock of knowledge to devise new applications.’

    It’s the use of knowledge to ‘devise’ new approaches, products and services that really interests me. I would like to see a ‘making space’ that brings researchers and practitioners together to co-construct, design and pilot new tools and methods. How about a workshop to explore possibilities?

    • Yes, I like that OECD definition too – particularly the combination of “creative” and “systematic”! And I agree, it does feel like there’s a gap in bringing together research and practice expertise for innovation. Much recent effort in the UK has been on evaluating existing interventions (particularly by the Education Endowment Foundation), although they are now investing in more ‘grass roots’ activity, for example Research Schools. NFER are part of the secretariat for CEBE which has previously brought a range of UK partners together in workshops. It would interesting to explore how these ideas transfer to an international stage though – ODI’s Rapid programme is one such example. – Ben Durbin

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s