This week’s guest post is from Julie Bayley, Coventry University. It was originally published on her blog on November 12, 2016 and is reposted here with permission.
I was delighted to be asked to speak at the KT Australia Research Impact Summit (November 2016). In my talk, I discussed many of the challenges of introducing an impact agenda into the academic community, and how impact literacy can help. An extended version of my slides are here, but let me talk through the key points below.
Consider impact. A small word. A simple, standard part of our vocabulary meaning influence or effect. But go from (small i) impact to (big I) Impact, and you’ve suddenly entered the domain of formal assessment and causal expectations. Arguably the UK have been the first to really take the Impact bull formally by the horns through the Research Assessment Framework 2014, but of course efforts to drive research into usable practice are far from unique to this little island. Whilst every country is rich with learning about how knowledge best mobilises within its own context, the UK probably offers a unique insight into the realities of impact assessment at scale and the multiple, non-prescribable pathways connecting research to effect.
First principles: impact is the provable effects of research in the real world (see slides 2 and 3). It’s the changes we can see (demonstrate, measure, capture), beyond academia (in society, economy, environment) which happen because of our studies (caused by, contributed to, attributable to). Dissemination, communication, engagement, knowledge transfer, knowledge exchange and knowledge mobilisation are all vital in getting research into practice, but in its truest form, ‘impact’ is the protected description of the resulting change.
Largely speaking, impact has three main drivers (slide 4): funders (who increasingly require impact plans for research to be judged competitively), centralised assessment (eg the Research Excellence Framework, UK) and the individual academic’s commitment to social, economic or environmental change. Formal sector expectations such as the REF are a double edged sword. On one side they legitimate engagement and outreach activities which can be disregarded in income/publication focused environments. On the other however, they can confer unrealistic expectations on those disciplinary areas (eg. fundamental research) whose work does not naturally connect directly to ‘real world change’. Even where academics are personally committed to impact, the weight of complying with assessment rhetoric can corrode even the most impassioned resolve.
Impact offers challenges to academics and the institution alike (slide 5). For the academic, weaving impact into already pressured environments can be exhausting, and the unease of meeting expectations for impacts that are ‘significant’ enough for external assessment can trigger anxiety and anger. For the institution, staffing, resourcing and embedding impact within existing structures whilst ensuring assessment requirements are met is extremely tough. Similarly we must remember and address the challenges for the beneficiaries themselves. The ‘users’ of our work are concerned with how well the research fits their needs, and how accessible and useful it is. Unless work is appropriate and suitable for the audience, it’s unlikely to achieve its impact aims and will just introduce more burden into the user community.
So how can we do impact well? After several years in impact I’ve enjoyed/ burned my fingers on a considerable volume of training, planning/strategy building, designing information management systems and building impact into a university culture, alongside academic research in the area and (health psychology) research submitted to REF. It’s hard to disentangle the discrete elements of the impact process, which probably explains why I’ve had my fingers in quite so many pies. I have discussed the challenges still facing the impact community before, and how a reductionist, assessment driven approach can lead to impact short-sightedness. However, academics have an amazing and very privileged opportunity to make a genuine and meaningful difference to the ‘real world’. For this, the research community needs to understand how to make impact happen. The research community needs to be impact literate.
Impact literacy (slide 6, a term coined by myself and Dr David Phipps, York University, Toronto) describes individuals’ ability to understand, appraise and make decisions with regards to impact. Impact literacy involves understanding how the what (type, indicators and evidence of benefit), how (activities and engagement processes) and who (individuals’ skills and roles) of impact combine to produce effects. Impact literacy supports good decision making, clear planning and realistic methodologies. Impact can be pursued without being literate, but this is likely to lead to poor execution, missed opportunities, poor resource use and misaligned or underachieved targets. A person is only literate if they understand each of the three areas. If one is missing, thinking is incomplete:
How + Who (without What) gives poor consideration to endpoints/effects
How + What (without Who) neglects the importance of individual efforts and skills
Who + What (without How) overlooks the need for appropriate engagement methods
We can and should also extend literacy beyond the individual and build an impact literate research culture (slide 7). With all the challenges to delivering impact within a pressured academic environment, it’s essential that institutions align their internal structures to supporting delivery. Bluntly put, you can only measure what you create, so start working together from the start. Academics need to build partnerships and translate research into suitable formats, whilst the institution values, resources and builds strategic connections beyond the institution (‘How’). Academics and research managers also need to recognise their own skills/training needs, and share/partner with others, whilst the institution must commit to professional development and clarifying roles (‘Who’). Academics must work with end-users to establish suitable goals and ways to measure them, whilst the institution must offer the strategic and systems support to manage this information (‘What’).
The process of building a positive and impact-literate culture is of course beyond the scope of one talk. It is an ongoing process and takes continued strategic and individual commitment. But if we really want impact, and good impact at that, we must focus on improving the knowledge, skills and confidence of academics and research managers across the institution. An impact literate culture is one in which people know what’s needed and how they contribute. A positive culture is one in which they know that contribution is valued.
So if you’re trying to build impact into your institution, my top tips would be (slide 8):
Embed impact into the research process. If you’re going to create real benefits, impact has to be integrated from the start and not treated as a post-project add-on.
Recognise one size doesn’t fit all. Impact cannot be templated. It is always unique to the project, discipline and it’s place along the fundamental-to-applied continuum. Tailor your thinking.
Harness and build skills within the institution. Create your ‘impact agency’ by developing impact literacy, competencies and connections between colleagues.
Engage not enrage. Impact is a small word with big implications. Give people time to adjust and build a strong approach together.
Remember (slide 9): Impact is achievable. But it’s not simple. Value the people involved and their efforts, support the processes and connect researchers, users and research meaningfully. Just imagine what’s possible if you do 🙂