{"id":11973,"date":"2017-10-17T14:25:58","date_gmt":"2017-10-17T18:25:58","guid":{"rendered":"http:\/\/researchimpact.ydsinc.ca\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/"},"modified":"2021-11-23T09:34:29","modified_gmt":"2021-11-23T14:34:29","slug":"the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence","status":"publish","type":"post","link":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/","title":{"rendered":"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence"},"content":{"rendered":"<p>Digital Science (2016). The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence. Report available from <a href=\"https:\/\/www.digital-science.com\/resources\/digital-research-reports\/digital-research-report-societal-economic-impacts-academic-research\/\">https:\/\/www.digital-science.com\/resources\/digital-research-reports\/digital-research-report-societal-economic-impacts-academic-research\/<\/a><br \/>\n<strong>Introduction<\/strong><br \/>\n<em>This report was created to support a workshop in London in March 2016, supported by the Higher Education Funding Council for England (HEFCE). The objectives are to encourage researchers across all disciplines to reflect on what socio-economic research impact means for their areas of interest and what types of evidence best reflect achievement.<br \/>\nWhen impact case studies were added to the UK\u2019s 2014 Research Excellence Framework they created a new way of looking at what research delivers. This has proven remarkably amenable and incredibly revealing. There is a flavour to research outcomes that analytical indicators can never provide. But this was the first time such an exercise had been tried across all subjects in all universities in one cycle. One very flexible template fitted all. Now, with this experience, we have an opportunity to reflect on what worked and what could be improved.<br \/>\nDisciplinary communities must reflect on what they believe culturally constitutes proper, acceptable and appropriate evidence of economic, social or other impact and what constitutes strong or weak levels of achievement. It seems unlikely that broad-based sciences and arts will conceptualise impact, evidence of impact and assessment of impact in the same ways. There may also be divergence between professionally-focussed areas, like social policy, and their background academic disciplines, like sociology. And, whereas citation impact is used in the same way across continents, does the cultural construction of research impact allow it to become a global comparator?<\/em><br \/>\nThis report is a reflection on the UK <a href=\"http:\/\/www.ref.ac.uk\/\">Research Excellence Framework<\/a> (REF) and introduces some international perspectives on impact. It provides several useful conclusions about impact assessment and systems of impact assessment. It lacks a critical or empirical research lens but the people and organizations providing the commentary are recognized leaders in their fields. We can learn much form these leaders as Canada and other countries start to think about impact assessment.<br \/>\nImpact assessment is hard and expensive but worthwhile. The impact case study portion of the REF cost \u00a355M but drove the allocation of over \u00a31.6B in investment in higher education. This is a 3.4% transaction cost which is much less than the 13% transaction costs for grant writing.<br \/>\nThere were four types of evidence used to substantiate claims of impact: stakeholder information, testimonials, on line traffic, positions of responsibility. Figure 1 breaks these down into more granular forms of evidence (i.e. letters of support and focus groups as two of seven types of testimonial evidence). Testimonials were most frequently used evidence type for the Physical Sciences &#038; Engineering, Social Sciences, as well as the Arts and Humanities assessment panels with the Biological Sciences &#038; Medicine panel using reports more frequently.<br \/>\nThe report advocates for evidence collection during the conduct of the research, not just retrospectively. However, this requires impact to be planned (<em>ex ante<\/em>) rather than waiting until after the project has finished (<em>ex post<\/em>). This also requires some system to collect, gather and store the different forms of evidence of impact. Commercial products such as <a href=\"https:\/\/www.researchfish.net\/\">Research Fish<\/a> and <a href=\"http:\/\/www.vertigoventures.com\/vv-impact-tracker\/\">VV Impact Tracker<\/a> can help with this. Likely a good electronic filing system and excel will work for a small-scale impact assessment.<br \/>\nRelated to this the report states \u201c<em>Experience enabling clients to report research impact confirms that planning for impact is best done at the beginning of the research process, putting in place impact data and evidence capture as the project is being conceptualised<\/em>.\u201d See a Mobilize This! <a href=\"https:\/\/researchimpact.ca\/fr\/archive\/a-stranger-in-a-not-so-strange-land-etranger-en-terre-pas-si-etrangere\/\">blog post<\/a> about how this ex ante (planned at the beginning) impact assessment is the same thing as knowledge mobilization planning. When you plan your knowledge mobilization (i.e. impact) strategy you need to develop a theory of change (i.e. impact pathway) which will inform the indicators you need to measure along the way and at the end of the process. <strong>Knowledge mobilization planning is <em>ex ante<\/em> impact assessment<\/strong>.<br \/>\nAustralia has launched their <a href=\"http:\/\/www.arc.gov.au\/engagement-and-impact-assessment\">research engagement and impact pilot<\/a>. While they fall short of saying engagement metrics are a proxy for impact the theory is that engagement is a necessary precursor to impact, something I <a href=\"https:\/\/www.publicengagement.ac.uk\/blog\/engagement-necessary-precursor-impact\">wrote about more than two years ago<\/a>. Engagement should not be assessed separately from impact. Engagement metrics can be measured along the pathway from research to impact but they should not be conflated with actual impact.<br \/>\n<strong>Questions for Brokers:<\/strong><br \/>\n1. Discuss: You can\u2019t have impact without engagement but you can have engagement without impact.<br \/>\n2. Commercial systems such as Research Fish and VV Impact Tracker are used \u2013 usually -by academic institutions to capture the evidence of impact from \u2013 usually \u2013 researchers. But the forms of evidence of impact (Figure 1) are derived from research users\/partners. Why do we ask researchers to gather the evidence of impact when they aren\u2019t the ones making the impact?<br \/>\n3. Impact assessment is hard but worthwhile. In Canada, we don\u2019t (yet) have a REF like system that requires impact assessment. Why would we bother doing this if we don\u2019t have to?<br \/>\n<em>Research Impact Canada is producing this journal club series to make evidence on KMb more accessible to knowledge brokers and to create on line discussion about research on knowledge mobilization. It is designed for knowledge brokers and other knowledge mobilization stakeholders. Read this open access article. Then come back to this post and join the journal club by posting your comments.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Digital Science (2016). The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence. Report available from https:\/\/www.digital-science.com\/resources\/digital-research-reports\/digital-research-report-societal-economic-impacts-academic-research\/ Introduction This report was created to support a workshop in London in March 2016, supported by the Higher Education Funding Council for England (HEFCE). The objectives are to encourage researchers across all [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/\">Lire la suite\u2026<span class=\"screen-reader-text\"> from The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence<\/span><\/a><\/p>\n","protected":false},"author":22,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2386],"tags":[1501,1454],"class_list":["post-11973","post","type-post","status-publish","format-standard","hentry","category-archive","tag-ref-fr-2","tag-research-impact-fr-2"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence - Research Impact Canada<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence - Research Impact Canada\" \/>\n<meta property=\"og:description\" content=\"Digital Science (2016). The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence. Report available from https:\/\/www.digital-science.com\/resources\/digital-research-reports\/digital-research-report-societal-economic-impacts-academic-research\/ Introduction This report was created to support a workshop in London in March 2016, supported by the Higher Education Funding Council for England (HEFCE). The objectives are to encourage researchers across all [...]Lire la suite\u2026 from The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence\" \/>\n<meta property=\"og:url\" content=\"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/\" \/>\n<meta property=\"og:site_name\" content=\"Research Impact Canada\" \/>\n<meta property=\"article:published_time\" content=\"2017-10-17T18:25:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-11-23T14:34:29+00:00\" \/>\n<meta name=\"author\" content=\"Connie Tang\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Connie Tang\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/\"},\"author\":{\"name\":\"Connie Tang\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/394e3b399bbe436d094e028d9c00962d\"},\"headline\":\"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence\",\"datePublished\":\"2017-10-17T18:25:58+00:00\",\"dateModified\":\"2021-11-23T14:34:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/\"},\"wordCount\":920,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"keywords\":[\"REF\",\"Research impact\"],\"articleSection\":[\"Archiv\u00e9\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/\",\"name\":\"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence - Research Impact Canada\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\"},\"datePublished\":\"2017-10-17T18:25:58+00:00\",\"dateModified\":\"2021-11-23T14:34:29+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/accueil\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"name\":\"Research Impact Canada\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\",\"name\":\"Research Impact Canada\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"contentUrl\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"width\":286,\"height\":66,\"caption\":\"Research Impact Canada\"},\"image\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/394e3b399bbe436d094e028d9c00962d\",\"name\":\"Connie Tang\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/author\\\/connie\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence - Research Impact Canada","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/","og_locale":"fr_FR","og_type":"article","og_title":"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence - Research Impact Canada","og_description":"Digital Science (2016). The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence. Report available from https:\/\/www.digital-science.com\/resources\/digital-research-reports\/digital-research-report-societal-economic-impacts-academic-research\/ Introduction This report was created to support a workshop in London in March 2016, supported by the Higher Education Funding Council for England (HEFCE). The objectives are to encourage researchers across all [...]Lire la suite\u2026 from The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence","og_url":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/","og_site_name":"Research Impact Canada","article_published_time":"2017-10-17T18:25:58+00:00","article_modified_time":"2021-11-23T14:34:29+00:00","author":"Connie Tang","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"Connie Tang","Dur\u00e9e de lecture estim\u00e9e":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/#article","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/"},"author":{"name":"Connie Tang","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/394e3b399bbe436d094e028d9c00962d"},"headline":"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence","datePublished":"2017-10-17T18:25:58+00:00","dateModified":"2021-11-23T14:34:29+00:00","mainEntityOfPage":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/"},"wordCount":920,"commentCount":0,"publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"keywords":["REF","Research impact"],"articleSection":["Archiv\u00e9"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/","url":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/","name":"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence - Research Impact Canada","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/#website"},"datePublished":"2017-10-17T18:25:58+00:00","dateModified":"2021-11-23T14:34:29+00:00","breadcrumb":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/researchimpact.ca\/fr\/archive\/the-societal-and-economic-impacts-of-academic-research-international-perspectives-on-good-practice-and-managing-evidence\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/researchimpact.ca\/fr\/accueil\/"},{"@type":"ListItem","position":2,"name":"The Societal and Economic Impacts of Academic Research: International perspectives on good practice and managing evidence"}]},{"@type":"WebSite","@id":"https:\/\/researchimpact.ca\/fr\/#website","url":"https:\/\/researchimpact.ca\/fr\/","name":"Research Impact Canada","description":"","publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/researchimpact.ca\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/researchimpact.ca\/fr\/#organization","name":"Research Impact Canada","url":"https:\/\/researchimpact.ca\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","contentUrl":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","width":286,"height":66,"caption":"Research Impact Canada"},"image":{"@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/394e3b399bbe436d094e028d9c00962d","name":"Connie Tang","url":"https:\/\/researchimpact.ca\/fr\/author\/connie\/"}]}},"_links":{"self":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/11973","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/comments?post=11973"}],"version-history":[{"count":0,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/11973\/revisions"}],"wp:attachment":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/media?parent=11973"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/categories?post=11973"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/tags?post=11973"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}