{"id":13811,"date":"2018-12-11T14:59:20","date_gmt":"2018-12-11T19:59:20","guid":{"rendered":"https:\/\/researchimpact.ca\/?p=13811"},"modified":"2021-11-23T09:33:52","modified_gmt":"2021-11-23T14:33:52","slug":"reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue","status":"publish","type":"post","link":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/","title":{"rendered":"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue"},"content":{"rendered":"<p>Scarrow, G., Angus, D., &amp; Holmes, B. (2017). Reviewer training to assess knowledge translation in funding applications is long overdue. <em>Research integrity and Peer Review,\u00a02<\/em>(13), pp. 1-7.\u00a0<a href=\"https:\/\/doi.org\/10.1186\/s41073-017-0037-8\">https:\/\/doi.org\/10.1186\/s41073-017-0037-8<\/a><\/p>\n<p><strong>Abstract<\/strong><\/p>\n<p><em><strong>Background: <\/strong>Health research funding agencies are placing a growing focus on knowledge translation (KT) plans, also known as dissemination and implementation (D&amp;I) plans, in grant applications to decrease the gap between what we know from research and what we do in practice, policy, and further research. Historically, review panels have focused on the scientific excellence of applications to determine which should be funded; however, relevance to societal health priorities, the facilitation of evidence-informed practice and policy, or realizing commercialization opportunities all require a different lens.<\/em><\/p>\n<p><em><strong>Discussion: <\/strong>While experts in their respective fields, grant reviewers may lack the competencies to rigorously assess the KT components of applications. Funders of health research\u2014including health charities, non-profit agencies, governments, and foundations\u2014have an obligation to ensure that these components of funding applications are as rigorously evaluated as the scientific components. In this paper, we discuss the need for a more rigorous evaluation of knowledge translation potential by review panels and propose how this may be addressed.<\/em><\/p>\n<p><em><strong>Conclusion: <\/strong>We propose that reviewer training supported in various ways including guidelines and KT expertise on review panels and modalities such as online and face-to-face training will result in the rigorous assessment of all components of funding applications, thus increasing the relevance and use of funded research evidence. An unintended but highly welcome consequence of such training could be higher quality D&amp;I or KT plans in subsequent funding applications from trained reviewers.<\/em><\/p>\n<p>I like this article because I spend so much time helping researchers craft impact strategies (knowledge mobilization\/translation plans) only to (not infrequently) hear that it was only the scientific and training components of the application that were discussed at review. As this article points out, peer reviewers are usually scientific peers with no training in KT, so they will focus on what they know. However, if one goal (not the only goal) of research funding is to develop new knowledge and translate that knowledge into benefits for society then it is incumbent upon funders to train reviewers to also provide a critical review of the impact strategies as well as the intellectual merit of the applications.<\/p>\n<p>The article points to steps being taken as identified in the literature:<\/p>\n<ul>\n<li><em>Providing resources for reviewers such as the Guide for Assessing Health Research Knowledge Translation (KT) Plans, tips for reviewers from past chairs and reviewers of KT applications<\/em><\/li>\n<li><em>Embedding specific review criteria for KT in funding applications<\/em><\/li>\n<li><em>Providing an overview of KT as part of peer review panel orientation <\/em><\/li>\n<li><em>Having KT experts on peer review panels and research users on panels as context experts to assess the merit of proposed research: its relevance to, potential uptake by, and impact on targeted stakeholders<\/em><\/li>\n<\/ul>\n<p>The article then proceeds to critique each of these and, \u201c<em>reviewer training or education in KT, tailored to the specific requirements of the funding program, is critical to ensuring a rigorous review of KT plans and funding of excellent applications, thereby improving the likelihood that research evidence will be used to inform policy and practice<\/em>.\u201d<\/p>\n<p>One article cited showed that only 9% of reviewers ever received training in grant review \u2013 just grant review, not even mentioning review of impact strategies. The same article showed that 64% would take training if it were offered (the remaining 36% clearly not being challenged by a lack of self esteem!). It seems like grant review is something scholars are just expected to know.<\/p>\n<p>The authors point to some considerations about training for KT strategies<\/p>\n<ol>\n<li>The type of KT being reviewed: dissemination and co-production are different methods and may need distinct training<\/li>\n<li>The review panel\u2019s level of knowledge and expertise in KT, including the chair: some reviewers are experienced in KT and some aren\u2019t. Training should reflect different stages of KT sophistication<\/li>\n<li>The resources available: what is optimal and what is feasible are often not the same thing.<\/li>\n<\/ol>\n<p><em>In summary, the key informants felt that reviewers do need a solid understanding of what good KT plans should contain and guidelines are not sufficient for this purpose. Training should therefore be required. Training should be delivered just in time and should recognize existing levels of expertise. Having an expert on every panel is an alternative but is not be feasible given the small pool of available experts.<\/em><\/p>\n<p><strong>Questions for brokers:<\/strong><\/p>\n<ol>\n<li>Have you been a KT\/Impact expert on a grant review panel? What were your experiences? Would you do it again?<\/li>\n<li>If the best funder advice for applicants is generic (i.e. your impact strategy for water management in remote communities will be different than your impact strategy for commercializing a medical device) how can training for review be made more specific for the grant competition?<\/li>\n<li>Isn\u2019t learning about impact like learning to swim? You can\u2019t learn to swim by watching a webinar. You need to get in the pool (but with a buddy and a life guard). Similarly, can you learn about impact from a webinar or do you actually need to learn by doing?<\/li>\n<\/ol>\n<p><em>ResearchImpact-R\u00e9seauImpactRecherche is producing this journal club series as a way to make the evidence and research on knowledge mobilization more accessible to knowledge brokers and to create on line discussion about research on knowledge mobilization. It is designed for knowledge brokers and other knowledge mobilization stakeholders. Read the open access article. Then come back to this post and join the journal club by posting your comments.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Scarrow, G., Angus, D., &amp; Holmes, B. (2017). Reviewer training to assess knowledge translation in funding applications is long overdue. Research integrity and Peer Review,\u00a02(13), pp. 1-7.\u00a0https:\/\/doi.org\/10.1186\/s41073-017-0037-8 Abstract Background: Health research funding agencies are placing a growing focus on knowledge translation (KT) plans, also known as dissemination and implementation (D&amp;I) plans, in grant applications to [&#8230;]<\/p>\n<p><a class=\"btn btn-secondary understrap-read-more-link\" href=\"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/\">Lire la suite\u2026<span class=\"screen-reader-text\"> from Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue<\/span><\/a><\/p>\n","protected":false},"author":22,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2386],"tags":[2187,1454],"class_list":["post-13811","post","type-post","status-publish","format-standard","hentry","category-archive","tag-grant-reviews-fr","tag-research-impact-fr-2"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue - Research Impact Canada<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue - Research Impact Canada\" \/>\n<meta property=\"og:description\" content=\"Scarrow, G., Angus, D., &amp; Holmes, B. (2017). Reviewer training to assess knowledge translation in funding applications is long overdue. Research integrity and Peer Review,\u00a02(13), pp. 1-7.\u00a0https:\/\/doi.org\/10.1186\/s41073-017-0037-8 Abstract Background: Health research funding agencies are placing a growing focus on knowledge translation (KT) plans, also known as dissemination and implementation (D&amp;I) plans, in grant applications to [...]Lire la suite\u2026 from Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue\" \/>\n<meta property=\"og:url\" content=\"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/\" \/>\n<meta property=\"og:site_name\" content=\"Research Impact Canada\" \/>\n<meta property=\"article:published_time\" content=\"2018-12-11T19:59:20+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-11-23T14:33:52+00:00\" \/>\n<meta name=\"author\" content=\"Connie Tang\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Connie Tang\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/\"},\"author\":{\"name\":\"Connie Tang\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/394e3b399bbe436d094e028d9c00962d\"},\"headline\":\"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue\",\"datePublished\":\"2018-12-11T19:59:20+00:00\",\"dateModified\":\"2021-11-23T14:33:52+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/\"},\"wordCount\":943,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"keywords\":[\"Grant reviews\",\"Research impact\"],\"articleSection\":[\"Archiv\u00e9\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/\",\"name\":\"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue - Research Impact Canada\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\"},\"datePublished\":\"2018-12-11T19:59:20+00:00\",\"dateModified\":\"2021-11-23T14:33:52+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/accueil\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"name\":\"Research Impact Canada\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\",\"name\":\"Research Impact Canada\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"contentUrl\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"width\":286,\"height\":66,\"caption\":\"Research Impact Canada\"},\"image\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/394e3b399bbe436d094e028d9c00962d\",\"name\":\"Connie Tang\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/author\\\/connie\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue - Research Impact Canada","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/","og_locale":"fr_FR","og_type":"article","og_title":"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue - Research Impact Canada","og_description":"Scarrow, G., Angus, D., &amp; Holmes, B. (2017). Reviewer training to assess knowledge translation in funding applications is long overdue. Research integrity and Peer Review,\u00a02(13), pp. 1-7.\u00a0https:\/\/doi.org\/10.1186\/s41073-017-0037-8 Abstract Background: Health research funding agencies are placing a growing focus on knowledge translation (KT) plans, also known as dissemination and implementation (D&amp;I) plans, in grant applications to [...]Lire la suite\u2026 from Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue","og_url":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/","og_site_name":"Research Impact Canada","article_published_time":"2018-12-11T19:59:20+00:00","article_modified_time":"2021-11-23T14:33:52+00:00","author":"Connie Tang","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"Connie Tang","Dur\u00e9e de lecture estim\u00e9e":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/#article","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/"},"author":{"name":"Connie Tang","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/394e3b399bbe436d094e028d9c00962d"},"headline":"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue","datePublished":"2018-12-11T19:59:20+00:00","dateModified":"2021-11-23T14:33:52+00:00","mainEntityOfPage":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/"},"wordCount":943,"commentCount":0,"publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"keywords":["Grant reviews","Research impact"],"articleSection":["Archiv\u00e9"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/","url":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/","name":"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue - Research Impact Canada","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/#website"},"datePublished":"2018-12-11T19:59:20+00:00","dateModified":"2021-11-23T14:33:52+00:00","breadcrumb":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/researchimpact.ca\/fr\/archive\/reviewer-training-to-assess-knowledge-translation-in-funding-applications-is-long-overdue\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/researchimpact.ca\/fr\/accueil\/"},{"@type":"ListItem","position":2,"name":"Reviewer Training to Assess Knowledge Translation in Funding Applications is Long Overdue"}]},{"@type":"WebSite","@id":"https:\/\/researchimpact.ca\/fr\/#website","url":"https:\/\/researchimpact.ca\/fr\/","name":"Research Impact Canada","description":"","publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/researchimpact.ca\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/researchimpact.ca\/fr\/#organization","name":"Research Impact Canada","url":"https:\/\/researchimpact.ca\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","contentUrl":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","width":286,"height":66,"caption":"Research Impact Canada"},"image":{"@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/394e3b399bbe436d094e028d9c00962d","name":"Connie Tang","url":"https:\/\/researchimpact.ca\/fr\/author\/connie\/"}]}},"_links":{"self":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/13811","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/comments?post=13811"}],"version-history":[{"count":0,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/13811\/revisions"}],"wp:attachment":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/media?parent=13811"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/categories?post=13811"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/tags?post=13811"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}