{"id":14043,"date":"2019-05-24T13:46:24","date_gmt":"2019-05-24T17:46:24","guid":{"rendered":"https:\/\/researchimpact.ca\/?p=14043"},"modified":"2024-01-10T13:14:08","modified_gmt":"2024-01-10T18:14:08","slug":"assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks","status":"publish","type":"post","link":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/","title":{"rendered":"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks"},"content":{"rendered":"

Cruz Rivera, S., Kyte, D.G., Aiyegbusi, O.L., Keeley, T.J., & Calvert, M.J. (2017). Assessing the impact of healthcare research: A systematic review of methodological frameworks. PLoS Medicine 14<\/em>(8): e1002370. https:\/\/doi.org\/10.1371\/journal.pmed.1002370<\/a><\/u><\/p>\n

Abstract<\/strong><\/p>\n

Background:<\/u><\/em> Increasingly, researchers need to demonstrate the impact of their research to their sponsors, funders, and fellow academics. However, the most appropriate way of measuring the impact of healthcare research is subject to debate. We aimed to identify the existing methodological frameworks used to measure healthcare research impact and to summarise the common themes and metrics in an impact matrix.<\/em><\/p>\n

Methods and findings:<\/u><\/em> Two independent investigators systematically searched the Medical Literature Analysis and Retrieval System Online (MEDLINE), the Excerpta Medica Database (EMBASE), the Cumulative Index to Nursing and Allied Health Literature (CINAHL+), the Health Management Information Consortium, and the Journal of Research Evaluation from inception until May 2017 for publications that presented a methodological framework for research impact. We then summarised the common concepts and themes across methodological frameworks and identified the metrics used to evaluate differing forms of impact. Twenty-four unique methodological frameworks were identified, addressing 5 broad categories of impact: (1) \u2018primary research-related impact\u2019, (2) \u2018influence on policy making\u2019, (3) \u2018health and health systems impact\u2019, (4) \u2018health-related and societal impact\u2019, and (5) \u2018broader economic impact\u2019. These categories were subdivided into 16 common impact subgroups. Authors of the included publications proposed 80 different metrics aimed at measuring impact in these areas. The main limitation of the study was the potential exclusion of relevant articles, as a consequence of the poor indexing of the databases searched.<\/em><\/p>\n

Conclusions:<\/u><\/em> The measurement of research impact is an essential exercise to help direct the allocation of limited research resources, to maximise research benefit, and to help minimise research waste. This review provides a collective summary of existing methodological frameworks for research impact, which funders may use to inform the measurement of research impact and researchers may use to inform study design decisions aimed at maximising the short-, medium-, and long-term impact of their research.<\/em><\/p>\n

I usually present a journal club article that can help our knowledge mobilization practices. I\u2019m not certain what this paper adds. It is a review of impact frameworks for healthcare research. As the abstract says 24 unique frameworks were identified for five categories of impact and 80 different metrics. The authors state, \u201cwhilst previous researchers have summarised existing methodological frameworks and impact case studies they have not summarised the metrics for use by researchers, funders, and policy makers<\/em>.\u201d And they claim to \u201cprovide a simplified consolidated resource<\/em>\u201d.<\/p>\n

The 24 frameworks might be \u201cunique\u201d but they are not distinct. Seven of the 24 frameworks are based on the payback method. And as the authors point out, \u201cthe Payback Framework drew upon a literature review and was refined through a case study approach. Arguably, this approach could be considered inferior to other methods that involved extensive stakeholder involvement<\/em>.\u201d So, is this a critique of all seven frameworks even if they subsequently engaged stakeholders?<\/p>\n

Also, I wouldn\u2019t call 80 metrics simplified. It is useful to have these 80 metrics named but the paper gives no guidance on how or when to use them. And while all 24 frameworks are compared along several parameters in table 1 and figure 2 the authors don\u2019t draw much in the way of conclusions. Impact practitioners need more from impact researchers. It would have been nice to know those conditions\/situations which demand one framework over another.<\/p>\n

And finally, there are contradictions in Figure 4 which shows a \u201cpathways to research impact diagram<\/em>\u201d. This pathway is depicted longitudinally with short term impacts at the left and broader economic impacts on the right. Makes sense except that the patents granted are depicted as broader socioeconomic impacts and are absent as a dissemination event under short term impacts. A granted patent does nothing more than disseminate the information in the patent. Only when a company sells product based on that patent is there an economic impact. \u201cCollaborative research with industry\u201d <\/em>is identified as a mid term outcome but \u201cresearch contracts and income from industry<\/em>\u201d are also mentioned in socioeconomic impacts. Which is it?<\/p>\n

The paper may be useful background for those writing other research articles but not so much for practitioners.<\/p>\n

Questions for brokers:<\/p>\n

    \n
  1. Why is an issued patent considered by many as a metric of innovation when all it does is disseminate the invention.?<\/li>\n
  2. When does innovation occur: when something is invented or when something is produced and sold?<\/li>\n
  3. What are you looking for from research on impact frameworks?<\/li>\n<\/ol>\n

    Research Impact Canada (RIC) is producing this journal club series as a way to make evidence on KMb more accessible to knowledge brokers and to create on line discussion about research on knowledge mobilization. It is designed for knowledge brokers and other knowledge mobilization stakeholders. Read this open access article. Then come back to this post and join the journal club by posting your comments.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

    Cruz Rivera, S., Kyte, D.G., Aiyegbusi, O.L., Keeley, T.J., & Calvert, M.J. (2017). Assessing the impact of healthcare research: A systematic review of methodological frameworks. PLoS Medicine 14(8): e1002370. https:\/\/doi.org\/10.1371\/journal.pmed.1002370 Abstract Background: Increasingly, researchers need to demonstrate the impact of their research to their sponsors, funders, and fellow academics. However, the most appropriate way of […]<\/p>\n

    Lire la suite\u2026 from Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks<\/span><\/a><\/p>\n","protected":false},"author":31,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1453],"tags":[1690],"class_list":["post-14043","post","type-post","status-publish","format-standard","hentry","category-club-de-lecture-en-mdc","tag-systematic-reviews-fr-2"],"acf":[],"yoast_head":"\nAssessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks - Research Impact Canada<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks - Research Impact Canada\" \/>\n<meta property=\"og:description\" content=\"Cruz Rivera, S., Kyte, D.G., Aiyegbusi, O.L., Keeley, T.J., & Calvert, M.J. (2017). Assessing the impact of healthcare research: A systematic review of methodological frameworks. PLoS Medicine 14(8): e1002370. https:\/\/doi.org\/10.1371\/journal.pmed.1002370 Abstract Background: Increasingly, researchers need to demonstrate the impact of their research to their sponsors, funders, and fellow academics. However, the most appropriate way of [...]Lire la suite\u2026 from Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks\" \/>\n<meta property=\"og:url\" content=\"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/\" \/>\n<meta property=\"og:site_name\" content=\"Research Impact Canada\" \/>\n<meta property=\"article:published_time\" content=\"2019-05-24T17:46:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-10T18:14:08+00:00\" \/>\n<meta name=\"author\" content=\"Sandy Chan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sandy Chan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/\"},\"author\":{\"name\":\"Sandy Chan\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/836cf0d03e4199b502bd93568fcc66f6\"},\"headline\":\"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks\",\"datePublished\":\"2019-05-24T17:46:24+00:00\",\"dateModified\":\"2024-01-10T18:14:08+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/\"},\"wordCount\":818,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"keywords\":[\"Systematic reviews\"],\"articleSection\":[\"Club de lecture en MdC\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/\",\"name\":\"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks - Research Impact Canada\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\"},\"datePublished\":\"2019-05-24T17:46:24+00:00\",\"dateModified\":\"2024-01-10T18:14:08+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/club-de-lecture-en-mdc\\\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/accueil\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"name\":\"Research Impact Canada\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\",\"name\":\"Research Impact Canada\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"contentUrl\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"width\":286,\"height\":66,\"caption\":\"Research Impact Canada\"},\"image\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/836cf0d03e4199b502bd93568fcc66f6\",\"name\":\"Sandy Chan\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/author\\\/sandy-chan\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks - Research Impact Canada","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/","og_locale":"fr_FR","og_type":"article","og_title":"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks - Research Impact Canada","og_description":"Cruz Rivera, S., Kyte, D.G., Aiyegbusi, O.L., Keeley, T.J., & Calvert, M.J. (2017). Assessing the impact of healthcare research: A systematic review of methodological frameworks. PLoS Medicine 14(8): e1002370. https:\/\/doi.org\/10.1371\/journal.pmed.1002370 Abstract Background: Increasingly, researchers need to demonstrate the impact of their research to their sponsors, funders, and fellow academics. However, the most appropriate way of [...]Lire la suite\u2026 from Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks","og_url":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/","og_site_name":"Research Impact Canada","article_published_time":"2019-05-24T17:46:24+00:00","article_modified_time":"2024-01-10T18:14:08+00:00","author":"Sandy Chan","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"Sandy Chan","Dur\u00e9e de lecture estim\u00e9e":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/#article","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/"},"author":{"name":"Sandy Chan","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/836cf0d03e4199b502bd93568fcc66f6"},"headline":"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks","datePublished":"2019-05-24T17:46:24+00:00","dateModified":"2024-01-10T18:14:08+00:00","mainEntityOfPage":{"@id":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/"},"wordCount":818,"commentCount":0,"publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"keywords":["Systematic reviews"],"articleSection":["Club de lecture en MdC"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/","url":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/","name":"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks - Research Impact Canada","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/#website"},"datePublished":"2019-05-24T17:46:24+00:00","dateModified":"2024-01-10T18:14:08+00:00","breadcrumb":{"@id":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/researchimpact.ca\/fr\/club-de-lecture-en-mdc\/assessing-the-impact-of-healthcare-research-a-systematic-review-of-methodological-frameworks\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/researchimpact.ca\/fr\/accueil\/"},{"@type":"ListItem","position":2,"name":"Assessing the Impact of Healthcare Research: A Systematic Review of Methodological Frameworks"}]},{"@type":"WebSite","@id":"https:\/\/researchimpact.ca\/fr\/#website","url":"https:\/\/researchimpact.ca\/fr\/","name":"Research Impact Canada","description":"","publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/researchimpact.ca\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/researchimpact.ca\/fr\/#organization","name":"Research Impact Canada","url":"https:\/\/researchimpact.ca\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","contentUrl":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","width":286,"height":66,"caption":"Research Impact Canada"},"image":{"@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/836cf0d03e4199b502bd93568fcc66f6","name":"Sandy Chan","url":"https:\/\/researchimpact.ca\/fr\/author\/sandy-chan\/"}]}},"_links":{"self":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/14043","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/comments?post=14043"}],"version-history":[{"count":0,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/14043\/revisions"}],"wp:attachment":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/media?parent=14043"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/categories?post=14043"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/tags?post=14043"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}