{"id":13550,"date":"2018-07-25T14:57:39","date_gmt":"2018-07-25T18:57:39","guid":{"rendered":"https:\/\/researchimpact.ca\/?p=13550"},"modified":"2021-11-23T09:33:59","modified_gmt":"2021-11-23T14:33:59","slug":"a-better-measure-of-research-from-the-global-south","status":"publish","type":"post","link":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/","title":{"rendered":"A Better Measure of Research From the Global South"},"content":{"rendered":"

Lebel, J. & McLean, R. (2018). A better measure of research from the global south. Nature, 559<\/em>, 23-26. https:\/\/www.nature.com\/articles\/d41586-018-05581-4<\/a><\/p>\n

Abstract<\/strong>
\nFunders Jean Lebel and Robert McLean describe a new tool for judging the value and validity of science that attempts to improve lives.<\/em><\/p>\n

This is a good article for anyone interested in assessing the research quality and utility.<\/p>\n

This Nature Comment article is best read alongside the original 2016 IDRC report<\/a> which provides more detail on implementing the Research Quality Plus (RQ+) research assessment tool developed and tested by Canada\u2019s International Development Research Centre (IDRC).<\/p>\n

The RQ+ tool is predicated on the observation that \u201cDominant techniques of research evaluation take a narrow view of what constitutes quality, thus undervaluing unique solutions to unique problems<\/em>.\u201d\u00a0 Current methods (peer review and citation analysis) do not give equal recognition to local researchers. They assess local and foreign researchers equally while their motivations and incentives might be different (i.e. they ignore local context). RQ+ \u201crecognizes that scientific merit is necessary, but not sufficient. It acknowledges the crucial role of stakeholders and users in determining whether research is salient and legitimate. It focuses attention on how well scientists position their research for use, given the mounting understanding that uptake and influence begins during the research process, not only afterwards<\/em>.\u201d These are the four primary dimensions (with sub dimensions) of RQ+ assessment: integrity, legitimacy, importance, positioning for use.<\/p>\n

Assessment is a four-step process (best described in the original 2016 report<\/a>):<\/p>\n

    \n
  1. \n
      \n
    1. Select the project and data sources (research outputs, interviews, related documents)<\/li>\n
    2. Characterize key influences which uses a rubric (low, medium, high) to examine the context of the research: maturity of the research field; research capacity strengthening; risk in the data environment; risk in the political environment; risk in the research environment<\/li>\n
    3. Rate the quality of the research on the four primary dimensions (above) and their subdimensions using an 8-point scale<\/li>\n
    4. Synthesize the ratings (among parallel reviewers) rolling up across projects, programs and portfolios (i.e. RQ+ scales from a project to a portfolio).<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n

      IDRC did a retrospective analysis of 170 projects to validate RQ+ and were able to bust three myths. First: southern only research is high quality (i.e. you don\u2019t need researchers from an industrialized nation to do high quality research). Second: capacity strengthening and research excellence go hand in hand. Third: Research can be rigorous and useful (something Amanda Cooper demonstrated in last month\u2019s journal club<\/a>).<\/p>\n

      The IDRC review was done ex post but IDRC is looking at how they might use it ex ante for grant selection as well as in a formative fashion to monitor progress of individual projects.<\/p>\n

      One thing I don\u2019t yet understand is the relationship between step 2 and step 3. I understand both of them but I don\u2019t (yet) understand how characterizing key influences on a 3 point scale influences the rating of each of the dimensions and subdimensions on the 8 point scale because according to Figure 5 in the original 2016 report it appears that it is the 8 point ratings that are rolled up for the overall assessment. What role then for the key influencers?<\/p>\n

      Questions for brokers<\/strong><\/p>\n

        \n
      1. Can you figure out the one thing I don\u2019t understand, above?<\/li>\n
      2. The REF<\/a> provides little guidance to promote consistency for both creating and assessing research impact case studies. Might this tool create greater consistency, at least for research excellence (and for research engagement if you\u2019re subject to Excellence in Research for Australia<\/a> exercise)?<\/li>\n
      3. RQ+ is concerned with assessing research excellence and its \u201cpositioning for use\u201d. This clearly includes research engagement and is pointing towards impact assessment but isn\u2019t there yet. What would you do to add an element of impact assessment to the RQ+ method?<\/li>\n<\/ol>\n

        Research Impact Canada is producing this journal club series to make evidence on Knowledge Mobilization more accessible to knowledge brokers and to create on line discussion about research on knowledge mobilization. It is designed for knowledge brokers and other knowledge mobilization stakeholders. Read this open access article. Then come back to this post and join the journal club by posting your comments.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

        Lebel, J. & McLean, R. (2018). A better measure of research from the global south. Nature, 559, 23-26. https:\/\/www.nature.com\/articles\/d41586-018-05581-4 Abstract Funders Jean Lebel and Robert McLean describe a new tool for judging the value and validity of science that attempts to improve lives. This is a good article for anyone interested in assessing the research […]<\/p>\n

        Lire la suite\u2026 from A Better Measure of Research From the Global South<\/span><\/a><\/p>\n","protected":false},"author":22,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2386],"tags":[1633],"class_list":["post-13550","post","type-post","status-publish","format-standard","hentry","category-archive","tag-research-fr-2"],"acf":[],"yoast_head":"\nA Better Measure of Research From the Global South - Research Impact Canada<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A Better Measure of Research From the Global South - Research Impact Canada\" \/>\n<meta property=\"og:description\" content=\"Lebel, J. & McLean, R. (2018). A better measure of research from the global south. Nature, 559, 23-26. https:\/\/www.nature.com\/articles\/d41586-018-05581-4 Abstract Funders Jean Lebel and Robert McLean describe a new tool for judging the value and validity of science that attempts to improve lives. This is a good article for anyone interested in assessing the research [...]Lire la suite\u2026 from A Better Measure of Research From the Global South\" \/>\n<meta property=\"og:url\" content=\"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/\" \/>\n<meta property=\"og:site_name\" content=\"Research Impact Canada\" \/>\n<meta property=\"article:published_time\" content=\"2018-07-25T18:57:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-11-23T14:33:59+00:00\" \/>\n<meta name=\"author\" content=\"Connie Tang\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Connie Tang\" \/>\n\t<meta name=\"twitter:label2\" content=\"Dur\u00e9e de lecture estim\u00e9e\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/\"},\"author\":{\"name\":\"Connie Tang\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/394e3b399bbe436d094e028d9c00962d\"},\"headline\":\"A Better Measure of Research From the Global South\",\"datePublished\":\"2018-07-25T18:57:39+00:00\",\"dateModified\":\"2021-11-23T14:33:59+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/\"},\"wordCount\":695,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"keywords\":[\"Research\"],\"articleSection\":[\"Archiv\u00e9\"],\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/\",\"name\":\"A Better Measure of Research From the Global South - Research Impact Canada\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\"},\"datePublished\":\"2018-07-25T18:57:39+00:00\",\"dateModified\":\"2021-11-23T14:33:59+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/archive\\\/a-better-measure-of-research-from-the-global-south\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/accueil\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A Better Measure of Research From the Global South\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"name\":\"Research Impact Canada\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#organization\",\"name\":\"Research Impact Canada\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"contentUrl\":\"https:\\\/\\\/researchimpact.ca\\\/wp-content\\\/uploads\\\/RIC-FR-CMYK.jpg\",\"width\":286,\"height\":66,\"caption\":\"Research Impact Canada\"},\"image\":{\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/#\\\/schema\\\/person\\\/394e3b399bbe436d094e028d9c00962d\",\"name\":\"Connie Tang\",\"url\":\"https:\\\/\\\/researchimpact.ca\\\/fr\\\/author\\\/connie\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A Better Measure of Research From the Global South - Research Impact Canada","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/","og_locale":"fr_FR","og_type":"article","og_title":"A Better Measure of Research From the Global South - Research Impact Canada","og_description":"Lebel, J. & McLean, R. (2018). A better measure of research from the global south. Nature, 559, 23-26. https:\/\/www.nature.com\/articles\/d41586-018-05581-4 Abstract Funders Jean Lebel and Robert McLean describe a new tool for judging the value and validity of science that attempts to improve lives. This is a good article for anyone interested in assessing the research [...]Lire la suite\u2026 from A Better Measure of Research From the Global South","og_url":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/","og_site_name":"Research Impact Canada","article_published_time":"2018-07-25T18:57:39+00:00","article_modified_time":"2021-11-23T14:33:59+00:00","author":"Connie Tang","twitter_card":"summary_large_image","twitter_misc":{"\u00c9crit par":"Connie Tang","Dur\u00e9e de lecture estim\u00e9e":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/#article","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/"},"author":{"name":"Connie Tang","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/394e3b399bbe436d094e028d9c00962d"},"headline":"A Better Measure of Research From the Global South","datePublished":"2018-07-25T18:57:39+00:00","dateModified":"2021-11-23T14:33:59+00:00","mainEntityOfPage":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/"},"wordCount":695,"commentCount":0,"publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"keywords":["Research"],"articleSection":["Archiv\u00e9"],"inLanguage":"fr-FR","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/","url":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/","name":"A Better Measure of Research From the Global South - Research Impact Canada","isPartOf":{"@id":"https:\/\/researchimpact.ca\/fr\/#website"},"datePublished":"2018-07-25T18:57:39+00:00","dateModified":"2021-11-23T14:33:59+00:00","breadcrumb":{"@id":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/researchimpact.ca\/fr\/archive\/a-better-measure-of-research-from-the-global-south\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/researchimpact.ca\/fr\/accueil\/"},{"@type":"ListItem","position":2,"name":"A Better Measure of Research From the Global South"}]},{"@type":"WebSite","@id":"https:\/\/researchimpact.ca\/fr\/#website","url":"https:\/\/researchimpact.ca\/fr\/","name":"Research Impact Canada","description":"","publisher":{"@id":"https:\/\/researchimpact.ca\/fr\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/researchimpact.ca\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/researchimpact.ca\/fr\/#organization","name":"Research Impact Canada","url":"https:\/\/researchimpact.ca\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","contentUrl":"https:\/\/researchimpact.ca\/wp-content\/uploads\/RIC-FR-CMYK.jpg","width":286,"height":66,"caption":"Research Impact Canada"},"image":{"@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/researchimpact.ca\/fr\/#\/schema\/person\/394e3b399bbe436d094e028d9c00962d","name":"Connie Tang","url":"https:\/\/researchimpact.ca\/fr\/author\/connie\/"}]}},"_links":{"self":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/13550","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/comments?post=13550"}],"version-history":[{"count":0,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/posts\/13550\/revisions"}],"wp:attachment":[{"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/media?parent=13550"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/categories?post=13550"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/researchimpact.ca\/fr\/wp-json\/wp\/v2\/tags?post=13550"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}