{"id":1144,"date":"2022-03-24T19:09:21","date_gmt":"2022-03-24T22:09:21","guid":{"rendered":"https:\/\/www.ufrgs.br\/ppgie\/?page_id=1144"},"modified":"2022-03-24T19:09:23","modified_gmt":"2022-03-24T22:09:23","slug":"a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case","status":"publish","type":"page","link":"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/","title":{"rendered":"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case"},"content":{"rendered":"\n<p><strong>Autora:&nbsp;<\/strong>Alause da Silva Pires<\/p>\n\n\n\n<p><strong>Data:&nbsp;<\/strong>28\/04\/2020<\/p>\n\n\n\n<p><strong>Hor\u00e1rio:&nbsp;<\/strong>14:00<\/p>\n\n\n\n<p><strong>Local:&nbsp;<\/strong>https:\/\/mconf.ufrgs.br\/webconf\/00126356<\/p>\n\n\n\n<p><strong>Orientador:&nbsp;<\/strong>Prof. Dr. Eliseo Berni Reategui<\/p>\n\n\n\n<p><strong>Coorientador:&nbsp;<\/strong>Prof. Dr. S\u00e9rgio Kieling Franco<\/p>\n\n\n\n<p><strong>Banca Examinadora:<\/strong><\/p>\n\n\n\n<p>Prof. Dr. Leandro Krug Wives (PPGIE\/UFRGS)<br>Prof. Dr. Eduardo Winter&nbsp; (INPI)<br>Prof. Dr. Robert Evan Verhine (UFBA)<\/p>\n\n\n\n<p><strong>Resumo:&nbsp;<\/strong>The extent and quality of research outputs have become a key focus in evaluating universities\u2019 performance, leading to the introduction of research evaluation systems in several countries. In general, international journal rankings or national ones are an integral part of these systems. Thus, these systems promote the legitimization and reification of those rankings. This study comprises the development of a framework for the analysis of scientific production evaluation systems based on journal ranking lists. Developing this framework may be helpful to evidence some patterns of academic production as well as potential effects induced by these systems. Given that Brazil has such a policy for more than two decades, the framework was applied to QUALIS, the Brazilian journal ranking system, in eight distinct subject fields. First, the framework was designed. After, it was used to correlate QUALIS with SNIP from Scopus and to understand the shift of QUALIS categories from 2007 to 2016, which encompasses three periodic evaluations. The results showed that the designed framework was efficient to reveal some patterns as well as potential effects of journal ranking lists in academic production behavior. Considering Brazil, it was found that it produces fewer and fewer articles in the primary international databases in Social Sciences and Humanities (SSH) when considering the proportion of generated articles over the years. Concerning the studied other subject fields, in the majority, the impact of the chosen journals overall did not change or declined over the years. In most subject fields, the articles concentrated more in journals with the lowest impact in the A1 and A2 categories. Moreover, few journals concentrated most articles over the years. Among them, those with the lower-impact moved to the highest categories of QUALIS over the years. This shift happens simultaneously with the increase in the number of articles in journals with a lower international impact in all fields. In the end, these results showed that the QUALIS system does not seem to encourage publication in journals indexed in major international databases in some subject fields, and overall in high-impact journals. These patterns of specific publications may be considered potential effects of journal ranking lists, which are in a certain way similar to those found by Butler in Australia. Hence, intrinsic characteristics of QUALIS may be related to these patterns, such as it generates journal lists that are deemed national quality indicators of scientific production in Brazil, and these lists are somehow connected to a significant amount of research funding.<\/p>\n\n\n\n<p><strong>Palavras-chave:&nbsp;<\/strong>Research Evaluation Systems, Monitoring Framework, Scientific Production Behavior, And Brazilian Journal Ranking System.<\/p>\n\n\n\n<p><strong>Tese homologada em:<\/strong>&nbsp;22\/07\/2020<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Autora:&nbsp;Alause da Silva Pires Data:&nbsp;28\/04\/2020 Hor\u00e1rio:&nbsp;14:00 Local:&nbsp;https:\/\/mconf.ufrgs.br\/webconf\/00126356 Orientador:&nbsp;Prof. Dr. Eliseo Berni Reategui Coorientador:&nbsp;Prof. Dr. S\u00e9rgio Kieling Franco Banca Examinadora: Prof. Dr. Leandro Krug Wives (PPGIE\/UFRGS)Prof. Dr. Eduardo Winter&nbsp; (INPI)Prof. Dr. Robert Evan Verhine (UFBA) Resumo:&nbsp;The extent and quality of research outputs have become a key focus in evaluating universities\u2019 performance, leading to the introduction of &hellip;<\/p>\n<p class=\"read-more\"> <a class=\"\" href=\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/\"> <span class=\"screen-reader-text\">A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case<\/span> Leia mais &raquo;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-global-header-display":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":""},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v17.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case - Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/\" \/>\n<meta property=\"og:locale\" content=\"pt_BR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case - Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o\" \/>\n<meta property=\"og:description\" content=\"Autora:&nbsp;Alause da Silva Pires Data:&nbsp;28\/04\/2020 Hor\u00e1rio:&nbsp;14:00 Local:&nbsp;https:\/\/mconf.ufrgs.br\/webconf\/00126356 Orientador:&nbsp;Prof. Dr. Eliseo Berni Reategui Coorientador:&nbsp;Prof. Dr. S\u00e9rgio Kieling Franco Banca Examinadora: Prof. Dr. Leandro Krug Wives (PPGIE\/UFRGS)Prof. Dr. Eduardo Winter&nbsp; (INPI)Prof. Dr. Robert Evan Verhine (UFBA) Resumo:&nbsp;The extent and quality of research outputs have become a key focus in evaluating universities\u2019 performance, leading to the introduction of &hellip; A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case Leia mais &raquo;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/\" \/>\n<meta property=\"og:site_name\" content=\"Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o\" \/>\n<meta property=\"article:modified_time\" content=\"2022-03-24T22:09:23+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. tempo de leitura\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutos\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ufrgs.br\/ppgie\/#website\",\"url\":\"https:\/\/www.ufrgs.br\/ppgie\/\",\"name\":\"Programa de P\\u00f3s-Gradua\\u00e7\\u00e3o Inform\\u00e1tica em Educa\\u00e7\\u00e3o\",\"description\":\"O Programa de P\\u00f3s-Gradua\\u00e7\\u00e3o em Inform\\u00e1tica na Educa\\u00e7\\u00e3o (PPGIE) da UFRGS, n\\u00edvel Doutorado, atua em \\u00e1rea interdisciplinar com o objetivo principal de aplicar as tecnologias digitais na Educa\\u00e7\\u00e3o.  O PPGIE tem como objetivo geral propiciar estudos aprofundados na \\u00e1rea de Inform\\u00e1tica na Educa\\u00e7\\u00e3o, formando, prioritariamente, pessoal de alto n\\u00edvel para o exerc\\u00edcio das atividades de pesquisa, ensino e extens\\u00e3o.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ufrgs.br\/ppgie\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"pt-BR\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/#webpage\",\"url\":\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/\",\"name\":\"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case - Programa de P\\u00f3s-Gradua\\u00e7\\u00e3o Inform\\u00e1tica em Educa\\u00e7\\u00e3o\",\"isPartOf\":{\"@id\":\"https:\/\/www.ufrgs.br\/ppgie\/#website\"},\"datePublished\":\"2022-03-24T22:09:21+00:00\",\"dateModified\":\"2022-03-24T22:09:23+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/#breadcrumb\"},\"inLanguage\":\"pt-BR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"P\\u00e1gina Inicial\",\"item\":\"https:\/\/www.ufrgs.br\/ppgie\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case\"}]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case - Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/","og_locale":"pt_BR","og_type":"article","og_title":"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case - Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o","og_description":"Autora:&nbsp;Alause da Silva Pires Data:&nbsp;28\/04\/2020 Hor\u00e1rio:&nbsp;14:00 Local:&nbsp;https:\/\/mconf.ufrgs.br\/webconf\/00126356 Orientador:&nbsp;Prof. Dr. Eliseo Berni Reategui Coorientador:&nbsp;Prof. Dr. S\u00e9rgio Kieling Franco Banca Examinadora: Prof. Dr. Leandro Krug Wives (PPGIE\/UFRGS)Prof. Dr. Eduardo Winter&nbsp; (INPI)Prof. Dr. Robert Evan Verhine (UFBA) Resumo:&nbsp;The extent and quality of research outputs have become a key focus in evaluating universities\u2019 performance, leading to the introduction of &hellip; A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case Leia mais &raquo;","og_url":"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/","og_site_name":"Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o","article_modified_time":"2022-03-24T22:09:23+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. tempo de leitura":"3 minutos"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/www.ufrgs.br\/ppgie\/#website","url":"https:\/\/www.ufrgs.br\/ppgie\/","name":"Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o","description":"O Programa de P\u00f3s-Gradua\u00e7\u00e3o em Inform\u00e1tica na Educa\u00e7\u00e3o (PPGIE) da UFRGS, n\u00edvel Doutorado, atua em \u00e1rea interdisciplinar com o objetivo principal de aplicar as tecnologias digitais na Educa\u00e7\u00e3o.  O PPGIE tem como objetivo geral propiciar estudos aprofundados na \u00e1rea de Inform\u00e1tica na Educa\u00e7\u00e3o, formando, prioritariamente, pessoal de alto n\u00edvel para o exerc\u00edcio das atividades de pesquisa, ensino e extens\u00e3o.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ufrgs.br\/ppgie\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"pt-BR"},{"@type":"WebPage","@id":"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/#webpage","url":"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/","name":"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case - Programa de P\u00f3s-Gradua\u00e7\u00e3o Inform\u00e1tica em Educa\u00e7\u00e3o","isPartOf":{"@id":"https:\/\/www.ufrgs.br\/ppgie\/#website"},"datePublished":"2022-03-24T22:09:21+00:00","dateModified":"2022-03-24T22:09:23+00:00","breadcrumb":{"@id":"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/#breadcrumb"},"inLanguage":"pt-BR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ufrgs.br\/ppgie\/a-framework-for-minitoring-scientific-production-behavior-in-research-evaluation-systems-based-on-journal-ranking-lists-the-brazilian-case\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"P\u00e1gina Inicial","item":"https:\/\/www.ufrgs.br\/ppgie\/"},{"@type":"ListItem","position":2,"name":"A Framework for Minitoring Scientific Production Behavior in Research Evaluation Systems Based on Journal Ranking Lists: The Brazilian Case"}]}]}},"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"depicter-thumbnail":false},"uagb_author_info":{"display_name":"gerente","author_link":"https:\/\/www.ufrgs.br\/ppgie\/author\/gerente\/"},"uagb_comment_info":0,"uagb_excerpt":"Autora:&nbsp;Alause da Silva Pires Data:&nbsp;28\/04\/2020 Hor\u00e1rio:&nbsp;14:00 Local:&nbsp;https:\/\/mconf.ufrgs.br\/webconf\/00126356 Orientador:&nbsp;Prof. Dr. Eliseo Berni Reategui Coorientador:&nbsp;Prof. Dr. S\u00e9rgio Kieling Franco Banca Examinadora: Prof. Dr. Leandro Krug Wives (PPGIE\/UFRGS)Prof. Dr. Eduardo Winter&nbsp; (INPI)Prof. Dr. Robert Evan Verhine (UFBA) Resumo:&nbsp;The extent and quality of research outputs have become a key focus in evaluating universities\u2019 performance, leading to the introduction of&hellip;","_links":{"self":[{"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/pages\/1144"}],"collection":[{"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/comments?post=1144"}],"version-history":[{"count":1,"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/pages\/1144\/revisions"}],"predecessor-version":[{"id":1146,"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/pages\/1144\/revisions\/1146"}],"wp:attachment":[{"href":"https:\/\/www.ufrgs.br\/ppgie\/wp-json\/wp\/v2\/media?parent=1144"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}