Production, centrality, and impact: correlations between different metrics in the field of tourism in Brazil

Authors

DOI:

https://doi.org/10.18225/ci.inf.v50i2.5421

Keywords:

Information Science, Bibliometrics, Tourism journals, Rankings

Abstract

In the last decades, bibliometric metrics have been used to assess the quantity and quality of production
in different areas of knowledge. Often, a single metric is used to rank researchers and institutions, without,
in some cases, justification for its choice. There are, in literature, studies that build rankings of authors and
institutions, using production and impact. However, there are still few surveys that discuss whether the use of
different metrics generates rankings that are more similar or different from each other. There is also little use of
centrality in the field of tourism in Brazil. We calculate and correlate a set of production, centrality, and impact
metrics, which are regularly used to build rankings, through 3,887 articles from 16 Brazilian tourism journals
(1990-2018). Depending on the metrics applied, the rankings created are more similar or divergent from each
other. The collection of data from primary sources and their review was done manually. The calculation of
correlations was made for absolute values and ranking positions. The main result is to show that rankings
based on a low number of metrics, mainly from the same group, can ignore important points in the performance
of authors, institutions, and countries. It is also shown that several correlations are not as high as expected
(e.g., between centrality and impact metrics).

Downloads

Download data is not yet available.

Author Biographies

  • Andre Fontan Kohler, Universidade de São Paulo

    Doutorado em Arquitetura e Urbanismo pela Universidade de São Paulo (FAU-USP) - São Paulo, SP -
    Brasil. Professor Doutor, Escola de Artes, Ciências e Humanidades da Universidade de São Paulo (EACHUSP) - São Paulo, SP - Brasil.

  • Associate Professor, University of Sao Paulo

    Associate Professor, School of Arts, Sciences and Humanities, University of Sao Paulo (EACH-USP), Sao Paulo, SP, Brazil.

    PhD in Computer Science, State University of Campinas (UNICAMP), Campinas, SP, Brazil.

References

BENCKENDORFF, P. Themes and trends in Australian and New Zealand tourism research: A social network analysis of citations in two leading journals (1994–2007). Journal of Hospitality and Tourism Management, v. 16, n.1, p.1–15, 2009. DOI: 10.1375/jhtm.16.1.1.
BENCKENDORFF, P.; ZEHRER, A. A network analysis of tourism research. Annals of Tourism Research, v. 43, p.121–149, 2013. DOI: 10.1016/j.annals.2013.04.005.
BOLLEN, J. et al. A principal component analysis of 39 scientific impact measures. PLoS ONE, v. 4, p.6: e6022, 2009. DOI: 10.1371/journal.pone.0006022.
COHEN, E. Authenticity and commoditization in tourism. Annals of Tourism Research, v. 15, n.3, p.371-386, 1988. DOI: 10.1016/0160-7383(88)90028-X.
DIGIAMPIETRI, L.A. et al. BraX-Ray: an x-ray of the Brazilian computer science graduate programs. PLoS ONE, v. 9, n.4: e94541, 2014. DOI: 10.1371/journal.pone.0094541.
HALL, C.M. Publish and perish? Bibliometric analysis, journal ranking and the assessment of research quality in tourism. Tourism Management, v. 32, n.1, p.16–27, 2011. DOI: 10.1016/j.tourman.2010.07.001.
HIRSCH, J.E. An index to quantify an individual's scientific research output. PNAS, v. 102, n.46, p.16.569–16.572, 2005. DOI: 10.1073/pnas.0507655102.
JAMAL, T.; SMITH, B.; WATSON, E. Ranking, rating and scoring of tourism journals: interdisciplinary challenges and innovations. Tourism Management, v. 29, n.1, p.66–78, 2008. DOI: 10.1016/j.tourman.2007.04.001.
JOGARATNAM, G. et al. An analysis of institutional contributors to three major academic tourism journals: 1992-2001. Tourism Management, v. 26, n.5, p.641-648, 2005. DOI: 10.1016/j.tourman.2004.04.002.
KIRILENKO, A.P.; STEPCHENKOVA, S. Tourism research from its inception to present day: subject area, geography, and gender distributions. PLoS ONE, v. 13, n.11: e0206820, 2018. DOI: 10.1371/journal.pone.0206820.
KOC, E.; BOZ, H. Triangulation in tourism research: a bibliometric study of top three tourism journals. Tourism Management Perspectives, v. 12, p.9–14, 2014. DOI: 10.1016/j.tmp.2014.06.003.
KOSEOGLU, M.A. et al. Bibliometrics studies in tourism. Annals of Tourism Research, v. 61, p.180–198, 2016. DOI: 10.1016/j.annals.2016.10.006.
LAW, R.; VEEN, R. The popularity of prestigious hospitality journals: a Google Scholar approach. International Journal of Contemporary Hospitality Management, v. 20, n.2, p.113-125, 2008. DOI: 10.1108/09596110810852113.
LETA, J.; LEWISON, G. The contribution of women in Brazilian science: a case study in astronomy, immunology and oceanography. Scientometrics, v. 57, n.3, p.339-353, 2003. DOI: 10.1023/A:1025000600840.
LINDEN, R.; BARBOSA, L.F.; DIGIAMPIETRI, L.A. “Brazilian style science”—an analysis of the difference between Brazilian and international Computer Science departments and graduate programs using social networks analysis and bibliometrics. Social Network Analysis and Mining, v. 7, n.44, p.1-19, 2017. DOI: 10.1007/s13278-017-0463-0.
MCCARTY, C. et al. Predicting author h-index using characteristics of the co-author network. Scientometrics, v. 96, p.467-483, 2013. DOI: 10.1007/s11192-012-0933-0.
MCKERCHER, B. A case for ranking tourism journals. Tourism Management, v. 26, n.5, p.649–651, 2005. DOI: 10.1016/j.tourman.2004.04.003.
MCKERCHER, B. A citation analysis of tourism scholars. Tourism Management, v. 29, n.6, p.1.226–1.232, 2008. DOI: 10.1016/j.tourman.2008.03.003.
MENA-CHALCO, J.P. et al. Brazilian bibliometric coauthorship networks. Journal of the Association for Information Science and Technology, v. 65, n.7, p.1.424-1.445, 2014. DOI: 10.1002/asi.23010.
MINISTÉRIO DA EDUCAÇÃO. Relatório do Qualis Periódicos. Área 27: administração pública e de empresas, ciências contábeis e turismo. Brasília: Ministério da Educação, 2019. 8p. Disponível em: <https://capes.gov.br/images/Relatorio_qualis_periodicos_referencia_2019/Relatorio_qualis_Adm.pdf>. Acesso em: 30 ago. 2020.
NYKIEL, R.A. Handbook of marketing research methodologies for hospitality and tourism. Binghamton: The Haworth Hospitality, 2007.
PAGE, S.J. Academic ranking exercises: do they achieve anything meaningful? – A personal view. Tourism Management, v. 26, n.5, p.663–666, 2005. DOI: 10.1016/j.tourman.2004.05.007.
PARK, K. et al. Hospitality and tourism research rankings by author, university, and country using six major journals: the first decade of the new millennium. Journal of Hospitality & Tourism Research, v. 35, n.3, p.381-416, 2011. DOI: 10.1177/1096348011400743.
RACHERLA, P.; HU, C. A social network perspective of tourism research collaborations. Annals of Tourism Research, v. 37, n.4, p.1.012–1.034, 2010. DOI: 10.1016/j.annals.2010.03.008.
STRANDBERG, C. et al. Tourism research in the new millennium: a bibliometric review of literature in Tourism and Hospitality Research. Tourism and Hospitality Research, v. 18, n.3, p.269–285, 2018. DOI: 10.1177/1467358416642010.
TRIBE, J. The indiscipline of tourism. Annals of Tourism Research, v. 24, n.3, p.638–657, 1997. DOI: 10.1016/S0160-7383(97)00020-0.
TRIBE, J. Indisciplined and unsubstantiated. Annals of Tourism Research, v. 27, n.3, p.809–813, 2000. DOI: 10.1016/S0160-7383(99)00122-X.
TRIBE, J. Tribes, territories and networks in the tourism academy. Annals of Tourism Research, v. 37, n.1, p.7–33, 2010. DOI: 10.1016/j.annals.2009.05.001.
WASSERMAN, S.; FAUST, K. Social network analysis: methods and applications. 19. ed. Cambridge: Cambridge University Press, 2009.
WEINER, G. The academic journal: has it a future? Education Policy Analysis Archives, v. 9, n.9, p.1-19, 2001. DOI: 10.14507/epaa.v9n9.2001.
YAN, E.; DING, Y. Applying centrality measures to impact analysis: a coauthorship network analysis. Journal of the American Society for Information Science and Technology, v. 60, n.10, p.2.107-2.118, 2009. DOI: 10.1002/asi.21128.
YE, Q.; LI, T.; LAW, R. A coauthorship network analysis of tourism and hospitality research collaboration. Journal of Hospitality & Tourism Research, v. 37, n.1, p.51-76, 2013. DOI: 10.1177/1096348011425500.
ZHAO, W.; RITCHIE, J.R.B. An investigation of academic leadership in tourism research: 1985–2004. Tourism Management, v.28, n.2, p.476–490, 2007. DOI: 10.1016/j.tourman.2006.03.007.

Published

31/12/2021

Issue

Section

Articles