Skip to main content
Springer Nature Link
Log in

Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

The family of indicators presented in this paper includes indices created by taking into account not only the direct but also the indirect impact of citations and references. Three types of citation graphs are presented, namely, the Paper-Citation graph, the Author-Citation graph and the Journal-Citation graph, along with different methods for constructing them. In addition, the concept of generations of citations is examined in detail, again by presenting various methods for defining them found in the literature. Finally, a number of indirect indicators for papers, authors and journals are discussed, which among others, include PageRank, CiteRank, indirect h-index and the EigenFactor score.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  • Anderson, T. R., Hankin, R. K. S., & Killworth, P.D. (2008). Beyond the Durfee square: enhancing the h-index to score total publication output. Scientometrics, 76(3), 577–588.

    Article  Google Scholar 

  • Antonakis, J., & Lalive, R. (2008). Quantifying scholarly impact: IQp versus the Hirsch h. Journal of the American Society for Information Science and Technology, 59(6), 956–969.

    Article  Google Scholar 

  • Atallah, G., & Rodríguez, G. (2006). Indirect patent citations. Scientometrics, 67, 437–465

    Google Scholar 

  • Batista, P. D., Campiteli, M. G., & Kinouchi, O. (2006). Is it possible to compare researchers with different scientific interests? Scientometrics, 68(1), 179–189.

    Article  Google Scholar 

  • Bergstrom, C. T. (2007). Eigenfactor: Measuring the value and prestige of scholarly journals. C&RL News 68(5)

  • Bergstrom, C. T., West, J. D., & Wiseman, M. A. (2008). The EigenfactorTM metrics. The Journal of Neuroscience, 28(45), 11433–11434.

    Article  Google Scholar 

  • Bollen, J., Rodriguez, M. A., & Van de Sompel, H. (2006). Journal status. Scientometrics, 69(3), 669–687.

    Article  Google Scholar 

  • Cabrerizo, F., Alonso, S., Herrera-Viedma, E., & Herrera, F. (2010). q2-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core. Journal of Informetrics, 4(1), 23–28.

    Article  Google Scholar 

  • Costas, R., & Bordons, M. (2008). Is g-index better than h-index? An exploratory study at the individual level. Scientometrics, 77(2), 267–288.

    Article  Google Scholar 

  • Dervos, D. A., & Kalkanis, T. (2005). cc-IFF: A Cascading Citations Impact Factor Framework for the Automatic Ranking of Research Publications. In Intelligent data acquisition and advanced computing systems: technology and applications, 2005. IDAACS 2005. IEEE, pp 668–673

  • Dervos, D. A., Samaras, N., Evangelidis, G., & Folias, T. (2006). A new framework for the citation indexing paradigm. Proceedings of the American Society for Information Science and Technology, 43(1), 1–16.

    Article  Google Scholar 

  • Egghe, L. (2006) Theory and practise of the g-index. Scientometrics, 69(1), 131–152.

    Article  MathSciNet  Google Scholar 

  • Egghe, L. (2011a). The single publication H-index and the indirect H-index of a researcher. Scientometrics, 88, 1003–1004.

    Article  Google Scholar 

  • Egghe, L. (2011b). The single publication H-index of papers in the Hirsch-core of a researcher and the indirect H-index. Scientometrics, 89, 727–739.

    Article  Google Scholar 

  • eigenFACTORorg (2008). EigenfactorTM score and article influenceTM Score: Detailed methods [version 2.01]. www.eigenfactor.org/methods.pdf.

  • Fragkiadaki, E., Evangelidis, G., Samaras, N., & Dervos, D. A. (2011). f-Value: measuring an article’s scientific impact. Scientometrics, 86(3), 671–686.

    Article  Google Scholar 

  • Garfield, E. (1999). Journal impact factor: a brief review. Canadian Medical Association Journal, 161(8), 979–980.

    Google Scholar 

  • Garfield, E. (2005). The agony and the Ecstasy— the history and meaning of the journal impact factor.

  • González-Pereira, B., Guerrero-Bote, V. P., & Moya-Anegón, F. (2010). A new approach to the metric of journals’ scientific prestige: The SJR indicator. Journal of Informetrics, 4(3), 379–391.

    Article  Google Scholar 

  • Guerrero-Bote, V. P., & Moya-Anegón, F. (2012). A further step forward in measuring journals’ scientific prestige: The SJR2 indicator. Journal of Informetrics, 6(4), 674–688.

    Article  Google Scholar 

  • Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. Proceedings of the National Academy of Sciences of the United States of America, 102(46), 16569–16572.

    Article  Google Scholar 

  • Hirsch, J. E. (2007). Does the h-index have predictive power?. Proceedings of the National Academy of Sciences of the United States of America, 104(49), 19193–19198.

    Article  Google Scholar 

  • Hu, X., Rousseau, R., & Chen, J. (2011). On the definition of forward and backward citation generations. Journal of Informetrics, 5(1), 27–36.

    Article  Google Scholar 

  • Jin, B., Liang, L., Rousseau, R., & Egghe, L. (2007). The R- and AR-indices: complementing the h-index. Chinese Science Bulletin, 52(6), 855–863.

    Article  Google Scholar 

  • Kosmulski, M. (2006). A new Hirsch-type index saves time and works equally well as the original h-index. ISSI Newsletter pp 4–6

  • Kosmulski, M. (2010). Hirsch-type approach to the 2nd generation citations. Journal of Informetrics, 4(3), 257–264.

    Article  Google Scholar 

  • Ma, N., Guan, J., & Zhao, Y. (2008). Bringing PageRank to the citation analysis. Information Processing & Management, 44(2), 800–810.

    Article  Google Scholar 

  • Maslov, S., & Redner, S. (2008). Promise and pitfalls of extending google’s PageRank algorithm to citation networks. The Journal of Neuroscience, 28(44), 11,103–11,105.

    Article  Google Scholar 

  • Page, L., Brin, S., Motwani, R., & Winograd, T. (1999). The PageRank citation ranking: bringing order to the web. Technical report 1999–66, Stanford InfoLab.

  • Pinski G., & Narin F. (1976). Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Information Processing & Management, 12(5), 297–312.

    Google Scholar 

  • Radicchi, F., Fortunato, S., Markines, B., Vespignani, A. (2009). Diffusion of scientific credits and the ranking of scientists. Phys Rev E, 80, 056,103.

    Google Scholar 

  • Radicchi, F., Fortunato, S., & Vespignani, A. (2012). Citation networks. Understanding Complex Systems. Berlin: Springer, pp 233–257.

  • Rousseau, R. (1987). The Gozinto theorem: Using citations to determine influences on a scientific publication. Scientometrics, 11, 217–229.

    Article  Google Scholar 

  • Schubert, A. (2009). Using the h-index for assessing single publications. Scientometrics, 78, 559–565.

    Article  Google Scholar 

  • Sidiropoulos, A., & Manolopoulos, Y. (2005). A citation-based system to assist prize awarding. SIGMOD Rec, 34(4), 54–60.

    Article  Google Scholar 

  • Sidiropoulos, A., Katsaros, D., & Manolopoulos, Y. (2007). Generalized Hirsch h-index for disclosing latent facts in citation networks. Scientometrics, 72, 253–280.

    Article  Google Scholar 

  • Su, C., Pan, Y., Zhen, Y., Ma, Z., Yuan, J., Guo, H., Yu, Z., Ma, C., & Wu, Y. (2011). PrestigeRank: A new evaluation method for papers and journals. Journal of Informetrics, 5(1), 1–13.

    Article  Google Scholar 

  • Tol, R. S. (2008). A rational, successive g-index applied to economics departments in Ireland. Journal of Informetrics, 2(2), 149–155.

    Article  Google Scholar 

  • van Eck, N. J., & Waltman, L. (2008) Generalizing the h- and g-indices. Journal of Informetrics, 2(4), 263–271.

    Article  Google Scholar 

  • Walker, D., Xie, H., Yan, K. K., & Maslov, S. (2007). Ranking scientific publications using a model of network traffic. Journal of Statistical Mechanics, (06), P06,010.

    Google Scholar 

  • Waltman, L., & van Eck, N. J. (2012). The inconsistency of the h-index. Journal of the American Society for Information Science and Technology, 63(2), 406–415.

    Article  Google Scholar 

  • Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & van Raan, A. F. (2011a). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics, 5(1), 37–47.

    Article  Google Scholar 

  • Waltman, L., Yan, E., van Eck, N. (2011b). A recursive field-normalized bibliometric performance indicator: an application to the field of library and information science. Scientometrics, 89, 301–314.

    Article  Google Scholar 

  • West, J. D., Jensen, M. C., Dandrea, R. J., Gordon, G. J., & Bergstrom, C. T. (2013). Author-level Eigenfactor metrics: Evaluating the influence of authors, institutions, and countries within the social science research network community. Journal of the American Society for Information Science and Technology, 64(4), 787–801.

    Article  Google Scholar 

  • Wu, Q. (2010). The w-index: A measure to assess scientific impact by focusing on widely cited papers. Journal of the American Society for Information Science and Technology, 61(3), 609–614.

    Google Scholar 

  • Yan, E., Ding, Y., & Sugimoto, C. R. (2011). P-Rank: An indicator measuring prestige in heterogeneous scholarly networks. Journal of the American Society for Information Science and Technology 62(3), 467–477.

    Google Scholar 

Download references

Acknowledgements

We would like to thank the reviewers for their helpful and constructive comments.

Author information

Authors and Affiliations

  1. Department of Applied Informatics, School of Information Sciences, University of Macedonia, 156 Egnatia St, 54006, Thessaloniki, Greece

    Eleni Fragkiadaki & Georgios Evangelidis

Authors
  1. Eleni Fragkiadaki
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Georgios Evangelidis
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Eleni Fragkiadaki.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fragkiadaki, E., Evangelidis, G. Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals. Scientometrics 99, 261–288 (2014). https://doi.org/10.1007/s11192-013-1175-5

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-013-1175-5

Keywords