THE PROPERTY THAT IS FACTUALLY BEING EVALUATED WHEN THEY SAY THEY EVALUATE IMPACT
https://doi.org/10.24108/2658-3143-2019-2-2-129-138
Abstract
Introduction. Analysis of the definitions and perceptions of the notion of “impact”, introduced into circulation by Yu. Garfield in 1955, does not allow to assert that in the scientometrics literature there is a strict definition of this notion at all. Since it is assumed that citedness figures are its reliable indicator, it is necessary to discover what property is actually reflected by this indicator.
Materials and methods. Analytical interpretation of the scientific literature related to this problem since 1955.
Results. Comparison of the notion of “impact” with the possibilities of its quantitative evaluation by citedness figures demonstrated the unreliability of this basic scientometric method for the assessment of exactly “impact” as in terms of cause-and-effect relationships, “impact” may or may not be the reason for the use of scientific documents reflected in their citedness figures. In other words, citedness is not a very reliable proxy (substitute indicator) to be used for assessing poorly defined (as it was shown in my previous article published in Scholarly Research and Information; 2019;2(1):63–73) notion of “impact”. At the same time, citedness figures reflect the value of cited scientific documents (by reflecting their use while the creation of citing documents).
Discussion and Conclusions. If “impact” should not be considered as a key notion of scientometrics, then its place can naturally be taken by the notion of the value of cited documents, their totalities, creators, etc.
About the Author
V. S. Lazarev
Scientific Library of the Belarusian National Technical University
Belarus
Belarus
Vladimir S. Lazarev, Leading Bibliographer of the Marketing and Project Activity Department
Researcher ID: D-5165-2016;
Google Scholar: https://scholar.google.ru/citations?user=-C7EcR8AAAAJ&hl=ru&oi=sra;
Research Gate: https://www.researchgate.net/profile/Vladimir_Lazarev6
References
1. Bornmann L. Is there currently a scientific revolution is scientometrics? Journal of the Association for Information Science and Technology. 2014;65(3):647–648. https://doi.org/10.1002/asi.23073
2. Bornmann L. Is there currently a scientific revolution is scientometrics? Journal of the Association for Information Science and Technology. 2014;65(3):647–648. https://doi.org/10.1002/asi.23073
3. Lazarev V.S. Insufficient Definitions or a Vaguely Grasped Notion? On Definitions of “Impact”. Nauka i nauchnaya informatsiya = Scholarly Research and Information. 2019;2(1):63–78 (In Russ.). https://doi.org/10.24108/2658-3143-2019-2-1-63-78
4. Garfield E. Citation indexes for science: A new dimension in Documentation through association of ideas. Science. 1955;122(3159):108–111.
5. Garfield E. Citation indexes for science: A new dimension in Documentation through association of ideas. Science. 1955;122(3159):108–111.
6. Bornmann L. Is there currently a scientific revolution is scientometrics? Journal of the Association for Information Science and Technology. 2014;65(3):647–648. https://doi.org/10.1002/asi.23073
7. Cole S., Cole J.R. Scientific output and recognition: A study in the operation of the reward system in science. American Sociological Review. 1967;32(3):377–390.
8. Cole S., Cole J.R. Scientific output and recognition: A study in the operation of the reward system in science. American Sociological Review. 1967;32(3):377–390.
9. Garfield E. Citation indexes for science: A new dimension in Documentation through association of ideas. Science. 1955;122(3159):108–111.
10. Garfield E., Malin M.E. Can Nobel Prize winners be predicted? Paper presented at 135th Annual Meeting, American Association for the Advancement of Science, Dallas, Texas — December 26–31, 1968. Eugene Garfield, Ph.D. (1925–2017) S.a. Available at: http://www.garfield.library.upenn.edu/papers/nobelpredicted.pdf ( accessed 13 December 2018).
11. Garfield E., Malin M.E. Can Nobel Prize winners be predicted? Paper presented at 135th Annual Meeting, American Association for the Advancement of Science, Dallas, Texas — December 26–31, 1968. Eugene Garfield, Ph.D. (1925–2017) S.a. Available at: http://www.garfield.library.upenn.edu/papers/nobelpredicted.pdf ( accessed 13 December 2018).
12. Cole S., Cole J.R. Scientific output and recognition: A study in the operation of the reward system in science. American Sociological Review. 1967;32(3):377–390.
13. MacRoberts M.H., MacRoberts B.R. Problems of citation analysis: A critical review. Journal of the American Society for Information Science. 1989;40(5):342–349.
14. MacRoberts M.H., MacRoberts B.R. Problems of citation analysis: A critical review. Journal of the American Society for Information Science. 1989;40(5):342–349.
15. Garfield E., Malin M.E. Can Nobel Prize winners be predicted? Paper presented at 135th Annual Meeting, American Association for the Advancement of Science, Dallas, Texas — December 26–31, 1968. Eugene Garfield, Ph.D. (1925–2017) S.a. Available at: http://www.garfield.library.upenn.edu/papers/nobelpredicted.pdf ( accessed 13 December 2018).
16. MacRoberts M.H., MacRoberts B.R. Problems of citation analysis. Scientometrics. 1996. 36(3): 435–444.
17. MacRoberts M.H., MacRoberts B.R. Problems of citation analysis. Scientometrics. 1996. 36(3): 435–444.
18. MacRoberts M.H., MacRoberts B.R. Problems of citation analysis: A critical review. Journal of the American Society for Information Science. 1989;40(5):342–349.
19. History of citation indexing. In: Essays. S.a., Clarivate Analytics. Available at: https://clarivate.com/ essays/history-citation-indexing/ (accessed 13 December 2018).
20. History of citation indexing. In: Essays. S.a., Clarivate Analytics. Available at: https://clarivate.com/ essays/history-citation-indexing/ (accessed 13 December 2018).
21. MacRoberts M.H., MacRoberts B.R. Problems of citation analysis. Scientometrics. 1996. 36(3): 435–444.
22. Kara-Murza S.G. Citation in Science and Approaches to the Assessment of Scientific Impact. Vestnik AN SSSR = Herald of the USSR AS. 1981;(5):68–75 (In Russ.).
23. Kara-Murza S.G. Citation in Science and Approaches to the Assessment of Scientific Impact. Vestnik AN SSSR = Herald of the USSR AS. 1981;(5):68–75 (In Russ.).
24. History of citation indexing. In: Essays. S.a., Clarivate Analytics. Available at: https://clarivate.com/ essays/history-citation-indexing/ (accessed 13 December 2018).
25. Voverene O.I. On evaluation of the effectiveness of selective information dissemination systems. Nauchno-tekhnicheskaya informatsiya. Ser. 1. = Scientific and Technical Information. 1973;(9):12–14 (In Russ.).
26. Voverene O.I. On evaluation of the effectiveness of selective information dissemination systems. Nauchno-tekhnicheskaya informatsiya. Ser. 1. = Scientific and Technical Information. 1973;(9):12–14 (In Russ.).
27. Kara-Murza S.G. Citation in Science and Approaches to the Assessment of Scientific Impact. Vestnik AN SSSR = Herald of the USSR AS. 1981;(5):68–75 (In Russ.).
28. Mirskaya E.Z. The mechanism of assessment and formation of knowledge in the natural sciences. Voprosy filosofii = Problems of philosophy. 1976;(5):119–130 (In Russ.).
29. Mirskaya E.Z. The mechanism of assessment and formation of knowledge in the natural sciences. Voprosy filosofii = Problems of philosophy. 1976;(5):119–130 (In Russ.).
30. Voverene O.I. On evaluation of the effectiveness of selective information dissemination systems. Nauchno-tekhnicheskaya informatsiya. Ser. 1. = Scientific and Technical Information. 1973;(9):12–14 (In Russ.).
31. Lazarev V.S. On chaos in bibliometric terminology. Scientometrics. 1996;35(2):271–277. https://doi.org/10.1007/BF02018485
32. Lazarev V.S. On chaos in bibliometric terminology. Scientometrics. 1996;35(2):271–277. https://doi.org/10.1007/BF02018485
33. Mirskaya E.Z. The mechanism of assessment and formation of knowledge in the natural sciences. Voprosy filosofii = Problems of philosophy. 1976;(5):119–130 (In Russ.).
34. Lazarev V.S. Properties of scientific periodicals under bibliometric assessment. International Journal of Information Sciences for Decision Making. 1997;(1):1–17. Available at: http://isdm.univ-tln.fr/PDF/isdm1/isdm1a6_lazarev.pdf (accessed 13 December 2018).
35. Lazarev V.S. Properties of scientific periodicals under bibliometric assessment. International Journal of Information Sciences for Decision Making. 1997;(1):1–17. Available at: http://isdm.univ-tln.fr/PDF/isdm1/isdm1a6_lazarev.pdf (accessed 13 December 2018).
36. Lazarev V.S. On chaos in bibliometric terminology. Scientometrics. 1996;35(2):271–277. https://doi.org/10.1007/BF02018485
37. van Raan A.F.J. In matters of quantitative studies of science the fault of theorists is offering too little and asking too much. Scientometrics. 1998;43(1):129–139. https://doi.org/10.1007/BF02458401
38. van Raan A.F.J. In matters of quantitative studies of science the fault of theorists is offering too little and asking too much. Scientometrics. 1998;43(1):129–139. https://doi.org/10.1007/BF02458401
39. Lazarev V.S. Properties of scientific periodicals under bibliometric assessment. International Journal of Information Sciences for Decision Making. 1997;(1):1–17. Available at: http://isdm.univ-tln.fr/PDF/isdm1/isdm1a6_lazarev.pdf (accessed 13 December 2018).
40. Lazarev V.S. Citation analysis in the context of nobelistics: citedness figures (An essay of a bibliometrician) In: Tyutyunnik V.M., Gorbunov G.V. (eds) Nobelistika. Naukovedenie. Informatika: Materialy 5 Mezhdunarodnoi vstrechi-konferentsii laureatov Nobelevskikh premii i nobelistov; 5 Mezhdunarodnoi (7 Tambovskoi) nauchnoi konferentsii “Informatika i naukovedenie”, Tambov, 17–20 November, 1998. Tambov: Tambov State University, 1999.
41. Lazarev V.S. Citation analysis in the context of nobelistics: citedness figures (An essay of a bibliometrician) In: Tyutyunnik V.M., Gorbunov G.V. (eds) Nobelistika. Naukovedenie. Informatika: Materialy 5 Mezhdunarodnoi vstrechi-konferentsii laureatov Nobelevskikh premii i nobelistov; 5 Mezhdunarodnoi (7 Tambovskoi) nauchnoi konferentsii “Informatika i naukovedenie”, Tambov, 17–20 November, 1998. Tambov: Tambov State University, 1999.
42. van Raan A.F.J. In matters of quantitative studies of science the fault of theorists is offering too little and asking too much. Scientometrics. 1998;43(1):129–139. https://doi.org/10.1007/BF02458401
43. Bornmann L., Mutz R., Neuhaus C., Daniel Y.-D. Citation counts for research evaluation: standards of good practice for analyzing bibliometric data and presenting and interpreting results. Ethics in Science and Environmental Politics. 2008;8:93–102. https://doi.org/10.3354/esep00084
44. Bornmann L., Mutz R., Neuhaus C., Daniel Y.-D. Citation counts for research evaluation: standards of good practice for analyzing bibliometric data and presenting and interpreting results. Ethics in Science and Environmental Politics. 2008;8:93–102. https://doi.org/10.3354/esep00084
45. Lazarev V.S. Citation analysis in the context of nobelistics: citedness figures (An essay of a bibliometrician) In: Tyutyunnik V.M., Gorbunov G.V. (eds) Nobelistika. Naukovedenie. Informatika: Materialy 5 Mezhdunarodnoi vstrechi-konferentsii laureatov Nobelevskikh premii i nobelistov; 5 Mezhdunarodnoi (7 Tambovskoi) nauchnoi konferentsii “Informatika i naukovedenie”, Tambov, 17–20 November, 1998. Tambov: Tambov State University, 1999.
46. Lazarev V.S. Scientific documents and their regulated totalities: citedness, use, value. Mezhdunarodnyi forum po informatsii = International Forum on Information. 2017;42(1):3–16 (In Russ.). Available at: http://lamb.viniti.ru/sid2/sid2free?sid2=J15472040 (accessed 13 December 2018).
47. Lazarev V.S. Scientific documents and their regulated totalities: citedness, use, value. Mezhdunarodnyi forum po informatsii = International Forum on Information. 2017;42(1):3–16 (In Russ.). Available at: http://lamb.viniti.ru/sid2/sid2free?sid2=J15472040 (accessed 13 December 2018).
48. Bornmann L., Mutz R., Neuhaus C., Daniel Y.-D. Citation counts for research evaluation: standards of good practice for analyzing bibliometric data and presenting and interpreting results. Ethics in Science and Environmental Politics. 2008;8:93–102. https://doi.org/10.3354/esep00084
49. Lazarev V.S. Is it right to consider the level of citations to scientific papers as the indicator of their quality? In: Grusha A.I. et al. (eds) Naukometriya: metodologiya, instrumenty, prakticheskoe primenenie: sbornik nauchnykh statei, Minsk: Belaruskaya navuka Publ.; 2018 (In Russ.). Available at: https://rep.bntu.by/handle/data/37342 (accessed 13 December 2018).
50. Lazarev V.S. Is it right to consider the level of citations to scientific papers as the indicator of their quality? In: Grusha A.I. et al. (eds) Naukometriya: metodologiya, instrumenty, prakticheskoe primenenie: sbornik nauchnykh statei, Minsk: Belaruskaya navuka Publ.; 2018 (In Russ.). Available at: https://rep.bntu.by/handle/data/37342 (accessed 13 December 2018).
51. Lazarev V.S. Scientific documents and their regulated totalities: citedness, use, value. Mezhdunarodnyi forum po informatsii = International Forum on Information. 2017;42(1):3–16 (In Russ.). Available at: http://lamb.viniti.ru/sid2/sid2free?sid2=J15472040 (accessed 13 December 2018).
52. Fussler H.H. Characteristics of the research literature used by chemists and physicists in the United States. Library Quarterly. 1949;19(1):19–35.
53. Fussler H.H. Characteristics of the research literature used by chemists and physicists in the United States. Library Quarterly. 1949;19(1):19–35.
54. Lazarev V.S. Is it right to consider the level of citations to scientific papers as the indicator of their quality? In: Grusha A.I. et al. (eds) Naukometriya: metodologiya, instrumenty, prakticheskoe primenenie: sbornik nauchnykh statei, Minsk: Belaruskaya navuka Publ.; 2018 (In Russ.). Available at: https://rep.bntu.by/handle/data/37342 (accessed 13 December 2018).
55. Simkin M.V., Roychowdhury V.P. Stochastic modeling of citation slips. Scientometrics. 2005;62(3):367– 384. https://doi.org/10.1007/s11192-005-0028-2
56. Simkin M.V., Roychowdhury V.P. Stochastic modeling of citation slips. Scientometrics. 2005;62(3):367– 384. https://doi.org/10.1007/s11192-005-0028-2
57. Fussler H.H. Characteristics of the research literature used by chemists and physicists in the United States. Library Quarterly. 1949;19(1):19–35.
58. Kurtz M.J., Bollen J. Usage bibliometrics. Annual Review of Information Science and Technology. 2010;44(1):3–64. https://doi.org/10.1002/aris.2010.1440440108
59. Kurtz M.J., Bollen J. Usage bibliometrics. Annual Review of Information Science and Technology. 2010;44(1):3–64. https://doi.org/10.1002/aris.2010.1440440108
60. Simkin M.V., Roychowdhury V.P. Stochastic modeling of citation slips. Scientometrics. 2005;62(3):367– 384. https://doi.org/10.1007/s11192-005-0028-2
61. Lazarev V.S. Reprint requests analysis in documentation (concerning the paper by W.I.B. Onuigbo). International Forum on Information and Documentation. 1986:11(2):40–41. Available at: https://rep.bntu.by/handle/data/25448 (accessed 13 December 2018).
62. Lazarev V.S. Reprint requests analysis in documentation (concerning the paper by W.I.B. Onuigbo). International Forum on Information and Documentation. 1986:11(2):40–41. Available at: https://rep.bntu.by/handle/data/25448 (accessed 13 December 2018).
63. Kurtz M.J., Bollen J. Usage bibliometrics. Annual Review of Information Science and Technology. 2010;44(1):3–64. https://doi.org/10.1002/aris.2010.1440440108
64. Lazarev V.S. Readers’ addressing to scientific periodicals as an indicator of the thematic focus of publications. In: Metodologicheskie problemy meditsinskoi informatiki i naukovedeniya: Sbornik nauchnykh trudov. Moscow, “Soyuzmedinform” Research and Production Association et al.; 1989 (In Russ.). Available at: https://rep.bntu.by/handle/data/25434 (accessed 13 December 2018).
65. Lazarev V.S. Readers’ addressing to scientific periodicals as an indicator of the thematic focus of publications. In: Metodologicheskie problemy meditsinskoi informatiki i naukovedeniya: Sbornik nauchnykh trudov. Moscow, “Soyuzmedinform” Research and Production Association et al.; 1989 (In Russ.). Available at: https://rep.bntu.by/handle/data/25434 (accessed 13 December 2018).
66. Lazarev V.S. Reprint requests analysis in documentation (concerning the paper by W.I.B. Onuigbo). International Forum on Information and Documentation. 1986:11(2):40–41. Available at: https://rep.bntu.by/handle/data/25448 (accessed 13 December 2018).
67. Scales P.A. Citation analysis as indicator of the use of serials: A comparison of ranked titles lists produced by counting and from the use data. Journal of Documentation. 1977;32:17–25. https://doi.org/10.1108/eb026612
68. Scales P.A. Citation analysis as indicator of the use of serials: A comparison of ranked titles lists produced by counting and from the use data. Journal of Documentation. 1977;32:17–25. https://doi.org/10.1108/eb026612
69. Lazarev V.S. Readers’ addressing to scientific periodicals as an indicator of the thematic focus of publications. In: Metodologicheskie problemy meditsinskoi informatiki i naukovedeniya: Sbornik nauchnykh trudov. Moscow, “Soyuzmedinform” Research and Production Association et al.; 1989 (In Russ.). Available at: https://rep.bntu.by/handle/data/25434 (accessed 13 December 2018).
70. Garfield E. Why are the impacts of the leading medical journals so similar and yet so different? Item-by-item audits reveal a diversity of editorial material. Current Contents. 1987;(2):7–13.
71. Garfield E. Why are the impacts of the leading medical journals so similar and yet so different? Item-by-item audits reveal a diversity of editorial material. Current Contents. 1987;(2):7–13.
72. Scales P.A. Citation analysis as indicator of the use of serials: A comparison of ranked titles lists produced by counting and from the use data. Journal of Documentation. 1977;32:17–25. https://doi.org/10.1108/eb026612
73. Nederhof A.J., van Raan A.F.J. Citation theory and the Ortega hypothesis. Scientometrics. 1987;12(5– 6):325–328. https://doi.org/10.1007/BF02016674
74. Nederhof A.J., van Raan A.F.J. Citation theory and the Ortega hypothesis. Scientometrics. 1987;12(5– 6):325–328. https://doi.org/10.1007/BF02016674
75. Garfield E. Why are the impacts of the leading medical journals so similar and yet so different? Item-by-item audits reveal a diversity of editorial material. Current Contents. 1987;(2):7–13.
76. Liu M. Progress in documentation — the complexities of citation practice: a review of citation studies. Journal of Documentation. 1993;49(4):370–408.
77. Liu M. Progress in documentation — the complexities of citation practice: a review of citation studies. Journal of Documentation. 1993;49(4):370–408.
78. Nederhof A.J., van Raan A.F.J. Citation theory and the Ortega hypothesis. Scientometrics. 1987;12(5– 6):325–328. https://doi.org/10.1007/BF02016674
79. Merton R.K. The sociology of science: An episodic memoir. In: The sociology of science in Europe. Carbondale: Southern Illinois Univercity Press, 1977. Cited according to [29, page 100].
80. Merton R.K. The sociology of science: An episodic memoir. In: The sociology of science in Europe. Carbondale: Southern Illinois Univercity Press, 1977. Cited according to [29, page 100].
81. Liu M. Progress in documentation — the complexities of citation practice: a review of citation studies. Journal of Documentation. 1993;49(4):370–408.
82. Bredikhin S.V., Kuznetsov A.Yu., Shcherbakova N.G. Citation analysis in bibliometrics. Novosibirsk: Institute of Computational Mathematics and Mathematical Geophysics of the Siberian Branch of the Russian Academy of Sciences et al., 2013 (In Russ.).
83. Bredikhin S.V., Kuznetsov A.Yu., Shcherbakova N.G. Citation analysis in bibliometrics. Novosibirsk: Institute of Computational Mathematics and Mathematical Geophysics of the Siberian Branch of the Russian Academy of Sciences et al., 2013 (In Russ.).
84. Merton R.K. The sociology of science: An episodic memoir. In: The sociology of science in Europe. Carbondale: Southern Illinois Univercity Press, 1977. Cited according to [29, page 100].
85. Dictionary of informatics terms. Moscow: International Centre for Scientific and Technical Information, 1975 (In Russ.).
86. Dictionary of informatics terms. Moscow: International Centre for Scientific and Technical Information, 1975 (In Russ.).
87. Bredikhin S.V., Kuznetsov A.Yu., Shcherbakova N.G. Citation analysis in bibliometrics. Novosibirsk: Institute of Computational Mathematics and Mathematical Geophysics of the Siberian Branch of the Russian Academy of Sciences et al., 2013 (In Russ.).
88. Zozulich M.F., Vendeleva M.A. Specific features of enterprise information resources management. In: Ekonomika i effektivnost’ organizatsii proizvodstva: sbornik nauchnykh trudov po itogam Mezhdunarodnoi nauchno-tekhnicheskoi konferentsii. Issue 9. Bryansk: BSITA, 2008 (In Russ.).
89. Zozulich M.F., Vendeleva M.A. Specific features of enterprise information resources management. In: Ekonomika i effektivnost’ organizatsii proizvodstva: sbornik nauchnykh trudov po itogam Mezhdunarodnoi nauchno-tekhnicheskoi konferentsii. Issue 9. Bryansk: BSITA, 2008 (In Russ.).
90. Dictionary of informatics terms. Moscow: International Centre for Scientific and Technical Information, 1975 (In Russ.).
91. Minkina V.A. The study of documentary flows to determine the value properties of technical literature. In: Trudy Leningradskogo gosudarstvennogo instituta kul’tury. V. 76: The documentary flows on natural Sciences and engineering and problems bibliography. Leningrad, 1983 (In Russ.).
92. Minkina V.A. The study of documentary flows to determine the value properties of technical literature. In: Trudy Leningradskogo gosudarstvennogo instituta kul’tury. V. 76: The documentary flows on natural Sciences and engineering and problems bibliography. Leningrad, 1983 (In Russ.).
93. Zozulich M.F., Vendeleva M.A. Specific features of enterprise information resources management. In: Ekonomika i effektivnost’ organizatsii proizvodstva: sbornik nauchnykh trudov po itogam Mezhdunarodnoi nauchno-tekhnicheskoi konferentsii. Issue 9. Bryansk: BSITA, 2008 (In Russ.).
94. Garfield E. Quality of impact factor of general medical journals — PRADVA wins hands down. British Medical Journal. 2003;326(7383):283. https://doi.org/10.1136/bmj.326.7383.283
95. Garfield E. Quality of impact factor of general medical journals — PRADVA wins hands down. British Medical Journal. 2003;326(7383):283. https://doi.org/10.1136/bmj.326.7383.283
96. Minkina V.A. The study of documentary flows to determine the value properties of technical literature. In: Trudy Leningradskogo gosudarstvennogo instituta kul’tury. V. 76: The documentary flows on natural Sciences and engineering and problems bibliography. Leningrad, 1983 (In Russ.).
97. Tahamtan I., Afshar A.S.K., Ahamdzadeh K. Factors affecting number of citations: a comprehensive review of the literature. Scientometrics. 2016;107(3):1195–1225. https://doi.org/10.1007/s11192-016-1889-2
98. Tahamtan I., Afshar A.S.K., Ahamdzadeh K. Factors affecting number of citations: a comprehensive review of the literature. Scientometrics. 2016;107(3):1195–1225. https://doi.org/10.1007/s11192-016-1889-2
99. Garfield E. Quality of impact factor of general medical journals — PRADVA wins hands down. British Medical Journal. 2003;326(7383):283. https://doi.org/10.1136/bmj.326.7383.283
100. Hamid R. Jamali H.R., Nikzad M. Article title type and its relation with the number of downloads and citations. Scientometrics. 2011;88(2):653–661. https://doi.org/10.1007/s11192-011-0412-z
101. Hamid R. Jamali H.R., Nikzad M. Article title type and its relation with the number of downloads and citations. Scientometrics. 2011;88(2):653–661. https://doi.org/10.1007/s11192-011-0412-z
102. Tahamtan I., Afshar A.S.K., Ahamdzadeh K. Factors affecting number of citations: a comprehensive review of the literature. Scientometrics. 2016;107(3):1195–1225. https://doi.org/10.1007/s11192-016-1889-2
103. Garfield E. Is citation analysis a legitimate evaluation tool? Scientometrics. 1979;1(4):359–375.
104. Garfield E. Is citation analysis a legitimate evaluation tool? Scientometrics. 1979;1(4):359–375.
105. Hamid R. Jamali H.R., Nikzad M. Article title type and its relation with the number of downloads and citations. Scientometrics. 2011;88(2):653–661. https://doi.org/10.1007/s11192-011-0412-z
106. Gove Ph.B. (ed.-in-chief) Webster’s Third New International Dictionary of the English Language. Unabridged. Utilizing All the Experience and Resources of More than One Hundred Years of Merriam-Webster Dictionaries. Cologne: Köneman, 1993. 2663 p.
107. Gove Ph.B. (ed.-in-chief) Webster’s Third New International Dictionary of the English Language. Unabridged. Utilizing All the Experience and Resources of More than One Hundred Years of Merriam-Webster Dictionaries. Cologne: Köneman, 1993. 2663 p.
108. Garfield E. Is citation analysis a legitimate evaluation tool? Scientometrics. 1979;1(4):359–375.
109. Quality management system. Basic provisions and vocabulary. STB ISO 9000-2015 (ISO 9000:2015, IDT). — Instead of STB ISO 9000-2006; introduced 2016-03-01. Minsk: Gosstandart Publ. et al., 2015 (In Russ.).
110. Quality management system. Basic provisions and vocabulary. STB ISO 9000-2015 (ISO 9000:2015, IDT). — Instead of STB ISO 9000-2006; introduced 2016-03-01. Minsk: Gosstandart Publ. et al., 2015 (In Russ.).
111. Gove Ph.B. (ed.-in-chief) Webster’s Third New International Dictionary of the English Language. Unabridged. Utilizing All the Experience and Resources of More than One Hundred Years of Merriam-Webster Dictionaries. Cologne: Köneman, 1993. 2663 p.
112. Quality management system. Basic provisions and vocabulary (Amended) GOST R ISO 9000-2015 (National Standard of the Russian Federation) (In Russ.). Available at: http://docs.cntd.ru/document/1200124393 (accessed 13 December 2018).
113. Quality management system. Basic provisions and vocabulary (Amended) GOST R ISO 9000-2015 (National Standard of the Russian Federation) (In Russ.). Available at: http://docs.cntd.ru/document/1200124393 (accessed 13 December 2018).
114. Quality management system. Basic provisions and vocabulary. STB ISO 9000-2015 (ISO 9000:2015, IDT). — Instead of STB ISO 9000-2006; introduced 2016-03-01. Minsk: Gosstandart Publ. et al., 2015 (In Russ.).
115. Thelwall M. Not dead, just resting: The practical value of per publications citation indicators. Journal of Informetrics. 2016;10(2):667–670.
116. Thelwall M. Not dead, just resting: The practical value of per publications citation indicators. Journal of Informetrics. 2016;10(2):667–670.
117. Quality management system. Basic provisions and vocabulary (Amended) GOST R ISO 9000-2015 (National Standard of the Russian Federation) (In Russ.). Available at: http://docs.cntd.ru/document/1200124393 (accessed 13 December 2018).
118. Martin B.R., Irvine J. Assessing basic research. Some partial indicators of scientific progress in radio astronomy. Research Policy. 1983;12(2):61–90.
119. Martin B.R., Irvine J. Assessing basic research. Some partial indicators of scientific progress in radio astronomy. Research Policy. 1983;12(2):61–90.
120. Thelwall M. Not dead, just resting: The practical value of per publications citation indicators. Journal of Informetrics. 2016;10(2):667–670.
121. Martin B.R., Irvine J. Assessing basic research. Some partial indicators of scientific progress in radio astronomy. Research Policy. 1983;12(2):61–90.
Review
For citations:
Lazarev V.S. THE PROPERTY THAT IS FACTUALLY BEING EVALUATED WHEN THEY SAY THEY EVALUATE IMPACT. Scholarly Research and Information. 2019;2(2):129-138. (In Russ.) https://doi.org/10.24108/2658-3143-2019-2-2-129-138
Views:
2234
Email this article 