Abstract
The amount of research articles produced every day is overwhelming: scholarly knowledge is getting harder to communicate and easier to get lost. A possible solution is to represent the information in knowledge graphs: structures representing knowledge in networks of entities, their semantic types, and relationships between them. But this solution has its own drawback: given its very specific task, it requires new methods for designing and evaluating user interfaces. In this paper, we propose an approach for user interface evaluation in the knowledge communication domain. We base our methodology on the well-established Cognitive Walkthough approach but employ a different set of questions, tailoring the method towards domain-specific needs. We demonstrate our approach on a scholarly knowledge graph implementation called Open Research Knowledge Graph (ORKG).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Auer, Sören., Bizer, Christian, Kobilarov, Georgi, Lehmann, Jens, Cyganiak, Richard, Ives, Zachary: DBpedia: a nucleus for a web of open data. In: Aberer, K., et al. (eds.) ASWC/ISWC -2007. LNCS, vol. 4825, pp. 722–735. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-76298-0_52
Auer, S., et al.: Improving access to scientific literature with knowledge graphs. Bibliothek Forschung und Praxis 44(3), 516–529 (2020)
Card, S.K., Moran, T.P., Newell, A.: The psychology of human-computer interaction
Clark, J., Van Oorschot, P.C., Adams, C.: Usability of anonymous web browsing: an examination of tor interfaces and deployability. In: Proceedings of the 3rd Symposium on Usable Privacy and Security pp. 41–51 (2007)
Gauselmann, P., Runge, Y., Jilek, C., Frings, C., Maus, H., Tempel, T.: A relief from mental overload in a digitalized world: How context-sensitive user interfaces can enhance cognitive performance. Int. J. Hum.-Comput. Interact. 39(1), 140–150 (2023)
Herrmannova, D., Knoth, P.: An analysis of the microsoft academic graph. D-lib Mag. 22, 9/10 (2016)
Hornbæk, K.: Current practice in measuring usability: challenges to usability studies and research. Int. J. Hum Comput Stud. 64(2), 79–102 (2006)
Kroetsch, M., Weikum, G.: Special issue on knowledge graphs. J. Web Semant. 37(38), 53–54 (2016)
Miller, G.A.: The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol. Rev. 63(2), 81 (1956)
Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors In Computing Systems, pp. 249–256 (1990)
Norman, D. Some observations on mental models. Mental Models (1983)
Oelen, A., Jaradeh, M.Y., Stocker, M., Auer, S.: Generate FAIR literature surveys with scholarly knowledge graphs. In: JCDL 2020: Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020. pp. 97–106 (2020)
Risko, E.F., Gilbert, S.J.: Cognitive offloading. Trends Cogn. Sci. 20(9), 676–688 (2016)
Rizzo, A., Marchigiani, E., Andreadis, A.: The avanti project: prototyping and evaluation with a cognitive walkthrough based on the norman’s model of action. In: Proceedings of the 2nd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, pp. 305–309 (1997)
Sousa, D.A.: How the brain learns. Corwin Press (2016)
Vrandečić, D., Krötzsch, M.: Wikidata: a free collaborative knowledgebase. Commun. ACM 57(10), 78–85 (2014)
Wade, A.D.: The semantic scholar academic graph (s2ag). In: Companion Proceedings of the Web Conference 2022, pp. 739–739 (2022)
Wharton, C., Rieman, J., Lewis, C., Polson, P.: A practitioner’s guide. In: Usability Inspection Methods, The cognitive walkthrough method, pp. 105–140 (1994)
Acknowledgements
This work was co-funded by the European Research Council for the project ScienceGRAPH (Grant agreement ID: 819536) and the TIB Leibniz Information Centre for Science and Technology.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Obrezkov, D., Oelen, A., Auer, S. (2023). An Approach to Evaluate User Interfaces in a Scholarly Knowledge Communication Domain. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14145. Springer, Cham. https://doi.org/10.1007/978-3-031-42293-5_44
Download citation
DOI: https://doi.org/10.1007/978-3-031-42293-5_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42292-8
Online ISBN: 978-3-031-42293-5
eBook Packages: Computer ScienceComputer Science (R0)
