Abstract
Effective support for multimedia analytics applications requires exploration and search to be integrated seamlessly into a single interaction model. Media metadata can be seen as defining a multidimensional media space, casting multimedia analytics tasks as exploration, manipulation and augmentation of that space. We present an initial case study of integrating exploration and search within this multidimensional media space. We extend the M\(^3\) model, initially proposed as a pure exploration tool, and show that it can be elegantly extended to allow searching within an exploration context and exploring within a search context. We then evaluate the suitability of relational database management systems, as representatives of today’s data management technologies, for implementing the extended M\(^3\) model. Based on our results, we finally propose some research directions for scalability of multimedia analytics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Available at https://www.kaggle.com/bittlingmayer/amazonreviews.
References
Arigon, A.M., Miquel, M., Tchounikine, A.: Multimedia data warehouses: a multiversion model and a medical application. Multi. Tools Apps. 35(1), 91–108 (2007)
Babenko, A., Lempitsky, V.S.: The inverted multi-index. IEEE Trans. Pattern Anal. Mach. Intell. 37(6), 1247–1260 (2015)
Bartolini, I., Ciaccia, P.: Integrating semantic and visual facets for browsing digital photo collections. In: Proceedings of SEBD (2009)
Diao, M., Mukherjea, S., Rajput, N., Srivastava, K.: Faceted search and browsing of audio content on spoken web. In: Proceedings of CIKM (2010)
Guðmundsson, G.Þ., Amsaleg, L., Jónsson, B.Þ., Franklin, M.J.: Towards engineering a web-scale multimedia service: a case study using Spark. In: Proceedings of MMSys, Taipei, Taiwan (2017)
Jégou, H., Tavenard, R., Douze, M., Amsaleg, L.: Searching in one billion vectors: re-rank with source coding. In: Proceedings of ICASSP, Prague, Czech Republic (2011)
Jin, X., Han, J., Cao, L., Luo, J., Ding, B., Lin, C.X.: Visual cube and on-line analytical processing of images. In: Proceedings of CIKM (2010)
Amsaleg, L., Jónsson, B.Þ., Lejsek, H.: Scalability of the NV-tree: three experiments. In: Marchand-Maillet, S., Silva, Y.N., Chávez, E. (eds.) SISAP 2018. LNCS, vol. 11223, pp. 59–72. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-02224-2_5
Jónsson, B.Þ., Tómasson, G., Sigurþórsson, H., Eiríksdóttir, Á., Amsaleg, L., Lárusdóttir, M.K.: A multi-dimensional data model for personal photo browsing. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015. LNCS, vol. 8936, pp. 345–356. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-14442-9_41
Shneiderman, B., Bederson, B.B., Drucker, S.M.: Find that photo! interface strategies to annotate, browse, and share. Commun. ACM 49(4), 69–71 (2006)
Worring, M., Koelma, D.C.: Insight in image collections by multimedia pivot tables. In: Proceedings of ACM ICMR, Shanghai, China (2015)
Yee, K.P., Swearingen, K., Li, K., Hearst, M.: Faceted metadata for image search and browsing. In: Proceedings of CHI (2003)
Zahálka, J., Rudinac, S., Jónsson, B.Þ., Koelma, D.C., Worring, M., : Blackthorn: large-scale interactive multimodal learning. IEEE Trans. Multi. 20(3), 687–698 (2018)
Zahálka, J., Worring, M.: Towards interactive, intelligent, and integrated multimedia analytics. In: Proceedings of IEEE VAST, Paris, France (2014)
Zaïane, O.R., Han, J., Li, Z.N., Hou, J.: Mining multimedia data. In: Proceedings of CASCON (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Gíslason, S., Jónsson, B.Þ., Amsaleg, L. (2019). Integration of Exploration and Search: A Case Study of the M\(^3\) Model. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, WH., Vrochidis, S. (eds) MultiMedia Modeling. MMM 2019. Lecture Notes in Computer Science(), vol 11295. Springer, Cham. https://doi.org/10.1007/978-3-030-05710-7_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-05710-7_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05709-1
Online ISBN: 978-3-030-05710-7
eBook Packages: Computer ScienceComputer Science (R0)