Skip to main content
Springer Nature Link
Log in

Research and Realization of News Gathering and Editing System Based on Distributed Search Engine

  • Conference paper
  • First Online:
Advances in Intelligent Networking and Collaborative Systems (INCoS 2017)

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 8))

  • 1365 Accesses

Abstract

According to the investigation and survey on the demands of e23.cn, the depth analysis was performed to explore the new changes in the news material gathering and material search methods in the system in the context of big data. Meanwhile, the related technologies of web crawler, replicated documents elimination and distributed search engine are integrated in the news gathering and editing system. The experimental results showed that the system had the functions of efficiently gathering Web materials, eliminating the replicated documents and fast retrieving information, which can meet the actual needs required by the industry of news.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Jiangwen, S., Kong, X., Song, L.: Non structured data unified storage platform. Comput. Modernization 11, 69–73 (2016)

    Google Scholar 

  2. Shi, R.: A new approach to content extraction from web page. Telecom World 19, 210–211 (2015)

    Google Scholar 

  3. Narawade, S.M., Prabhakar, N.M., Maruti, N.S.: A web based data extraction using hierarchical (DOM) tree approach. Int. J. Innovative Res. Sci. Technol. 2(11), 255–257 (2016)

    Google Scholar 

  4. Xiong, Z., Ya, M., Zhang, Y.: Detection and elimination of similar web pages based on text structure and string of feature code. J. Comput. Appl. 33(2), 554–557 (2013)

    Google Scholar 

  5. Gormley, C., Tong, Z.: Elasticsearch: The Definitive Guide. O’Reilly Media, Sebastopol (2015)

    Google Scholar 

  6. Meng, B., Wang, Z.: Two chinese word segmentation algorithms in the realization of the cloud computing platform. Netw. Secur. Technol. Appl. 12, 67–71 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Shandong Provincial Key Laboratory of Network Based Intelligent Computing, University of Jinan, Jinan, Shandong, China

    Yamin Han, Kun Liu & Kun Ma

  2. School of Information Science and Engineering, University of Jinan, Jinan, People’s Republic of China

    Yamin Han, Kun Liu & Kun Ma

Authors
  1. Yamin Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kun Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kun Liu .

Editor information

Editors and Affiliations

  1. Faculty of Information Engineering, Fukuoka Institute of Technology, Fukuoka, Japan

    Leonard Barolli

  2. Department of Computer Science, Ryerson University, Toronto, Ontario, Canada

    Isaac Woungang

  3. School of Business, UNSW Australia, Canberra, Aust Capital Terr, Australia

    Omar Khadeer Hussain

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Han, Y., Liu, K., Ma, K. (2018). Research and Realization of News Gathering and Editing System Based on Distributed Search Engine. In: Barolli, L., Woungang, I., Hussain, O. (eds) Advances in Intelligent Networking and Collaborative Systems. INCoS 2017. Lecture Notes on Data Engineering and Communications Technologies, vol 8. Springer, Cham. https://doi.org/10.1007/978-3-319-65636-6_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65636-6_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65635-9

  • Online ISBN: 978-3-319-65636-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics