The Implementation of Hadoop-based Crawler System and Graphlite-based PageRank-Calculation In Search Engine

Qingpei Guo, Chao Xu, Yang Song

Nowadays, the size of the Internet is experiencing rapid growth. As of December 2014, the number of global Internet websites has more than 1 billion and all kinds of information re…