1 paper · 1 filter
Yuichi Sasazawa, Yasuhiro Sogawa
A web crawler is a system designed to collect web pages, and efficient crawling of new pages requires appropriate algorithms. While website features such as XML sitemaps and the fr…