Date of Publication :8th March 2018

Abstract: Due to heavy usage of internet large amount of diverse data is spread over it which provides access to particular data or to search most relevant data. It is very challenging for search engine to retrieve required data as per user’s need and which takes more time. So, to reduce large amount of time spend on searching most relevant data we proposed the “Smartcrawler”. In this proposed approach, results taken from different web search engines to achieve relevant pages. Take online link from web and performing two stages crawling on that data or URL’s. In which sight locating and in-site exploring is carried out or obtaining most relevant site with the help of page ranking and reverse searching techniques. This system can works online and offline manner. This survey presents the fundamental challenges and studies existing models and solutions. It also highlights direction or way for future work.

Reference :