A proposal of deep web crawling system by using breath-first approach

Abstract EN

-A lot of data on the WWW stay unavailable to crawlers of web search engines, so it must uncovered data when the users submits form with valid inputs.

The obscure of some portion of web which is hidden behind the interfaces is define as a Deep web, It is also called invisible web.

Around 96% of data are hidden behind the Deep web interfaces.

This paper aims to build a Deep web Crawling system that extract the hidden data and all hyperlinks that are pointing to other web pages by using Breathfirst search.

The concluded issues in this research are: downloading the deep web content by using the surfacing approach with un-structural DB, the yielded results prove that a higher quality pages which relevant to user query is displayed to the user at the top of the results list.