PHP Classes / Web Crawler using MySQL DB

Retrieve Web pages and store links in a database

Web Crawler using MySQL DB PHP Class

This class can be used to retrieve Web pages and store the URLs links in a MySQL database. It retrieves a given Web page and parses its HTML content to extract the URLs of links and frames. The URLs that are crawled are stored in a MySQL database table if the URL was not yet stored previously. The class can also display in a Web page the list of URLs already stored from a given domain.

Search in PHP Classes

Filter by tags