PHP Classes

MegaSpider: Crawl a Web site and retrieve all links addresses

Recommend this page to a friend!
  Info   Screenshots Screenshots   View files View files (16)   DownloadInstall with Composer Download .zip   Reputation   Support forum (1)   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStar 47%Total: 3,006 All time: 1,225 This week: 560Up
Version License Categories
megaspider 1.0GNU Lesser Genera...Searching


This class can crawl the pages of Web site recursively to retrieve the URLs of links and e-mail addresses that are found in the pages.

It uses regular expressions to retrieve the links found in each page and follows the links URLs and until all linked pages are visited.

Picture of Marcin Sznyra
Name: Marcin Sznyra <contact>
Classes: 2 packages by
Country: Poland Poland
Age: 43
All time rank: 69218 in Poland Poland
Week rank: 286 Up8 in Poland Poland Up

  • screen
  Files folder image Files  
File Role Description
Files folder imagedocs (6 files, 3 directories)
Plain text file example.php Example Example of usage
Plain text file spider.class.php Class MegaSpider Class

  Files folder image Files  /  docs  
File Role Description
Files folder imagemedia (3 files)
Files folder imageMegaSpider (3 files)
Files folder image__filesource (2 files)
  HTML file classtrees_MegaSpider.html Doc. documentation
  HTML file elementindex.html Doc. documentation
  HTML file elementindex_MegaSpider.html Doc. documentation
  HTML file index.html Doc. documentation
  HTML file li_MegaSpider.html Doc. documentation
  HTML file todolist.html Doc. documentation

  Files folder image Files  /  docs  /  media  
File Role Description
  Image file background.png Data documentation
  Image file empty.png Data documentation
  Plain text file style.css Data documentation

  Files folder image Files  /  docs  /  MegaSpider  
File Role Description
  HTML file MegaSpider.html Doc. documentation
  HTML file _spider_example_php.html Doc. documentation
  HTML file _spider_spider_class_php.html Doc. documentation

  Files folder image Files  /  docs  /  __filesource  
File Role Description
  HTML file fsource_MegaSpider__example.php.html Doc. Documentation
  HTML file fsource_MegaSpider...ider.class.php.html Doc. documentation

 Version Control Unique User Downloads Download Rankings  
This week:0
All time:1,225
This week:560Up
 User Ratings  
 All time