PHP Classes

HTTP Spy: Crawl and retrieve remote site pages

Recommend this page to a friend!
  Info   View files View files (5)   DownloadInstall with Composer Download .zip   Reputation   Support forum   Blog    
Ratings Unique User Downloads Download Rankings
StarStarStarStar 65%Total: 1,898 All time: 2,074 This week: 673Up
Version License PHP version Categories
httpspy 1.0Artistic License4.3.0HTTP, Searching


This package can be used to crawl and retrieve remote Web site pages.

It retrieves pages of a given Web site and extract the URLs of links and images contained in each page to be able to find other resources in the same site.

Picture of huangjs
Name: huangjs <contact>
Classes: 1 package by
Country: China China
Age: ???
All time rank: 155818 in China China
Week rank: 286 Up3 in China China Up


/*---------------------------------------------------------*/ /* Package Name : Http Spy */ /* Author : James Huang (ShagoO) */ /* Email : */ /* Version : 1.0 */ /* Latest Release : 2006/12/09 */ /*---------------------------------------------------------*/ [Instruction] HttpSpy is Class written by James Huang (ShagoO) which extends the Class Http Clent. Use Can Use it spying infos from website. Main Function Description As Follow : //////////////////////////////////////////////////////////////////////// // Spy Main Process Methods. create() : Create a HttpClient Object. get() : Use "GET" method to get Content from website. post() : Use "POST" method to get Content from website. getContent() : Get Page Content after "get" or "post". useCurl() : Use Curl functions. setCookiePath() : Set Cookie storage path. curlLoaded() : Check if Curl is loaded. curlGetCookie() : Use curl function to get cookies. curlGetContent() : Use curl to get content. setConditions() : Set separators to parse page. getResult() : Get Result after execute(). execute() : Execute search process after getting links and setConditions(). //////////////////////////////////////////////////////////////////////// // Page Content Analyzing funcs. getHrefs() : get <a href= .. section of the page. getElements() : get .. src= .. section of the page. splitPage() : Use separators to split page. validUrlMaker() : Make all url valid. htmlTagsFilter() : Filter all html tags. [User Guild] 1. Decompress package to your DocumentRoot. 2. Use Class MySpy and spy data from Joyo. 3. Make your own Spy Classes :)

  Files folder image Files  
File Role Description
Files folder imageconfig (1 file)
Files folder imagecore (2 files)
Accessible without login Plain text file MySpy.php Example demo file
Accessible without login Plain text file readme.txt Doc. instruction

  Files folder image Files  /  config  
File Role Description
  Plain text file constant.php Class configure

  Files folder image Files  /  core  
File Role Description
  Plain text file HttpClient.php Class Base Http Functions
  Plain text file HttpSpy.php Class Main Class

 Version Control Unique User Downloads Download Rankings  
This week:0
All time:2,074
This week:673Up
 User Ratings  
 All time