Web Crawler / Spider Software

Hello Coders,

We are doing research on community driven websites, such as [url removed, login to view], [url removed, login to view], [[url removed, login to view]][1] and others.

We would like to have a system / software built whereby to find out the information regarding the url when entered in the system. Following are the reports which are desired:

Here’s what we need:

1) Spider the sites when the url is entered in the system.

2) Determined the number of video files available.

3) Determine if those files are being linked back to other sites who do the streaming, or streaming directly from those sites.

4) The source of the streaming media links through which they are linked to.

5) The types of content video (music, sports..whatever)

6) The bit rate of the streams (average)

7) Is all the content resident on the particular site’s servers.

8) The complete site map of the website.

9) The keywords used by the website.

10) The metatags used by the website.

11) How many registered members are there with the website.

12) Any other related information which is connected with the website.

The system should be easy to use with multiple choices to find out about the website like how many files are associated with the website (e.g. jpg's, swf's, video, mpeg, mp3, and other formats etc).

We need this done in the month of May itself.

Please let me have a sample and similar kind of work to have a look at it.

Please do not bid if you do not have the expertise and experience for developing such projects.

## Deliverables

1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done.

2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables):

a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment.

b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request.

3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement).

## Platform

All major platforms Windows, Linux, Mac OS, etc.

All Browser compatible.

PHP

ID dự án: #3485550

Về dự án