Crawler

1. Crawler has to be extremally high performance, it has to run 24/7. 2. It has to run manually and automatically (I can be able to define the schedule hour/date from the admin section) 3. Retrieve the item information from the different site (title, description, place, meta name description page, meta name title, meta name keywords) 4. I have to be able to configurate the crawler for different sites, simply to use from an user interface 5. The crawler should be very fast, not slow due to bad programming. Note: We will provide the server for testing and developing Bid above the budget will not be considerated the program must work with 5 sites that I can tell you in private. in the coming weeks, the crawler must run on another 100 sites