I need a spider that can crawl the entire site [url removed, login to view] and extract data from every product and list them onto a CSV file.
Please do look at example of CSV file attached "[url removed, login to view]" + “Page [url removed, login to view]”
It has to extract data from Music, DVD's and Games categories.
The information that it needs to extract is:
All the above information is found within each product.
Once completed we should be able to run the crawl as often as we need to, to get new products listed and updates on prices.
Our server is Linux MYSQL.
I do not mind what software our script will be as long as It is quick and simple for me to use.
Depending on outcome of this project there will be larger projects and regular sites to crawl.
You need to tell me how I will use the tool every week to extract data from that site, and how the process will work.
PLEASE NOTE THAT THIS IS A SCRIPT THAT IS REQUIRED ASAP SO PLEASE NO TIME WASTERS. PLEASE DO BID IF YOU ARE 100% CERATAIN THAT YOU CAN DO THE JOB, SO PLEASE DO TEST THE EXTRACT AND SEE IF YOU CAN DO THIS.