We are in need of a data mining script which runs on a monthy base.
The date come form a suppliers website where all products can be called trought a simple procedure.
We want the script to collect all the products for us and insert them into oscommerce web shop.
First will be in development server to test, when approved will be on live site.
script has to login and collect:
EAN code
Title
Description
price
EGS Code (category code for which a list is provided)
The images are already available on our server, all images are linked to product-id, so product-id 123 has [login to view URL] as image
EGS code is for the category structure.
We need a way to process the id's into normal category structure.
now is like 23-45-67 means maincategory-sub-sub. The script must replace the numbers with the text given. This conversion list will be emailed.
The products to be scaped is 1,3 million in total, so we need a way to do it in parts and also rerun the script every month to check for updates.
We cannot show the suppliers website here as you can understand so please give pm and i will show you what it is and what we need.