Đã Đóng

mySQL database to be filled with Icecat product data XML

Icecat ([url removed, login to view]) provides online shops and price comparison sites with structured product data for computers, electronic consumer goods, cameras, mobile phones and other gadgets. I need somebody who uses Icecats XML interface to store product data from selected product categories in a mySQL database (that has to be build up) and makes this data accessible for further processes. A presentation of Icecat and its XML interface can be found here: [url removed, login to view]

This is the job:

Download/transfer data from all products of these product categories:

- Notebooks (Category ID 151)

- Netbooks (Category ID 1561)

- Mobile & Smartphones (Category ID 119)

- Digital Cameras (Category ID 575)

- LCD TV (Category ID 1078)

- Plasma TV (Category ID 903)

- GPS navigation systems (Category ID 910)

Please notice that:

- I only need the product categories in the German language version (LanguageID= „4“)

- Only structured product data are needed (Product Quality = „ICECAT“)

- Product data of related products („ProductRelated“) are not needed neither

- To start with, the database will have to be build and tested with the free available brands („Open Icecat“). At the final project stage we would switch to the entire Icecat data base that includes all brands („Full Icecat“). The data structure is identical, only the XML addresses have to be changed.

Automatic update of the mySQL database

Icecat provides an update XML on a daily basis (*[url removed, login to view]) that contains new and obsolete products.

With respect to daily updates you will have to write a routine that

- updates the mySQL database on a daily basis for the seven product categories mentioned above (add new, remove old products),

- updates are only needed for the German market (<Country Market value = "DE">)

- sends a notification mail after each daily update with a .csv file attached stating which products have been added and which products have been removed (short information for each product such as date, category, added/removed, brand, product name, EAN, Icecat product ID)

Browser based Admin view to enable non IT experts to handle the mySQL database

This admin view should enable the following actions:

- export of product data sets in a .csv data file with filters to select

o which product data sets to export (e.g. category, date)

o which product features to include in the export (all, brand, specific product features etc.). For each product category this selection can be stored as a default for future exports.

- Direct search for specific products (e.g. brand, product name, EAN, Icecat product ID)

- Manual upload of additional products (within the given categories) with .csv data files structured according to the product information in the category

- Note: given a solid functionality of this admin view and possibilities to select and export data sets filtering for date ranges, the “mail notification functionality after uploads” mentioned above could be omitted.

Support with hosting and configuration

You should help me to choose the right selection and evaluation criteria for hosting providers and their services. Furthermore, I will need support to install and configure the database with a German provider.


You will have to transfer all rights for the developed services to me.

In case of a successful cooperation there will be more programming to be done for me (integration of Amazon API and price comparison services, other language versions, personal account services and many more).

You should state a fix price and a termination date for this project in your bid. Please mention references to past projects related to this one.

A sound knowledge of Perl is preferred but not mandatory as my services will use Perl to work with the Icecat product data.

Please take notice of the following additional remarks and confirm your bid, if you wish to go ahead:

- According to some feedback I got, you have to handle very high data volumes when extracting data from Icecat. Please make sure you have the appropriate infrastructure to do this. Make sure you have fully understood the way data can be extracted from Icecat. In case of doubt, please check the attached manual for this.
- The MySQL database to be build by you will serve as the data basis of a web based product recommendation service and has to be able to handle a large number of requests and thus has to perform very well. Each user will cause calculation of (max # of products, e.g. 2,000 - 10,000) x (15 most important datafields) to arrive to his results.
- You will have to provide proper documentation of the MySQL database, its admin view and the code used for extracting and updating data from Icecat so that other web designers will be able to build on your work.
Specification on the browser based admin view of the MySQL database:
- To select data files, up to five data fields to be determined by the user can be selected and combined with “and” statements. Each of this five selection fields will enable search functions with “=”, “<”, “>” with respect to the given search value.
- Search results can either be listed on screen or exported as .csv file

Terms of payment:
The project consists of three stages so payment is made in three installments:
1) 30%: After MySQL database and its admin view are completed and fully functional. Proof of work completed: Database is setup and contains and least 5 products in each of the mentioned product categories, browser based admin view is working. At this project stage the database can be hosted at any location of the bidder’s choice.
2) Next 40%: After integration of all Free Icecat data, database is transferred to a public hosting service in Germany. Proof of work completed: All data from Free Icecat are in the database and can be accessed through the admin view; daily updates are running smoothly, operations will run without error for seven consecutive days.
3) Last 30%: After integration of all Full Icecat data and project documentation. Proof of work completed: All data from Full Icecat are in the database and can be accessed through the admin view; daily updates are running smoothly, operations will run without error for seven consecutive days, documentation completed.

For each project stage there is a max number of 28 days allowed (I would appreciate faster completion). If the bidder fails to accomplish the tasks within this period (as stated in proof of work) the work will be considered as not completed and no payment will be made. If a project stage is not completed the bidder may not proceed to the next stage. Milestone payments are made according to the outstanding part of each project stage.

Please also provide me with short information on how and at what costs you can support me with ongoing maintenance work, for example when Icecat changes its data structure.

Kĩ năng: MySQL, Perl, PHP, XML

Xem nhiều hơn: icecat computers category, icecat mysql, icecat database, mysql categories icecat, open icecat includes related product information, full icecat database download, download icecat database, xml icecat product, icecat mysql database, data icecat database, icecat category xml, icecat amazon, icecat csv, ean icecat, icecat perl, xml use case, xml services, xml programming needed, xml programming language, who to use as references, who can help me with php online, view xml online, uses of data structure, use of data structure in programming, use of data structure

Về Bên Thuê:
( 14 nhận xét ) Weilheim, Germany

ID dự án: #1055511

22 freelancer đang chào giá trung bình €1006 cho công việc này


pls chk pmb

€1375 EUR trong 10 ngày
(797 Nhận xét)

Please check PMB for details.

€800 EUR trong 25 ngày
(90 Nhận xét)

Please check PMB. Thanks.

€750 EUR trong 15 ngày
(423 Nhận xét)

Kindly check pmb please.

€900 EUR trong 30 ngày
(60 Nhận xét)

Please check a PMB.

€1000 EUR trong 14 ngày
(113 Nhận xét)

--Hello Thomas, Please check your pm. Thanks.--

€800 EUR trong 5 ngày
(97 Nhận xét)

Please see pm. Thanks

€1000 EUR trong 30 ngày
(51 Nhận xét)

we are experienced in XML parsing, please check PM

€750 EUR trong 15 ngày
(65 Nhận xét)

Ready to start, please see PM for more details

€800 EUR trong 8 ngày
(86 Nhận xét)

Please check PM

€800 EUR trong 15 ngày
(71 Nhận xét)

Dear Sir, please read PM I sent you. I described all details about my bid there. Best regards, Jan

€1000 EUR trong 21 ngày
(47 Nhận xét)

6 years old in web development.

€750 EUR trong 20 ngày
(30 Nhận xét)

Please see PM

€1250 EUR trong 45 ngày
(3 Nhận xét)

Please see my PM

€750 EUR trong 25 ngày
(9 Nhận xét)

Hello, please see private message, thanks.

€1000 EUR trong 45 ngày
(4 Nhận xét)

Hi I have experience with price comparision and feed csv,xml import to mysql/oracle I worked for [login to view URL], [login to view URL] in developing APIs Please check my reviews. Thank you Vasundhar Boddapat Thêm

€1600 EUR trong 30 ngày
(1 Nhận xét)

I can do it.

€1200 EUR trong 30 ngày
(2 Nhận xét)

Hi, I do same work frequently, so I can help you.

€1000 EUR trong 10 ngày
(0 Nhận xét)

We are supporting [login to view URL] with import of their XMLs to different e-commerce. For more info and links to similar projects please contact us.

€1500 EUR trong 10 ngày
(0 Nhận xét)

we have experience of similar type of project

€1100 EUR trong 40 ngày
(0 Nhận xét)