Đã hoàn thành

Web scraping of printer toner/ink website with import of data to Magento

We intend to scrape product data from a printer toner/ink website. For every product on the website we will create one SKU in our Magento Ecommerce store and import the associated data that has been scraped. The scraped data needs to be cleaned and modified to ensure it meets our Magento Ecommerce store data standards. We will use four CSV files to import the data.

This tasks require that you scrape the data, clean and modify the data to meet our data standards, create four CSV files for import and import the data to our non-production Magento store.

Navigation Structure:

The website we want scrape is organised into this navigation structure:

Brand > Category > Models > Products

Brand Page:

There are 16 brand categories currently for the following brands:






Konica Minolta











Within each brand are one or more of the following categories:

Ink Cartridges

Toner Cartridges

Thermal Rolls

Category Page:

Within each category page is a list of printer models.

Models Page:

Within each model page is a list of products that are for use with that printer model broken into product segments such as below:

Compatible Brand Toner Value Pack

Genuine Brand Toner Value Pack

Compatible Brand Toner

Genuine Brand Toner

Compatible Brand Image Drums

Genuine Brand Image Drums

Product Page:

The final product page has the data that we intend to scrape. Each product page has a unique URL. The same product page will be linked from multiple printer model pages as one product is normally compatible with multiple printers.

We need four CSV files created with the data that is scraped. The four CSV files we need created are:

1) [login to view URL]

2) [login to view URL]

3) [login to view URL]

4) [login to view URL]

For each unique product URL we will create one product SKU in our Magento Ecommerce store. This is [login to view URL] and product_type.csv.

For each printer part/model we will cross reference the product SKU(s) that are compatible. For example, these parts/models:

SKU1: PartY, ModelZ

SKU2: PartY

SKU3: ModelZ

… we will cross reference in our database like:

PartY: SKU1, SKU2

ModelZ: SKU1, SKU3

This is [login to view URL] and [login to view URL]

*** Images need to be downloaded and will be referenced in the [login to view URL] import file for import to our Magento Ecommerce store ***

The scraped data needs to be cleaned and modified to ensure it meets our Magento Ecommerce store data standards.

Once complete each CSV file is to be imported to our non-production Magento Ecommerce store.

Existing Products

Our Magento Ecommerce store currently has products from the website we intend to scrape. We will provide a list of product URLs (The unique product URLs from the website that is being scraped) that you do not need to import. After scraping the data from the website you can remove the product URLs that we provide so the same data is not imported twice.

Data Cleaning and Modification

An example of data cleaning and modification is:

“HP LaserJet 1000” would be imported to our Magento Ecommerce store as “HP”,”LaserJet”,”1000”:

The brand and series are both placed into their own separate column. Again, by looking at our existing store data you can clearly see that Laserjet is a series of HP and should be placed into a separate column.

The product attribute “3,500 pages at 5% coverage” would be imported to our Magento Ecommerce store as “Approx. 3,500 pages at 5% coverage”:

By looking at our existing attributes you can see that we use “Approx.” in our data.


It is your responsibility to test each file using our non-production Magento Ecommerce store to ensure all data is able to import successfully.

Kĩ năng: Nhập liệu, Excel, Web Scraping, Tìm kiếm web

Xem nhiều hơn: web navigation 2014, use of data structure, scraping the web, scraping data from web database, scraping data from the web, samsung website, samsung web, need of data structure, model your brand, list of data structure, list in data structure, list data structure, linked list in data structure, linked list data structure, ecommerce website for 500, data structure list, data structure linked list, data structure example, data entry standards, data entry responsibility

Về Bên Thuê:
( 8 nhận xét ) FLEMINGTON, Australia

ID dự án: #5806088

Được trao cho:


Please send me the login credentials to the non-production shop so that I can take a look and make sure I understand all the requirements.

$684 AUD trong 10 ngày
(40 Đánh Giá)

31 freelancer đang chào giá trung bình $397 cho công việc này


Hi i will do it manually team base. "Dear employer, I am a highly trained Data Entry,Research, Web search, Web scrape, Product Add Any Type Of Card, Expert with great knowledge of Excel and all Social Networks. Pleas Thêm

$526 AUD trong 10 ngày
(1234 Nhận xét)

Hi, thank you for the invitation....your 5-star data extracting & database building expert is ready to help your project. pls check my profile and feedbacks first to have some idea about the quality of my work... I had Thêm

$315 AUD trong 5 ngày
(338 Nhận xét)

Hi, We are the most trusted freelancer in freelancer.com, we have wide range of experience in scraping products from website (latest scrape [login to view URL]) and import them into magento store.I kindly request you to see Thêm

$1052 AUD trong 10 ngày
(312 Nhận xét)

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$250 AUD trong 5 ngày
(267 Nhận xét)

Hello sir! I'm expert on web scraping and have more experience in Magento. I have done a lot projects for the importing products on Magento and very familiar with the template of csv files. Please take a look at my pro Thêm

$250 AUD trong 5 ngày
(411 Nhận xét)

Hello, Sir I am from vSol CORP. We are 19 people team, worked on more than 500 completed projects. We provide round the clock service. I have checked your project requirement. And we are professional and dedicated Thêm

$257 AUD trong 5 ngày
(286 Nhận xét)

Dear caphiticken,Greetings! Highly experienced team of Magento Experts here. Should we get a small chance to scrape few products from the site and import in your website . For your reference I have attached a copy Thêm

$250 AUD trong 4 ngày
(376 Nhận xét)

hi, i am expert in web scraping and interested in this project, let me do this work with perfection, accuracy and according to your requirements, plz contact with me so we can discuss further about the project thanks

$315 AUD trong 10 ngày
(243 Nhận xét)

Hello, I can very well understand that I am very new here and my profile shows that also. But I have vast experience in working on another site. You will have the details about my ability in doing this type of work. Pl Thêm

$250 AUD trong 10 ngày
(158 Nhận xét)

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. Thêm

$526 AUD trong 10 ngày
(180 Nhận xét)

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: [login to view URL] Thêm

$526 AUD trong 10 ngày
(67 Nhận xét)

Hi We have done similar project, We have expert team. WE provide you quality work as per your requirement. Ready to start Now. Thanks

$333 AUD trong 10 ngày
(256 Nhận xét)

Hello, Read and understood project details. We have a lot of experience of data scarping and data entry. We can do this job very well also we are ready to do sample entries. Hope to getting consider for this. Regards

$250 AUD trong 10 ngày
(108 Nhận xét)

Hey, I have done many template files and scraping work for amazon seller and can do your work as [login to view URL] i see your CSV with an populated entry to more concentrate on.I'm much interested in your project and assur Thêm

$555 AUD trong 10 ngày
(42 Nhận xét)

Respected Sir, I have done a lot of similar project done successfully in freelancer.com. This is my only income to live with my small family. I take the project seriously and finished it sincerely and provided 100% sat Thêm

$250 AUD trong 10 ngày
(80 Nhận xét)

Hello Still now doing the project for adding projects to magento store manually. I am able to import your products. Pls look at my profile picture. Kind Regards Kamal

$333 AUD trong 7 ngày
(94 Nhận xét)

Hi, I've read the entire description. I have sound knowledge of data entry, Google search and Internet Research jobs. I am a professional user of Office (Word, Excel, Power Point) and other programs. I have 6 years of Thêm

$280 AUD trong 10 ngày
(72 Nhận xét)

Hello, First of all let me introduce myself. I am a [login to view URL] Electrical and Electronic Engineer & [login to view URL] is going on and besides this, freelancing is my hobby as well as my main source of income and I am a hardcore freelance Thêm

$250 AUD trong 10 ngày
(35 Nhận xét)

Hi sir, Please let me know if you are interested in data from the following websites. 1. [login to view URL] 2. [login to view URL] I can provide data from both websites in csv format and I can provide scr Thêm

$277 AUD trong 10 ngày
(17 Nhận xét)

If you choose my bid, you won't only get that data but also the program that I used to generate it and its source code, so you'll be able to get their latest data again in the future. 1. What website do you want to Thêm

$650 AUD trong 7 ngày
(11 Nhận xét)