Đã Đóng

Data scrapping for public ecommerce site (2 sites)

I need a customized program to scrap data (and calculation) from an online ecommerce platform.

I want to scrap data from these ecommerce sites , esp. inventory and sales quantity. The program shall read user input excel file every day to check what categories are required for scrapping data. I need at least 30 categories within 20 hours, first 2 pages of products (SKU) for each category, i.e. 100 SKU for each category, total 3,000 SKU for 1 site. The same for the other sites. 2 programs shall run independently, 1 for each site, to scrap the data.

The program shall be able to run 7x24 in a VPS environment. Developer shall suggest a reliable and reasonable cost VPS provider. Output excel file for each scrapping data shall be uploaded to Google Drive and sent by auto-mail. Only the latest file shall be stored in Google Drive - that is old file shall be cleared from Google Drive.

There is NO API available from ecommerce site. The sites are blocking IP address, proxy etc. Developer shall be able to handle platform robot detection, captcha, proxy blocking, rate limitation etc. If proxy service is required, developer shall advise such service provider and monthly cost, in addition to handle the work. Good database design and management are necessary.

Developer shall provide 3 months warranty to ensure the program can run 7x24 in VPS server.

Developer shall also quote monthly maintenance cost.

Document and all necessary information shall be provided to ensure buyer can have 3rd party to do maintenance work (both the script and VPS set up details) in another VPS server if required.

Buyer will pay for VPS and proxy service every month after deploy. Developer shall include the cost for 1 month proxy service required (in addition to free proxy service) during development and testing.

1st milestone payment 5% - is to cover 1 month proxy service if free proxy service is not working.

2nd milestone payment 75% - when the project testing is completed (7x24). If problems occurs, it shall be counted from beginning. Full documentation and code provided.

3rd milestone payment 20% - after 3 months warranty

Applicant shall submit a sample of data fetching result (5 SKU) in order to understand data requirement and corresponding ecommerce site.

Applicant shall also recommend the selected VPS and Proxy service. Base on recommendation, applicant shall inform buyer the monthly charge of such service after deployment. Buyer confirmation of such charge is a pre-requisite to start any work.

Only serious and professional shall contact me for detail and project requirement documentation.

Please include 7 days verification in VPS environment in project time.

Seller shall adhere to committed project completion date.

Only serious seller shall apply. DO NOT auto bid the project. DO NOT send low price bid and then increase bidding price significantly.

Kĩ năng: PHP, Web Scraping, Kiến trúc phần mềm, Selenium, Lập trình cơ sở dữ liệu

Xem nhiều hơn: online ecommerce site, social ecommerce site, drupal photography ecommerce site, wordpress ecommerce site retail cost, gay adult site key sites, free data entry work providers site, small ecommerce site, parse product data ecommerce site, data ecommerce site, ecommerce site salary data entry, excel data upload ecommerce site, data entry ecommerce site, uk profile getafreelancer data entry wordpress ecommerce sites, data mining ecommerce site, product data entry ecommerce site, web scraping product data from a ecommerce site using python

Về Bên Thuê:
( 6 nhận xét ) Kowloon, Hong Kong

ID dự án: #30199472

21 freelancer chào giá trung bình$607 cho công việc này

(467 Nhận xét)
8.6
phpXpertbd

Dear Employer, Upon checking your project, I am pretty sure I can produce high-quality and perfect results for your project. I have checked the project details. I'm expert in web scraping, web automation and data minin Thêm

$555 USD trong 7 ngày
(98 Nhận xét)
7.5
ArkssTech

Hi Manager!! We checked for your project and interested in your project. Project: Data scrapping for public ecommerce site (2 sites) I am an expert full stack software engineer with skills including Selenium, Software Thêm

$610 USD trong 12 ngày
(43 Nhận xét)
6.7
raminde

Have over 12 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered resul Thêm

$667 USD trong 2 ngày
(14 Nhận xét)
6.3
aleksandrskvor

Dear employeer. How are you? I have checked your project (Data scrapping for public ecommerce site (2 sites)) carefully and understood your need. Until now I have made various types of website and have done similar thi Thêm

$550 USD trong 5 ngày
(20 Nhận xét)
6.0
saubhagyamweb

----- Data scrapping for public ecommerce site (2 sites) ----- Hello, I read the post and I think my skills and experience are a good fit for this project. I can effectively complete your task to your specifications. Thêm

$500 USD trong 7 ngày
(20 Nhận xét)
6.0
makeyourtomorrow

Hi! Thanks for posting. I am happy to send proposal on this project. I am interested in your project with the title of Data scrapping for public ecommerce site (2 sites). I am a professional programmer with 8+ years Thêm

$555 USD trong 7 ngày
(21 Nhận xét)
5.6
(12 Nhận xét)
5.8
viktorbelman01

Dear Sir. As an experienced web scrapper, it is interesting to me. I have been working on various data scrapping projects from static/dynamic sites for over 7+ yeras. I have full experience in requesting, analyzing, da Thêm

$1000 USD trong 30 ngày
(18 Nhận xét)
4.9
fadeevdoma

✔️ https://www.freelancer.com/u/fadeevdoma Hello. As you can see in my profile, I have finished many scraping works using Python and C#. I have worked in scraping over 3 years, experience solving captcha and Ip rotatio Thêm

$600 USD trong 7 ngày
(7 Nhận xét)
4.8
denTEAM

Hi, I have read your request. I can do anything you want. I've been working in various fields of programming and web scraping with python and using the beautifulSoup, scrapy (spiders), requests and Selenium libraries I Thêm

$500 USD trong 7 ngày
(7 Nhận xét)
4.2
anouphimmasy

Hi how are you doing I have checked your project's description in detail I think I can complete your Ecommerce site's scrapping task perfectly because I have rich experience in this kinda scrapping project development Thêm

$500 USD trong 7 ngày
(4 Nhận xét)
4.1
markprosorokin

Hi, I can start right now. I can finish it with in short time. With 6+ years rich experience for WebScraping using python and C#. I have ever scrap the ecommerce site that has got Robot, proxy detection. I read your j Thêm

$750 USD trong 10 ngày
(2 Nhận xét)
3.2
alexandersharov1

I have read your job description carefully and took a deep interest in your job. As a web expert, I have been working for over 10 years and have ripe experience in web scraping. So I am sure that I am the best fit for Thêm

$500 USD trong 7 ngày
(5 Nhận xét)
3.6
(4 Nhận xét)
2.9
maksimihnatiuk14

Dear Client! As a full stack developer I have extensive knowledge of webscrapping. My extensive experience with web scraping using IP proxy rotation, Selenium, tor Browser, multi thread and Bypassing captcha well wit Thêm

$500 USD trong 7 ngày
(1 Nhận xét)
2.3
rd1439

am Full stack developer having experience more than 8+ years and have good knowledge in MONGO DB, JAVASCRIPT, ANGULAR JS, NODE JS, REACT JS, RADIS, REDUX & FLUX. Few recently developed samples in Angular.Js, Node.Js. 1 Thêm

$500 USD trong 7 ngày
(1 Nhận xét)
1.4
Rukki123

Hi, I have scrapped so many website in past Amazon (400 Pages) Google Images using Keywords (5000 images) US yellow pages (100 pages) Saudi Arabia ecommerce website etc (More than 20000 products)Centerpoint (Extract  Thêm

$500 USD trong 7 ngày
(2 Nhận xét)
1.6
ahmedasal14

Hi There, I've read your project specifications and i can start from now I am a php developer and have good experience in bots and scripts like that. I have built similar things before (account creator bot, booking b Thêm

$750 USD trong 5 ngày
(0 Nhận xét)
0.0
vladislavcukanov

"Your project is my dream" Hello, Thank you for your project. I've just checked your job description carefully. I'm senior developer with 9+ years of Python. By using Python, I developed AI engine, BOT, Web Scraping To Thêm

$350 USD trong 3 ngày
(0 Nhận xét)
0.0