Data scrapping for public ecommerce site (2 sites)

$250-750 USD

Đã đóng

Đã đăng vào

gần 3 năm trước

$250-750 USD

Thanh toán khi bàn giao

I need a customized program to scrap data (and calculation) from an online ecommerce platform. I want to scrap data from these ecommerce sites , esp. inventory and sales quantity. The program shall read user input excel file every day to check what categories are required for scrapping data. I need at least 30 categories within 20 hours, first 2 pages of products (SKU) for each category, i.e. 100 SKU for each category, total 3,000 SKU for 1 site. The same for the other sites. 2 programs shall run independently, 1 for each site, to scrap the data. The program shall be able to run 7x24 in a VPS environment. Developer shall suggest a reliable and reasonable cost VPS provider. Output excel file for each scrapping data shall be uploaded to Google Drive and sent by auto-mail. Only the latest file shall be stored in Google Drive - that is old file shall be cleared from Google Drive. There is NO API available from ecommerce site. The sites are blocking IP address, proxy etc. Developer shall be able to handle platform robot detection, captcha, proxy blocking, rate limitation etc. If proxy service is required, developer shall advise such service provider and monthly cost, in addition to handle the work. Good database design and management are necessary. Developer shall provide 3 months warranty to ensure the program can run 7x24 in VPS server. Developer shall also quote monthly maintenance cost. Document and all necessary information shall be provided to ensure buyer can have 3rd party to do maintenance work (both the script and VPS set up details) in another VPS server if required. Buyer will pay for VPS and proxy service every month after deploy. Developer shall include the cost for 1 month proxy service required (in addition to free proxy service) during development and testing. 1st milestone payment 5% - is to cover 1 month proxy service if free proxy service is not working. 2nd milestone payment 75% - when the project testing is completed (7x24). If problems occurs, it shall be counted from beginning. Full documentation and code provided. 3rd milestone payment 20% - after 3 months warranty Applicant shall submit a sample of data fetching result (5 SKU) in order to understand data requirement and corresponding ecommerce site. Applicant shall also recommend the selected VPS and Proxy service. Base on recommendation, applicant shall inform buyer the monthly charge of such service after deployment. Buyer confirmation of such charge is a pre-requisite to start any work. Only serious and professional shall contact me for detail and project requirement documentation. Please include 7 days verification in VPS environment in project time. Seller shall adhere to committed project completion date. Only serious seller shall apply. DO NOT auto bid the project. DO NOT send low price bid and then increase bidding price significantly.

PHP

Web Scraping

Software Architecture

Selenium

Database Programming

Mã dự án: 30199472

Về dự án

20 đề xuất

Dự án từ xa

Hoạt động 3 năm trước

Bạn muốn kiếm tiền?

Địa chỉ email

Lợi ích khi chào giá trên Freelancer

Thiết lập ngân sách và thời gian

Nhận thanh toán cho công việc

Phác thảo đề xuất của bạn

Miễn phí đăng ký và cháo giá cho công việc

20 freelancer chào giá trung bình $607 USD cho công việc này

@phpXpertbd

Dear Employer, Upon checking your project, I am pretty sure I can produce high-quality and perfect results for your project. I have checked the project details. I'm expert in web scraping, web automation and data mining projects. Contact me so I can make few samples before you award the job. Looking forward to work with you thanks.

$555 USD trong 7 ngày

4,9

(106 nhận xét)

7,7

@ArkssTech

Hi Manager!! We checked for your project and interested in your project. Project: Data scrapping for public ecommerce site (2 sites) I am an expert full stack software engineer with skills including Selenium, Software Architecture, PHP, Database Programming and Web Scraping.  I have done several complex projects and provide continuous maintenance support. My goal has always been to provide reliable and efficient to my clients and so far I have been quite successful. I won't delay your project and will keep you updated with constant feedback and status of the work My Full Stack Development Skills 1. Frontend: Front-End HTML5, CSS/CSS 3, JavaScript, 2. Server Administration: Amazon Web Services, Digital Ocean, LAMP, Cloud, Apache, Apache Tomcat, NGINX. 3. Backend: PHP, GoLang, Ruby, Python, Laravel, CI, CakePHP. 4. Databases: Mysql, Oracle, PostgreSQL, MS SQL, SQLite, MongoDB. 5. Testing: Manual & Automation testing. 6. Frameworks: Angular Js, React JS, Symfony2, Laravel, Silex, Spring MVC, Rails, Django, Pyramid, Protractor, Selenium, Blockchain, Etherume, Vuejs 7. UI/UX: Photoshop, Sketch, Zeplin, Invision, Moqups. Type of projects we have delivered to our global clients: a. Enterprise Software Development, b. CRM Development, c. SAAS Product Development c. Web/Mobile Based Application development. d. All CMS website: Wordpress, Magento, Joomla, e. HRMS Software f. Multi-level Marketing (MLM) with crypto payment gateway f. E-commerce installation and customization g. Crypto Exchange Development Please contact me to discuss more regarding this project.

$610 USD trong 12 ngày

4,9

(47 nhận xét)

7,1

@raminde

Have over 12 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered results as per your requirement, In the format you want. You can also ask for data into a particular format - Excel, Json, Mysql, Databases, XMLs, you name them. Further Can help you with integrating it with ur databases, Can create json outputs. We are not only good with scraping but also with the tools that u may need after that. We can help you build you softwares round the data we have 99% Data Accuracy. We have Duplicate finder. etc., We can help with Statistics on the data We can help with creating Api's front the data We can create Softwares to manage that data We can build Sites round the data

$667 USD trong 2 ngày

5,0

(17 nhận xét)

6,6

@saubhagyamweb

----- Data scrapping for public ecommerce site (2 sites) ----- Hello, I read the post and I think my skills and experience are a good fit for this project. I can effectively complete your task to your specifications. I have deep knowledge and great experience (5+years) in Data scrapping , Machine Learning (ML), Tensorflow, Python, Machine Learning, Artificial Intelligence, Web Scraping. Please contact me to discuss the details. Thanks. Virang

$500 USD trong 7 ngày

4,8

(46 nhận xét)

6,8

@aleksandrskvor

Dear employeer. How are you? I have checked your project (Data scrapping for public ecommerce site (2 sites)) carefully and understood your need. Until now I have made various types of website and have done similar this functions. I offer the best quality code and professional performance. You can see some of my previous work in my profile. I can start working immediately. Please send me message so we can discuss further. Best regards. Aleksandr.

$550 USD trong 5 ngày

5,0

(21 nhận xét)

6,2

@viktorbelman01

Dear Sir. As an experienced web scrapper, it is interesting to me. I have been working on various data scrapping projects from static/dynamic sites for over 7+ yeras. I have full experience in requesting, analyzing, data handling, etc... I would be very appreciated if i have a chance to show you how could i contribute to your project. Thank you. Viktor.

$1.000 USD trong 30 ngày

5,0

(21 nhận xét)

5,4

@denTEAM

Hi, I have read your request. I can do anything you want. I've been working in various fields of programming and web scraping with python and using the beautifulSoup, scrapy (spiders), requests and Selenium libraries I can do my project in the shortest time and at the lowest possible price and save it to an excel file. You can even create a new excel file each time the code is run so you can get the old information if you want!! You can change whatever you want and I will take steps Also, I have done many projects on popular sites such as Amazon, eBay... You can see a sample of my work before starting work. Send us a sample action by sending a message on our chat page We can connect more if our work is interesting. My goal is to provide satisfactory and quality work. Thank

$500 USD trong 7 ngày

5,0

(7 nhận xét)

4,1

@anouphimmasy

Hi how are you doing I have checked your project's description in detail I think I can complete your Ecommerce site's scrapping task perfectly because I have rich experience in this kinda scrapping project development using C# and Python for 10+ years I will provide the good result in time I hope we can cooperate forever thanks

$500 USD trong 7 ngày

5,0

(5 nhận xét)

4,2

@markprosorokin

Hi, I can start right now. I can finish it with in short time. With 6+ years rich experience for WebScraping using python and C#. I have ever scrap the ecommerce site that has got Robot, proxy detection. I read your job description very carefully. And This is very interested on me. If you hire me, I will do my best for finishing this. I want to meet you soon for discussing more detail. Thank you.

$750 USD trong 10 ngày

5,0

(2 nhận xét)

3,2

@alexandersharov1

I have read your job description carefully and took a deep interest in your job. As a web expert, I have been working for over 10 years and have ripe experience in web scraping. So I am sure that I am the best fit for your project and I promise the high-quality code and deliver it on time. I can start working immediately and I can work full time in your timezone. I look forward to hearing from you. Best regards.

$500 USD trong 7 ngày

4,7

(5 nhận xét)

3,5

@Rukki123

Hi, I have scrapped so many website in past Amazon (400 Pages) Google Images using Keywords (5000 images) US yellow pages (100 pages) Saudi Arabia ecommerce website etc (More than 20000 products)Centerpoint (Extract More than 30000 products)Jarir(Extract More than 30000 products)Kidzee((Extract More than 30000 products)Khulud (Extract More than 2000 products) Giordano (Extract More than 2000 products) I have Python experience with more than 4 years and written so many scripts using that 1) Web Scraping (Amazon, Facebook, Naukri, etc) using tool (SELENIUM and BEAUTIFUL SOUP)Already scrapped(Amazon, Facebook, Google Images,US Yellow Pages and many more) 2) Created running graphs using python 3) Data Transformation and Data Processing 4) Stack creation using python 5) JSON Transformation using python 6) Video editing using python 7) REST API Using Python 8) ML models using python 9) Using Pyspark Library running Dataproc Jobs in GCP 10) Automate scripting using python 11) Graphical Dashboard creation Tableau and Google Data Studio and many more 12) Management code in GITHUB 13) Applied FUZZY WUZZY Logic to compare the similarity of two texts *** You can also check my feed and can take a final call. I can be a very fruitful resource to you :) Hope you will give me a chance to express my talent on your project using python.

$500 USD trong 7 ngày

5,0

(3 nhận xét)

1,9

@vladislavcukanov

"Your project is my dream" Hello, Thank you for your project. I've just checked your job description carefully. I'm senior developer with 9+ years of Python. By using Python, I developed AI engine, BOT, Web Scraping Tools, Web Searching Tools and so on. Python is my major so you will be satisfied. I think you want to hire a reliable developer. Don’t you? I always find my happy and pleasant within client's mind whenever the they are satisfied. So I try harder and harder to develop the projects perfectly. If someone asks me about my happy and pleasant, I always will talk that when the clients are satisfied as I develop their projects excellently and perfectly, I am very happy. I would love to work with you. I can complete your project on time and within your budget. I hope you contact me soon. Thank you. Best Regards. Vladislav

$350 USD trong 3 ngày

2,6

(3 nhận xét)

2,2

@ahmedasal14

Hi There, I've read your project specifications and i can start from now I am a php developer and have good experience in bots and scripts like that. I have built similar things before (account creator bot, booking bot, web scraping bot, etc ...). I will be happy to hear more details and start working with you. Regards.

$750 USD trong 5 ngày

0,0

(0 nhận xét)

0,0

@nayeepiyush3

i will do and i have a big team I am read your project description carefully. I have rich experience in RestAPI. I think I am the very man who you are looking for. » Ready to Start as Immediate::,Unlimited Revisions & Proper Testing » Keep your Data & Website Secure::, Daily Progress Updates Let's have a quick Chat/PMB-Session to discuss & proceed! Note : We are submiting bid according to your budget set but we feel that after final discussion it could be decrease or increase✔ 24*7 online any time massage Thanks

$1.000 USD trong 16 ngày