Develope four crawlers, running on a daily schedul and export data to Excel file

€12-18 EUR / hour

Đã hoàn thành

Đã đăng vào

hơn 5 năm trước

€12-18 EUR / hour

Project description: Requried is the development of four crawlers to get data from four websites. From those websites all postings of forklift trucks are supposed to be extracted. The crawlers are re-run on a daily basis and collect all new postings. The output than has to be safed to an excel file. New data from the daily crawls has to be either delivered in a new excel file or directly added to the exisiting excel data base. Required skills: - Python, GO, PHP or JVA - Experience in building webcrawlers - Experience in setting up hosting e.g. AWS or similar Websites: - [login to view URL] - [login to view URL] - [login to view URL] - [login to view URL] Required data points: Brand Type of forklift Modell type Year of Manufacturing Operation hours Mast type Lifting capcity Lifting height Engine type (e.g. Diesel, LPG, Battery, etc) Dealer location: Country, postal code, City Scope: Intilially there is expected to be about 150.000 postings. (Optional) Delete duplicates: If possible duplicates are supposed to be deleted before creating the excel file. Some dealers post their inventory on several websites and to make sure those are not accounted for twice the resulting duplicates have to be delelted. Based on the data points it should be possible to create a unique hash-value. (This can be discussed)

Mã dự án: 18213159

Về dự án

9 đề xuất

Dự án từ xa

Hoạt động 5 năm trước

Bạn muốn kiếm tiền?

Địa chỉ email

Lợi ích khi chào giá trên Freelancer

Thiết lập ngân sách và thời gian

Nhận thanh toán cho công việc

Phác thảo đề xuất của bạn

Miễn phí đăng ký và cháo giá cho công việc

Đã trao cho:

@hakyoshyt

Hello, I am an experienced python developer with 2+ years developing scrapers and websites. I have built web scrapers using scrapy, bs4, requests, random proxy, rotating user agent, postgreSQL and lxml. I can provide you with a link to my github account [login to view URL] so you can see some sample projects I have created. A little bit about me I’m an American located in sunny south florida, english is my first and only language and in the past I worked for large companies such as Visa and American Express.

€18 EUR trong 40 ngày

5,0

(1 nhận xét)

3,5

9 freelancer chào giá trung bình €17 EUR/giờ cho công việc này

@bestit4u

Hi. I am very interested in your project, because I have much experience in such projects. I have good skills with the program language including C/C++, C#, java, php, asp.net, python, VB.NET. So I have expert and smart technic with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others). Especially, I am an expert in betting project and gambling games and sites(bet365, bwin, pinnacle, betfair...) ,,, shopping auto buyer(adidas, footlocker, eastbay, supreme and etc) So, I can solve the captcha automatically. Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.

€22 EUR trong 40 ngày

4,9

(114 nhận xét)

7,1

@dvcontact

Hi Do you want to see a sample of your project on building four web-crawlers that will scrape data from four different website on a daily basis and save the scraped data in Excel file completed before you award the project. You can consider it professionally done in less than 24 hrs. I can tell you about how highly experienced and multi-talented I am. But I’m sure you need more than that. In less than 24 hrs, I will complete a sample part of the job before you award the project so you can be sure you’ve entrusted your job in the best hands. No commitments required! Hope to hear from you soon

€15 EUR trong 40 ngày

4,9

(58 nhận xét)

6,5

@hunmin888

Hi, sir! I have a close look to your project. I have a good skill in scrapping. If you want, I can show my previous projects to you. I wish you will work with me for this project. If you award this project to me, we'll complete it in time. Our budget may be negotiable Thanks

€16 EUR trong 40 ngày

5,0

(25 nhận xét)

5,7

@vhsoftwareBA

Hello. I can do the crawling software for You. Would base it on python. Scheduler would be created to run the script every morning. Contact me please so we could discuss details. Hope to hear from You. Regards

€15 EUR trong 40 ngày

5,0

(4 nhận xét)

4,2

@arcsoft16

"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on similar requirement in past. We have right skills to work on this assignment. . We will complete the work as per requirement Also my team working on same project" We have read out every thing about your project kindly confirm"

€16 EUR trong 40 ngày

0,0

(1 nhận xét)

0,0

@uday2405

If you're looking for top-quality project delivery that will increase leads, make life easier and build on your brand identity, you've come to the right place.

€16 EUR trong 40 ngày