Đã Đóng

Crawling tool with Scrapy and Mongo

- We need you to build us a crawling tool from scratch which follow these requirements:

--- Requirements ---

- The tool should be used Scapy Python and MongoDB.

- It should dockerized into docker-compose separated into two containers: web and db.

- It should be easier to extend if we gonna crawl the new site.

Such as we will have folderA will crawl site A, folderB will crawl site B...etc

- It should be easier for configure the database and the site we gonna crawling.

- When the structure of codebase is done, we will review it and you need to send us a documentation to show:

+ How can we setup crawler for new site ?

+ Which file/folder need to be created

+ Which command need to be executed to crawl all the sites which were configured in the codebase.

- We will send you an example site, so you will do an example for us when the structure of codebase is done.

- I will send you invitation to github repository then you will work on it.

---- Note ---

- Please read it carefully before you ask us or bid with the right price.

- Only release payment if the codebase is good enough and easy for us to crawling the site.

- Please mark prefix 'DDPythonMongo' when you bid. Otherwise, I'll skip the bid due to automatically bid or bot.

Kĩ năng: Tạo Blog, Thiết kế đồ họa, PHP, Thiết kế trang web

Xem nhiều hơn: easy wc3 bot, easy bot, diablo baal bot easy set, free crawling bot spider, easy populate review, easy logo review, easy php calendar documentation, oscommerce easy populate review, zen cart easy populate review, easy albums review wordpress, easy product review job, very easy and simple online job mostly it would be copy paste task and typing but need to be done very carefully and avoid error, need data crawling tool, easy digital downloads documentation, easy projects review, easy property listings documentation, fund easy app review, website crawling tool, easy post api documentation

Về Bên Thuê:
( 2 nhận xét ) Ho Chi Minh, Vietnam

ID dự án: #21405415

14 freelancer đang chào giá trung bình $204 cho công việc này

bestit4u

Hello Respect sir I saw your description, I can't stand the excitement of seeing the project you post on... I bet one's shirt on I have the ability to complete your project perfetly because I have experience with your Thêm

$140 USD trong 7 ngày
(87 Nhận xét)
6.9
chirgeo

Hi. I did read the project description and have a few questions. 1. Do you need the script as well or data only? 2. What is the format of the output data? CSV is OK? We can do other formats as well. 3. Which fields do Thêm

$180 USD trong 5 ngày
(19 Nhận xét)
6.3
MobileKing1225

Hi! Great Day! My name is Zaiju an expert in PHP. I have come to know what you needed. I would like to have the opportunity to discuss about the project with you. I have 8 years experience in web design and develop Thêm

$100 USD trong 7 ngày
(19 Nhận xét)
5.4
coolmob0816

DDPythonMongo Good day of today! I am a senior web developer with rich experiences about scrapy python and mongo db management. After checking your post carefully , I am convinced that I can complete your project and w Thêm

$600 USD trong 15 ngày
(23 Nhận xét)
5.4
romancoder204

DDPythonMongo How are you? I'm interested in your project. I've read your requirement carefully. In my precious working years i have finished many succesful projets with 100% customer satisfaction. I am a full stack d Thêm

$140 USD trong 7 ngày
(16 Nhận xét)
4.6
songhwa2019

DDPythonMongo Hi there. Thank you for your posting. I have done similar project before for onion site crawling. I hope my experiences would be helpful to this project. I would like to have a detailed discussion with yo Thêm

$250 USD trong 2 ngày
(3 Nhận xét)
3.9
poojaahujawebit

DDPythonMongo Hi, I have gone through your project description. I can do this work easily. I am a full stack developer with extensive experience in both front and backend technologies. I build apps using modern archi Thêm

$150 USD trong 10 ngày
(2 Nhận xét)
3.4
HanCG105

Hi, there. My name is Han, and I have 5+ years of experience in developing websites using HTML, CSS, JavaScript & several frameworks such as Python, Shopify, Wordpress, and Laravel. I read your job description and chec Thêm

$120 USD trong 7 ngày
(1 Nhận xét)
3.5
codestar0714

Hello Sir! I'm skilled in web scraping with Scrapy framework, and scraping automation with Selenium and beautifulsoup. If you need to get information off the web in an automatic fashion, I can write you a special scrip Thêm

$140 USD trong 1 ngày
(1 Nhận xét)
0.0
ellisjordann

Wait a second! As far as I see, the project has got a problem. We need to take it considered. But it is not a point, point is that I can think outside the box and help you by coming up with fresh ideas. Fresh idea is j Thêm

$400 USD trong 5 ngày
(0 Nhận xét)
0.0
swappitwebnsoftw

Thanks for taking the time to review my proposal! I’ve looked over my notes regarding your graphic design needs, and have created a proposal for your project which I feel meets your needs. We have a team of Freelance G Thêm

$140 USD trong 4 ngày
(2 Nhận xét)
0.0
GeraldPro

DDPythonMongo I have rich experience in Crawling system and Python, MongoDB. I fully understood your deeds. I have some questions to ask you. Can I have a chat with you? Hope you reply. Thank you.

$250 USD trong 7 ngày
(0 Nhận xét)
0.0
sunnyyadav4525

HI, I HAVE EXPERIENCE IN WORKING WITH WEB CRAWLING AND SCRAPING THE DATA FROM WEB SITES AND ABLE TO SCRAP THE DATA USING JAVA, PYTHON, PHP AND USING THE MYSQL AS MY DATABASE. AND THE BID IS NEGOTIABLE WANT TO NEGOTIA Thêm

$111 USD trong 6 ngày
(0 Nhận xét)
0.0
bedircaushi

Currently working at a large project where my responsibilities are crawling, maintaining and updating big websites like google news, yahoo news, bing news etc.

$140 USD trong 7 ngày
(0 Nhận xét)
0.0