My English is not very good, so please feel free to contact me if there is something I am not clear about.
I need a crawler expert to help me crawl all the listings in a certain city on airbnb.cn. so what I need is the python source code that can achieve this purpose.
Here is the details:
Let's say Shanghai, there are roughly 50,000 to 60,000 listings. I need the code to be able to capture this amount of data within 2 hours.
Considering that one page of airbnb displays 20 listings, and the information I need is all on this page, so even 60,000 listings information only need to be visited about 3000 times, which should not be difficult.
The real difficulty is that airbnb can only display 300 listings at a time in a city, so how to grab all the listings in this city has become a big problem. If you use filters and price combinations to filter, some places in Shanghai will still exceed the limit of 300 links, so I am more inclined to use a combination of latitude and longitude and display range to solve this problem.
The information I need is like the pictures below.
Hope someone can solve my problem.
thank you all
19 freelancer đang chào giá trung bình $144 cho công việc này
Hi, No problem if your english is not good..I understood your work requirement & ready here foe crawling from this website airbnb.com. Please mesaage me here. Regards, Sam