I need a great Laravel web developer to create a crawler/scraper.
I already have the scraper created in Python, but I'm trying to convert it to Laravel/PHP so that it's easier to manage for me since I'm a PHP developer too.
We will need to decide if we went to scrape like a user, i.e. using something like puphpeteer library, which controls node.js puppeteer, or use something like GuzzlePHP to scrape direct API endpoints on their websites.
The crawler/scraper will need to crawl restaurant websites like DoorDash, Uber Eats, and GrubHub and save all the data including:
- Main business info
- Location info
- Location menus
- Location menu groups
- Location menu items
- Location menu item options
I have an extensive database already, so each new location that is saved needs to check the database to make sure it exists, if it exists, update the information, otherwise, create a new business/location.
The locations would be matched up by business name + location address.
I am also looking to have a basic interface developed so that I can always see status of crawlers, how much data they are gathering, etc...
We will probably need proxies so I can get rotating residential proxies or similar.
When you bid on this job, please tell me which actor starred in the movie Dumb & Dumber as Lloyd Christmas, just so i know you've read this entire job description. If you do not post this, your entry will be rejected.
For now, I would say we just start with one, for example, Doordash, and see how that goes. Let me know how much time and cost you think it would take you.
18 freelancer chào giá trung bình$1097 cho công việc này
Hello, Sir. I read your description carefully. I have 5+ years of experience with Website Development using Laravel. I am a perfectly suitable for this job. Please contact me for further discussion. Thanks.