Freelancer: edwarddzi8f
Chia sẻ:
Báo cáo bài thi

Web scraper using Laravel Spatie and Dom Crawler

While you asked that I use spatie packages for scraping, I used similar packages that are used by spatie https://symfony.com/doc/current/components/dom_crawler.html Here is my set up I create a general scraper which has support for proxies (See attached) Scraper can work on cron jobs (scheduled) You can specify the sites and categories you want to scrape in .env file i.e SITE_SCRAPERS="bearmach" Every site has it own scraper After data has been scraped it can be saved to database Images are scraped and saved to a storage directory For now I have created a scraper for one of your site https://www.bearmach.com/ for category https://www.bearmach.com/catalogue/air-filters-seseseaf I will need some feedback from you to finish the other scrapers. I have hosted the code in github, Let me know how I can share the code. Here is a small video link to show you how it is scraping. https://www.loom.com/share/cf3cd2ec0a7b47bda4d6cde1df13dbd5 Thanks and hoping to hear from you


                                                                                                            Bài tham dự cuộc thi #                                        1
                                     cho                                         Looking for Laravel spatie / crawler developer to setup website parser.
Bài tham dự #1

Bảng thông báo công khai

Chưa có tin nhắn nào.