I need you to build a [login to view URL] scraper to specific endpoints which are covered under logged-in user.
The task includes for you to find solutions for:
- auto-login, or
- ways to avoid login scraping via generating cookies etc, or
- other creative ways you can get to achieve the required result.
As long as the solution is working well, payment will be also good. If you have experience or wish to test your skills, feel free to apply.
Payment will be funded and released ONLY when the working solutions are presented.
requires data examples that would include:
- All the information about the product when product ID is present
- All the reviews of the product with pagination and other filter options when product ID is present
- All the products including, of a single shop on taobao with posible filtering options when shop id or seller id is present
those are the main 3 focus points on which data has to be gathered, the first being the most important