Stabilize Amazon Job Scraper

$750-1500 USD

Đã đóng

Đã đăng vào khoảng 1 tháng trước

$750-1500 USD

Thanh toán khi bàn giao

I already have a working scraper that targets [login to view URL], but it quickly runs into 403 and 429 responses thrown by AWS WAF. My goal is simple: continue gathering job listings at full speed without resorting to artificial delays between requests. What I need from you • Diagnose exactly why the WAF is flagging my traffic (headers, cookies, TLS fingerprints, request rate, etc.) • Implement whatever counter-measures are required—smart rotation of IPs or user-agents, better session handling, signed cookies, custom TLS fingerprints, residential proxies, captchas, or any technique you know that keeps requests fast and invisible. • Hand back a clean, reproducible solution (preferably in Python, but I am flexible) that lets the scraper pull listings continuously with zero 403/429 interruptions. Acceptance criteria 1. A script or module I can plug into my current scraper. 2. Demonstrable run (screen capture or log) showing at least 1 000 uninterrupted requests hitting [login to view URL] endpoints with no delay logic and no WAF blocks. 3. Brief setup notes so I can replicate the environment on my side. If you have real-world experience taming AWS WAF or similar edge firewalls, let’s get this running smoothly.

Software Architecture

Web Scraping

Web Security

Mã dự án: 40303599

Về dự án

31 đề xuất

Dự án từ xa

Hoạt động 1 ngày trước

Bạn muốn kiếm tiền?

Địa chỉ email

Lợi ích khi chào giá trên Freelancer

Thiết lập ngân sách và thời gian

Nhận thanh toán cho công việc

Phác thảo đề xuất của bạn

Miễn phí đăng ký và cháo giá cho công việc

31 freelancer chào giá trung bình $1.049 USD cho công việc này

@ZohaibRoy

⭐⭐⭐⭐⭐ Bypass AWS WAF to Continuously Scrape Job Listings from Amazon ❇️ Hi My Friend, I hope you're doing well. I've reviewed your project requirements and see you're looking for a solution to bypass AWS WAF while scraping job listings. You don't need to look any further; Zohaib is here to help you! My team has successfully handled over 50 similar projects focused on web scraping. I will diagnose the WAF issues and implement effective counter-measures to ensure continuous scraping without interruptions. ➡️ Why Me? I can easily tackle your project as I have 5 years of experience in web scraping and automation. My expertise includes diagnosing WAF issues, implementing IP rotation, and managing session handling. Moreover, I have a strong grip on Python and relevant web technologies, ensuring a smooth solution for your needs. ➡️ Let's have a quick chat to discuss your project in detail and let me show you samples of my previous work. I'm excited to collaborate and find the best solution for your scraping needs. ➡️ Skills & Experience: ✅ Web Scraping ✅ Python Programming ✅ AWS WAF Management ✅ IP Rotation ✅ User-Agent Switching ✅ Session Handling ✅ Captcha Solutions ✅ Data Extraction ✅ Log Analysis ✅ Error Handling ✅ Script Optimization ✅ API Integration Waiting for your response! Best Regards, Zohaib

$900 USD trong 2 ngày

4,9

(160 nhận xét)

8,0

@salmanullahbaig

Came across your project and had to reach out. Understanding your current Amazon job scraper is hitting 403 and Let me know if you'd like to jump on a quick call to go over the details.

$1.242 USD trong 7 ngày

5,0

(13 nhận xét)

5,8

@OscarMozo

Hi, I can help you with this. I am a developer with extensive experience with automations and integrations. I've helped clients with similar projects. Let me know your interest, Sincerely, Nicolas

$1.125 USD trong 7 ngày

5,0

(6 nhận xét)

5,5

@Hemantt841

I see you’re dealing with AWS WAF blocking your Amazon job scraper and need a way to bypass 403 and 429 errors without slowing down your requests. You want a solution that keeps scraping at full speed, with no artificial delays, and a clean, reproducible integration for your existing scraper. Your key challenges are diagnosing why WAF flags your traffic—whether through headers, request patterns, or TLS fingerprints—and implementing advanced countermeasures like IP rotation, user-agent cycling, or session management to maintain uninterrupted scraping. You also need a demonstrable run of 1,000 continuous requests without blocks and clear setup instructions. I’ve built Python modules that integrate proxy rotation, custom TLS fingerprints, and session handling to evade AWS WAF and similar firewalls for high-volume scrapers. One recent project involved bypassing strict rate limits and bot detection on a major e-commerce site, delivering stable scraping at scale without triggering blocks. This experience directly applies to your need for a seamless, fast scraper that avoids 403/429 errors. I can deliver a tested, modular Python solution within 7 days that integrates smoothly with your current scraper and includes detailed setup notes. Let’s discuss how to get your scraper running uninterrupted as soon as possible.

$825 USD trong 7 ngày