
Closed
Posted
Paid on delivery
Quero automatizar a coleta de anúncios em quatro sites imobiliários que não exigem login. O objetivo é extrair diariamente as seguintes informações de cada anúncio: • Preço e localização • Detalhes do imóvel — número de quartos, banheiros e metragem Depois da extração, preciso que o script agrupe os registros em lotes (o tamanho deve ser configurável e facil de modificar) e envie cada lote para a minha API REST já existente, utilizando o endpoint e o formato JSON que vou fornecer. Escopo que imagino: 1. Fazer as buscas usando os filtros minimos de cada site. Possivelmente será necessário realizar 1 busca para cada cidade. E logo os resultados podem estar paginados ou podem aparecer por scroll infinito, terá que navegar todas as paginas ou fazer scroll ate o finao. Mapear as páginas de listagem e de detalhe dos quatro portais. 2. Criar o scraper em Python integrado com Firecrawl usando Prompt 3. Implementar mapeamento e normalização dos dados, deduplicação básica e detecção de anúncios já atualizados. 4. Envio em lotes para a API com manejo de erros e re-tentativas exponenciais. 5. Agendamento diário via cron, systemd timer ou similar. 6. Logs claros em arquivo e console, além de alertas simples em caso de falha (por exemplo, e-mail ou Slack webhook). 7. Entrega do código-fonte comentado, [login to view URL] (ou [login to view URL]) e um pequeno README para implantação. Opcionalmente, aceito Dockerfile. Aceito propostas que tragam melhorias, como testes unitários ou painel simples de monitoramento.
Project ID: 40496559
32 proposals
Remote project
Active 22 secs ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
32 freelancers are bidding on average $161 USD for this job

Olá, Tenho muita experiência com scraping de portais imobiliários. Para estimar prazo e custo de forma responsável, precisaria saber quais são os 4 sites. Pela descrição, acredito que existem algumas falhas relevantes no planejamento e que a complexidade real do projeto está sendo subestimada. Seguir a abordagem descrita provavelmente resultará em retrabalho posteriormente. Minha proposta inicial é de US$ 500, podendo variar de acordo com os portais envolvidos. Caso faça sentido para você, fico à disposição.
$500 USD in 10 days
5.5
5.5

You need a reliable scraper, not just data extraction. I can build a Python + Firecrawl solution that scrapes all 4 portals, handles pagination/infinite scroll, normalizes and deduplicates listings, detects updates, and sends configurable batches to your REST API with retry logic. The solution will include daily scheduling, logging, alerts, README, and well-commented source code. Looking forward to discussing the portals and API details.
$150 USD in 4 days
3.8
3.8

Hello Dear! Good Day! Hope you are doing fine. This is Ruhul Ajom Sagor. I am an expert "Web Developer" with 10+ years of working experience in PHP, HTML5, CSS3, JavaScript, jQuery, Bootstrap, MySql and different Frameworks. I have completed my B.S.C Engineering in Computer Science and Engineering (CSE) from BUET. Hire me and you don't have to worry about your website problems again! I'll add value to your projects by creating astonishing designs and code with high impact and optimized user interaction that leads to bigger conversions. WHAT PROBLEMS CAN I HELP YOU SOLVE? • Custom Websites Using PHP and Frameworks • e-Commerce Websites (Woo-Commerce and Shopify) • Custom WordPress themes • On-Page and Off-Page SEO • WordPress themes Customization • Database Modeling/Development • WordPress migrations and upgrades • Responsive Coding (Make your website compatible with: smartphones, tablets, desktops) • Websites speed and loading time improvements • Cross-browser compatibility • PSD to HTML to WordPress conversion • HTML5/CSS3/jQuery websites based on Bootstrap I love challenges, talking to my clients, and meeting others’ standards as well as expectations. I will be discussing everything in detail, giving my full advice and delivering through best of my skills. You are cordially welcome to discuss your project. Thank You! Best Regards, Ruhul Ajom
$50 USD in 2 days
3.8
3.8

Welcome to professional Python development services! Hi there, I'm Alema, a Python expert programmer who strives for clear code in atmospheric, numerical weather prediction, physics, and all other seminal fields. I'm ready to provide you with high-quality services. I have completed 350+ projects with a 100% Positive Rating. If you are looking for Quality work, look no further. Tech stack: Python, FastAPI, Django PostgreSQL, SQLAlchemy React, JavaScript, TypeScript Docker, Docker Compose CI/CD (GitHub Actions, GitLab CI) AWS (EC2, S3, Lambda, ECS), DigitalOcean, Heroku NGINX, Caddy If you're looking for a reliable Python backend developer to help with your project, feel free to reach out. Your faithfully. Eng. Alema Akter
$30 USD in 1 day
3.4
3.4

Hello, I can help automate the daily extraction of real estate listings from four login-free websites. The goal is to gather price, location, and property details (bedrooms, bathrooms, square footage) from each ad. The script will then batch the data and send it to your existing REST API using the provided JSON format. I've spent years creating Python scrapers integrated with Firecrawl via Prompt. I would first set up minimal filters for each site, navigate through paginated or infinite scroll results, and map the listing and detail pages. I can also handle data mapping, normalization, basic deduplication, and updated ad detection. Error handling, exponential retries, and daily scheduling via cron will be implemented. Clear logs, basic alerts, and well-commented source code will be provided. I can start anytime and work full-time. Regards,
$100 USD in 2 days
3.0
3.0

Hi! I can build your Python-based scraper for the 4 real estate sites using Firecrawl, with pagination/scroll handling, data normalization, deduplication, configurable batching, and reliable REST API delivery with retries and logging. Includes daily scheduling (cron/systemd) and optional Docker. Budget and scope will proceed only after your approval. Excited to work with you.
$100 USD in 3 days
2.7
2.7

I can help automate the ad collection from those four real estate sites using Python and web scraping techniques. It sounds like a fun project! Which sites are you focusing on for the scraping?
$54 USD in 7 days
2.5
2.5

Lets chat, a free consultation and no obligation. I understand you need a clean, professional, and user-friendly solution for your "Raspador Diário Sites Imobiliários" project. My skills in PHP, Java, JavaScript are a perfect fit for this project. While I am new to freelancer.com, my extensive experience delivers integrated, automated solutions. Regards, Jason McLachlan
$188 USD in 3 days
1.9
1.9

Hi, I can help with daily automated collection of real estate listings from four sites and sending normalized JSON batches to your existing REST API. I’ll start by mapping each site’s listing/detail flows, pagination or infinite scroll behavior, and building the Python + Firecrawl extraction with a configurable batch size and clear logs. To reduce risk, I’ll add deduplication, “already updated” detection, and robust retries/backoff so failures are visible and safe to review. Which cities and minimal filters should I use per site? Also, can you share the API endpoint and the exact JSON schema/fields you’ll accept—then we’ll set up a first test run and iterate fast.
$95 USD in 3 days
1.6
1.6

The real challenge here isn’t just scraping the four sites—it’s keeping data consistent across different layouts, pagination styles, and ensuring reliable daily delivery into your API without duplicates or missing updates. My approach: • Build a Python scraper using Firecrawl with structured prompts for consistent extraction across all portals • Create site-specific handlers for pagination, infinite scroll, and detail-page enrichment • Normalize all listings into a single schema (price, location, rooms, bathrooms, area) • Add deduplication + change detection using URL/ID fingerprinting • Batch system with configurable batch size and safe delivery to your REST API (retry + exponential backoff) • Daily automation via cron or systemd timer • Logging to file + console with optional Slack/email alerts for failures • Clean configuration file for API endpoints, batch size, and site rules • Optional Docker setup for easy deployment I’ve built similar data pipelines where scraping reliability, structure normalization, and API batching were critical for daily production use across multiple sources. One question: should updates overwrite existing listings in your system (upsert), or do you want historical versions stored as separate records? I can deliver a stable, maintainable scraper pipeline with clean configuration and production-ready error handling.
$140 USD in 7 days
0.0
0.0

Site Mapping & Discovery I will analyze the 4 property portals, identify listing/detail page structures, search filters, pagination, and infinite-scroll behavior. Searches can be executed per city when required, ensuring complete coverage of available listings. Firecrawl-Based Scraping Develop a Python scraper integrated with Firecrawl using prompt-driven extraction. The scraper will collect price, location, bedrooms, bathrooms, area size, listing URL, and other relevant attributes from each property. Data Processing & Normalization Implement a normalization layer to standardize fields across all portals, perform duplicate detection, and identify updated listings to avoid unnecessary API submissions. Batch API Integration Records will be grouped into configurable batch sizes and sent to your existing REST API using the JSON format you provide. The integration will include retry mechanisms, exponential backoff, timeout handling, and detailed error logging. Automated Scheduling Deploy daily execution through cron, systemd timer, or Docker scheduled jobs depending on your infrastructure preference. Monitoring & Alerts Provide structured logs in both console and file outputs, plus failure notifications via email or Slack webhook for operational visibility.
$300 USD in 10 days
0.0
0.0

Olá, posso criar o scraper em Python para os quatro sites imobiliários sem login, com paginação ou scroll infinito, normalização dos campos principais e envio em lotes para a sua API REST. Eu faria primeiro o mapeamento dos sites e filtros mínimos por cidade, depois implementaria deduplicação, checkpoints para retomar execuções interrompidas, retries com backoff, logs claros e um arquivo de configuração para tamanho do lote, endpoint e campos JSON. Entrego também um README curto para execução diária.
$76 USD in 4 days
0.0
0.0

Saw your project type post and it actually made me stop scrolling. Rare. Built 50 plus sites including similar project type. Question. Fixed deadline or flexible timeline? I am new here so my first few clients get a serious discount. Message me if you want details before the spots fill. Regards, Giancarlo Del Frate
$150 USD in 7 days
0.0
0.0

Spain
Member since Jun 16, 2017
₹750-1250 INR / hour
$30-250 USD
₹750-1250 INR / hour
£250-750 GBP
₹12500-37500 INR
$30-250 AUD
$30-50 USD
₹100-400 INR / hour
₹12500-37500 INR
$15-25 USD / hour
₹12500-37500 INR
$250-750 USD
₹1500-12500 INR
$10-350 USD
$250-750 USD
₹12500-37500 INR
₹12500-37500 INR
$250-750 USD
₹1500-12500 INR
$2-8 USD / hour