
Open
Posted
•
Ends in 1 hour
Paid on delivery
We need a robust yet lightweight script that can automatically pull business details from a publicly accessible government website. The information to capture will centre on business details, such as registration numbers, business name, registration date, address, etc. The workflow should: • Navigate every relevant section of the site (pagination, search filters, subsidiary pages). • Extract the required fields accurately • Export clean, structured data to CSV and JSON A Python solution leveraging requests/BeautifulSoup or Scrapy is preferred, but I’m open to other dependable stacks if they handle rate-limits, retries, and potential CAPTCHA gracefully. The script must be easy to rerun on demand, with clear instructions for environment setup and any dependencies. Acceptance criteria will be a sample scrape of 500 records that match the live site exactly, plus the commented source code and a short README outlining how to run, customise, and schedule the job.
Project ID: 40372992
124 proposals
Open for bidding
Remote project
Active 2 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
124 freelancers are bidding on average $257 AUD for this job

This is a solid scraping task, but the key here is making it reliable, not just getting the data once. I’ve worked on similar data extraction systems where the challenge was handling pagination, inconsistent structures, and making sure the script keeps working even when the site behaves differently or slows down. For your case, I’d structure it like this: navigate → extract → validate → export So the output stays clean and repeatable every time you run it. I’d use Python (requests/BeautifulSoup or Scrapy depending on site complexity) with built-in handling for retries, rate limits, and edge cases like partial loads or timeouts. The goal is to make sure you get consistent results, not broken runs. You’ll get: * Clean CSV and JSON output * Well-commented code * Simple setup so you can rerun or schedule it anytime Let’s open a chat—I can review the target site and suggest the best approach before starting. Best, Jenifer
$200 AUD in 7 days
9.4
9.4

⭐⭐⭐⭐⭐ Create a Script to Pull Business Details from Government Website ❇️ Hi My Friend, I hope you're doing well. I've reviewed your project requirements and see you're looking for a Python script to automate data extraction from a government website. You don't need to look any further; Zohaib is here to help you! My team has completed 50+ similar projects for data scraping. I will create a lightweight script that navigates the site, extracts required fields, and exports data in CSV and JSON formats. ➡️ Why Me? I can easily build your script as I have 5 years of experience in Python programming and web scraping. My expertise includes data extraction, working with APIs, and handling various web technologies. Additionally, I have a strong grip on tools like BeautifulSoup and Scrapy, ensuring your project is in good hands. ➡️ Let's have a quick chat to discuss your project in detail. I'll be happy to show you samples of my previous work. Looking forward to our conversation! ➡️ Skills & Experience: ✅ Python Programming ✅ Web Scraping ✅ Data Extraction ✅ BeautifulSoup ✅ Scrapy ✅ API Integration ✅ CSV/JSON Export ✅ Data Cleaning ✅ Error Handling ✅ Environment Setup ✅ Pagination Handling ✅ Rate Limiting Management Waiting for your response! Best Regards, Zohaib
$150 AUD in 2 days
8.2
8.2

Hello there, I am experienced in web scraping and building scripts or a Windows desktop application using Python. I am also experienced in large data scraping from a given website, bypassing IP, Captcha, and anti-bot or cloud flair protection. Please message me to discuss this project in detail. Best Regards Enamul
$80 AUD in 2 days
8.2
8.2

Hi I have strong expertise in Web Automation, and can develop you a realiable Python-based scraper to extract required business data from your targeted website, in structured CSV/JSON format. I'm available to discuss details in chat and can start right away. Abdul H.
$100 AUD in 1 day
7.8
7.8

Hi, I can build a reliable, scalable scraping solution to extract structured business data from the target government website with high accuracy and repeatability. I have solid experience with Python-based scraping using Requests + BeautifulSoup for lightweight tasks and Scrapy for large-scale, paginated crawls. I’ll design the script to: Traverse all sections (pagination, filters, nested/sub-pages) Extract fields like registration number, name, date, address with validation Handle rate limits using throttling, retries, and rotating headers/proxies if needed Gracefully manage edge cases (timeouts, partial loads, CAPTCHA scenarios where possible) Export clean, normalized data into both CSV and JSON You’ll receive: Fully commented, modular Python code A sample dataset of 500 verified records (matching live site) A clear README with setup, usage, and scheduling instructions (cron/Task Scheduler ready) A few quick questions: Can you share the target website URL? Does the site require login or is it بالكامل public? Any preferred hosting (local, VPS, or cloud) for running scheduled jobs? I can start immediately and ensure a clean, production-ready delivery. Thanks....
$250 AUD in 7 days
7.3
7.3

I can build a lightweight, robust Python scraper (Scrapy/Requests) to extract business details with pagination, filters, and retries. It will output clean CSV/JSON, be easy to rerun, and include full docs. I’ll deliver a 500-record sample matching the live site accurately.
$120 AUD in 3 days
7.3
7.3

Hello, Hope you are doing great, i am expert in web scraping , I can easily scrape all the target data from the website using Python or any other script so you don't have to spend any time or effort doing it manually. Plus, I provide quality results quickly and efficiently within your budget. Lets connect through chat for further detailed discussion, i can start the work right after the discussion., thank you Regards Gaurav Garg
$140 AUD in 7 days
7.3
7.3

As a seasoned veteran in the world of data extraction, I firmly believe that my skills and experience make me an ideal candidate for your Website Data Scraper project. Having successfully undertaken numerous data scraping tasks, I have honed my proficiency in versatile scraping environments including ```requests```, ```BeautifulSoup``` and ```Scrapy``` which align with your preference. Navigating through various sections of your target website is second nature to me, be it pagination, search filters or subsidiary pages. Guaranteeing structured, clean output in both CSV and JSON formats - no problem! My knowledge and proficiency with ASPX website scraping also ensure a seamless extraction process while dealing gracefully with rate-limits, retries and CAPTCHA. In addition to the technical aspects, I understand the importance of clarity and usability. My README are comprehensive and well-detailed enough, so even someone less versed in technicalities can easily customize, re-run and schedule the job on demand. To exemplify my commitment to quality and efficiency (100%), I will provide you not only with commented source code but also a 500-record sample scrape that perfectly matches your live site. My 24x7 availability is reflective of my dedication to deliver within timeframes without compromising on any client-desired needs.
$150 AUD in 1 day
7.0
7.0

We can assist with building a PHP or a Python script to automatically extract business details from a government website. We will navigate relevant site sections, extract required fields, and export data to CSV and JSON. For Python, we can use libraries like "requests" and "BeautifulSoup" for scraping, ensuring graceful handling of site limitations. Experience: We are a group of engineers with 18+ years of experience in software development and web development. We are familiar with PHP, Python, web scraping, and data export formats.
$250 AUD in 1 day
7.1
7.1

I can build a reliable Python scraper (Requests/BeautifulSoup or Scrapy) that handles pagination, retries, and anti-bot limits, delivering clean CSV/JSON with a verified 500-record sample. You’ll get well-commented code plus a simple README so you can rerun, customize, and schedule the script anytime.
$30 AUD in 1 day
6.9
6.9

As an experienced Full-Stack Web Developer with extensive knowledge in not only Python-based data scraping, but also PHP, Laravel, and Codeigniter among numerous other skills, I am certain that I possess the skills crucial for the successful completion of your website data scraping project. I have built robust and efficient web scraping solutions and web based management systems akin to what you require over a decade of working with more than 1000 businesses - and your project will be no different. Moreover, my familiarity with requests/BeautifulSoup and Scrapy gives me an edge in producing lightweight but effective scripts that navigate websites effortlessly along pagination, search filters, and subsidiary pages. I also appreciate your openness to alternative stacks to surmount any rate-limiting or CAPTCHA challenges and assure you of my competence in handling such contingencies. A crucial aspect of this project is the delivery of clean structured data in CSV and JSON formats as per the site to be scraped. Rest assured that my extensive experience and meticulous mindset would ensure not just meeting this requirement, but also provide commented source code and a detailed README to make it easy for you to use and customize the scraper as per your changing needs. Let's get started - I assure you won't regret choosing me to undertake this project!
$300 AUD in 7 days
6.9
6.9

Hello, I have thoroughly reviewed the project requirements for the Website Data Scraper, focusing on the need for a Python script to extract business details from a government website. Let's chat and discuss it further. To handle your project, I will start with developing a Python script utilizing the requests/BeautifulSoup library for web scraping. The script will be designed to navigate through all relevant sections, extract the required business details accurately, and export the data to CSV and JSON formats efficiently. The deliverables for this project will include a sample scrape of 500 records matching the live site, along with well-commented source code and a detailed README for easy setup, customization, and scheduling. Before signing-off my bid, I would like to ask a question, i.e., how frequently do you anticipate the need to run this scraping job? Best Regards, Aneesa.
$100 AUD in 1 day
6.6
6.6

Hi, Can we discuss here to start the work? I am an experienced and professional Data Scraper.I assure you that I can do this job perfectly within required time and reasonable budget. LET'S GET STARTED THE WORK WITH ME. Regards, Shalu
$130 AUD in 5 days
6.8
6.8

✅ Proposal for Website Data S With a strong background in Python programming and web scraping, I am ideally suited to develop the script needed to extract business details from the specified government website. My expertise with libraries like requests, BeautifulSoup, and Scrapy, along with handling pagination, search filters, and subsidiary pages, ensures thorough and efficient data extraction. I am experienced in managing rate limits, retries, and CAPTCHAs, which guarantees the reliability of the script. I will provide a clean, structured export of the data in both CSV and JSON formats, along with concise documentation and clear instructions for rerunning the script, customizing it, and scheduling as required. Ready to deliver a sample scrape of 500 records and detailed, commented source code to meet the acceptance criteria. Lets achieve accurate and effective results together.
$187 AUD in 6 days
6.9
6.9

With my track record of being in the top 1% as a freelancer and over X years of experience as a software engineer, I am well-poised to deliver the perfect solution for your website data scraping needs. My exceptional competencies with Python, Data Extraction, Software Architecture, and Web Scraping will ensure a robust and reliable scraper script. Capable of gracefully handling rate limits, retries, and potential CAPTCHA situations. I fully understand the importance of clean structured data for seamless analysis and I assure you that my solution will provide exactly that in both CSV and JSON formats. Having worked extensively with requests/BeautifulSoup and Scrapy, I completely align with your preference for a Python-based solution. Furthermore, my extensive background in cloud technologies will enable me to create an environment-specific setup with clear instructions to run, customize and schedule the job. Let's not forget about your acceptance criteria; I guarantee not only 500 accurate records matching the live site but also an extensively commented source code accompanied by an instructive README that outlines not just how to run this task specifically but also future-proof it for any kind of customization or scheduling needs you may have. Choose me and let's get this done meticulously with speed!
$80 AUD in 2 days
6.4
6.4

Hello, I will create a PHP script to automate your task. Please provide the details: the website URL, the list of fields to collect, or an example of the output. I have extensive experience in writing PHP scripts for automating data collection and posting. Please see my reviews for reference.
$180 AUD in 2 days
6.5
6.5

I can build a reliable, rerunnable scraper that captures the government site’s business records accurately and exports clean CSV/JSON with minimal overhead. I’m a strong fit for this project because I’ve built production scrapers that handle pagination, search filters, nested pages, retries, and rate limits without breaking when the site structure shifts. For your use case, I’d use Python with Scrapy or requests/BeautifulSoup depending on the site behavior, and add graceful handling for throttling and CAPTCHA-triggered pauses where needed. Key strengths: • Accurate field extraction for registration numbers, business name, dates, addresses, and related details • Clean data processing with validation, deduplication, and structured CSV/JSON output • Clear, commented code plus a short README for setup, reruns, and scheduling My approach: first I’ll inspect the site flow and confirm the best scraping method, then build the crawler, test it against live records, and verify a 500-record sample matches the source exactly. I’ll also include dependency instructions and make the script easy to run on demand. I’ve delivered similar data extraction tools for public directories and compliance datasets, with an emphasis on reliability and maintainability. If you’d like, I can review the target site and confirm the best implementation path before we start.
$140 AUD in 4 days
7.1
7.1

Hello, I will scrape the required information. I will do it as soon as possible. I am ready to start. Thanks. ....................................
$100 AUD in 1 day
6.7
6.7

You need more than a scraper—you need a reliable data extraction system that handles pagination, filters, and edge cases while producing clean, duplicate-free datasets. I specialize in building production-grade scraping pipelines using Node.js (Puppeteer) and Python (BeautifulSoup/Scrapy where suitable), with strong focus on accuracy and stability for structured sources like government sites. Approach: Crawl all sections (pagination, filters, nested pages) systematically Extract structured business fields (name, registration number, date, address, etc.) Implement retry logic, rate limiting, and user-agent rotation Handle anti-bot protections (CAPTCHA-aware fallback if needed) Output clean CSV + JSON with validation and no duplicates Modular config setup for easy reruns and customization Provide clear README + run instructions + optional scheduling setup I’ve delivered 15+ scraping systems with 5.0 ratings, including pipelines extracting 10,000+ records daily with consistent accuracy and structured outputs. Let’s schedule a quick call and I’ll review the target site to confirm the most stable scraping strategy before starting.
$300 AUD in 3 days
6.0
6.0

Hi, I can build a lightweight Python script using BeautifulSoup or Scrapy that navigates through pagination, extracts the required fields, and exports the data in both CSV and JSON formats. My approach includes handling rate limits and potential CAPTCHAs, ensuring the script is user-friendly with clear setup instructions. Upon completion, you’ll receive a sample scrape of 500 records, along with well-commented source code and a concise README for customization and scheduling. With over 5 years of experience in Python development and web scraping, I can deliver this solution efficiently. Let me know if you want to proceed. Best Regards, Priyanka
$140 AUD in 2 days
6.3
6.3

Melbourne, Australia
Payment method verified
Member since Aug 30, 2014
$10-30 AUD
$10000-20000 AUD
$30-250 AUD
$250-750 AUD
$30-250 AUD
$30-250 USD
₹1500-12500 INR
$10-50 USD
$250-750 USD
$15-25 USD / hour
$15-25 USD / hour
$30-250 CAD
$250-750 USD
₹600-1500 INR
$15-25 USD / hour
£250-750 GBP
₹750-1250 INR / hour
€12-18 EUR / hour
$10-30 USD
₹750-1250 INR / hour
$15-25 USD / hour
$30-250 AUD
₹600-1500 INR
₹12500-37500 INR
$10-30 AUD