Beautifulsoupcông việc

...đầu dự án). Mục tiêu – Lấy đầy đủ tên sản phẩm, giá hiện tại, giá gốc (nếu có), thuộc tính chính, tên shop, lượt bán, lượt thích, điểm rating và đường dẫn ảnh. – Crawler phải đi hết các trang trong danh mục, không bỏ sót, không trùng dữ liệu. – Kết quả xuất ra CSV / Excel; cột nào ra cột nấy, tiếng Việt không lỗi font. Yêu cầu kỹ thuật – Ưu tiên Python sử dụng Scrapy, Requests + BeautifulSoup hoặc Selenium nếu cần vượt qua cơ chế chống bot của Shopee. – Code sạch, chú thích ngắn gọn, dễ đọc; tôi cần toàn bộ source kèm hướng dẫn chạy trên Windows (có th...

...ideal workflow is simple: • I enter or update the list of product links I care about. • The script pings those pages at a reasonable interval, detects the switch in stock status, and immediately triggers a push notification to my smartphone. A lightweight web-scraper with a clear, maintainable rule for that button-text change should be enough. If you prefer to use Python with requests/BeautifulSoup —or Playwright, Puppeteer, or another headless approach—feel free; the key is fast, accurate detection and rock-solid alerts. Please include brief setup instructions so I can run it on my own machine or a small VPS and add or remove SKUs whenever I need. Deliverables 1. Source code with clear comments. 2. Configuration file or simple UI for adding prod...

...stock options and awards, bonuses / incentive pay, plus any other compensation figures that appear in the summary or grants tables. Because the data are scattered in both narrative text blocks and embedded HTML tables, a purely scripted scrape misses too much, while a purely manual effort would be too slow. I’m therefore looking for a balanced workflow that blends solid Python-based parsing (BeautifulSoup, pandas, regex, maybe an LLM call for tricky passages) with targeted human review to catch formatting quirks and footnotes. Deliverables • A single CSV or Excel file where each row is a firm-year filing and each column holds one of the compensation items above, clearly labeled. • A short read-me describing the extraction logic, any LLM prompts used, and the...

...delivered in a single, well-structured Excel file (.xlsx) with clear column headers and no duplicate rows. A short “read-me” tab or text file that explains any data cleaning or assumptions you had to make will also be appreciated. Because this is a one-off job, efficient turnaround is important to me. Please outline: 1. the approach and tools you will use (e.g., Python, Scrapy, Selenium, BeautifulSoup, Playwright, etc.) while respecting the site’s pagination and anti-bot measures; 2. the estimated time you need from award to delivery; 3. a realistic fixed price for the full scrape, including any post-processing needed to ensure clean, accurate data. If you can optionally supply the scraping script as part of the hand-off, note that in your proposal&mda...

I need a Python-based scraper that pulls complete c...useful is missed. Here’s what matters to me: • Reliability – the code must navigate pagination, work around basic anti-bot measures (rotating user-agents / respectful delays), and throw clear errors if the site layout changes. • Clean output – save to CSV or an SQLite database with consistent column names, ready for later analysis. You’re free to choose libraries you trust (requests, BeautifulSoup, Selenium, Scrapy, Playwright, etc.); just document any setup steps and keep third-party dependencies to a minimum. Deliverable: git-ready project folder containing the scraper, a brief README with run and schedule instructions, and a sample output file generated from at least a few live pages ...

I’m putting together a master spreadsheet of Australian businesses and need an organised, accurate data-gatherer to make it happen. ...spreadsheet (Excel or Google Sheets) with consistent formatting and no duplicates. Acceptance criteria • At least 95 % of golf clubs identified nationwide, verified by cross-checking multiple directories. • Phone numbers in Australian format, one row per business. • No duplicate entries and no blank mandatory fields. If you work comfortably with tools like Excel, Google Sheets, Python, BeautifulSoup or similar, you’ll fly through this. Data accuracy is more important than sheer speed, so double-checking entries is essential. Let me know how you plan to tackle the initial golf-club list and how quickly you can scale ...

...property type, sqft, lot size, occupancy (if available), county/state, source URL, status (upcoming/active/sold/postponed/canceled), priority score (1–100), alert tier. Output Structured JSON via webhook to our Supabase REST API (we provide schema + credentials). Alert emails as formatted HTML via SendGrid/SES. No duplicates — dedup by address + parcel ID. Technical Requirements Python (Scrapy, BeautifulSoup, Selenium) and/or JavaScript (Puppeteer, Playwright) API integration (Supabase REST API, ATTOM Data API) Anti-bot handling: CAPTCHA solving, IP rotation, proxy management Government website scraping experience (fragile, inconsistent sites) PDF parsing and OCR Email automation (formatted HTML alerts) Scheduling/orchestration (cron, n8n, Airflow, or similar) Error ...

...more APIs (for example OpenCorporates, Clearbit or any better suggestion you have). 3. Store results in a structured format (CSV plus an SQLite or Postgres option). 4. Offer a simple command-line trigger as well as a callable function so I can integrate it into larger workflows later. 5. Log activity and errors clearly. Tech stack Python 3.x with common libraries such as Requests, BeautifulSoup or Scrapy, Pandas and an ORM (SQLAlchemy is fine). If Selenium or Playwright is unavoidable for dynamic pages, please factor that in. Acceptance criteria • Full source code with virtual-env requirements file. • Sample run that fetches at least 30 real company records, shows enrichment working and saves the combined dataset. • README explaining setup, usage an...

...“address eligibility” checker, and I need that information pulled automatically rather than re-typing each location by hand. Your task is to build and run a scraper that goes through the same steps the public tool requires, captures the eligibility result for every address I supply, and returns the full set in a clean Spreadsheet (Excel or CSV is fine). A repeatable script—Python with requests / BeautifulSoup or Selenium, or any language you are comfortable with—is preferred so I can rerun it later when the list of addresses grows. Handle captchas or session cookies if the site uses them, and respect polite crawling speeds to avoid blocking. Deliverables • The complete spreadsheet containing the eligibility outcome for every input address • ...

...Companies) State Company Type (Private Limited / LLP / OPC / Public Limited) Authorized Capital (if available) Registered Office Address (if available) The system should: Run automatically daily (cron / scheduler) Avoid duplicate records Export data to Excel / CSV / Google Sheets / API endpoint Handle captcha or dynamic website structure if applicable Preferred technologies: Python (BeautifulSoup / Scrapy / Selenium) Node.js Puppeteer / Playwright Any robust scraping framework Deliverables: Fully working scraper or API system Source code Documentation for running the script Optional: Dashboard or automated email delivery of daily data Additional Preferred Features (Bonus): Historical data scraping Cloud deployment (AWS / DigitalOcean / VPS) API endpoint to ...

...dynamic JavaScript-rendered pages. Experience with data parsing and structured data storage. Ability to implement error handling and logging. Deliverables: Fully functional scraping script or application. Clean, well-structured dataset. Documentation explaining how to run and maintain the scraper. Optional: automated scheduling or update mechanism. Preferred Skills: Python (Scrapy, Selenium, BeautifulSoup) or Node.js (Playwright, Puppeteer). Experience scraping large datasets. Experience with MongoDB or similar databases is a plus. Project Size: Medium to large. Please Include in Your Proposal: Your experience with similar scraping projects. Technologies you would use. Estimated timeline. Examples of previous work. We are looking for someone reliable who can build a scalab...

...more APIs (for example OpenCorporates, Clearbit or any better suggestion you have). 3. Store results in a structured format (CSV plus an SQLite or Postgres option). 4. Offer a simple command-line trigger as well as a callable function so I can integrate it into larger workflows later. 5. Log activity and errors clearly. Tech stack Python 3.x with common libraries such as Requests, BeautifulSoup or Scrapy, Pandas and an ORM (SQLAlchemy is fine). If Selenium or Playwright is unavoidable for dynamic pages, please factor that in. Acceptance criteria • Full source code with virtual-env requirements file. • Sample run that fetches at least 30 real company records, shows enrichment working and saves the combined dataset. • README explaining setup, usage an...

...substitutions, shots on goal, shots off target, etc. with times will help • normalise club names so they are consistent across all leagues, and • write everything into a single, tidy CSV file that can be appended with new match days at the push of a button or a scheduled task. I plan to run the scraper on my own machine, so please code in a language with minimal setup friction—Python with requests/BeautifulSoup or a headless browser such as Selenium/Playwright is ideal, but I am open to alternatives if they are well-documented. Acceptance is straightforward: I should be able to clone or unzip your project, install any listed dependencies, point to a configuration file (or run a default), and receive clean CSV output covering at least the current and previous s...

I have a curated list of URLs that I need parsed for their readable text only—no images, no embedded links, no HTML clutter. Once the crawl is finished, I want the raw text returned as straightforward .txt files, one file per source page. You are free to code in Python, Bash, Node, or any stack you prefer; common libraries such as BeautifulSoup, Scrapy, Selenium, or Playwright are fine so long as the final output meets the spec. Please respect , set reasonable delays between requests, and keep the natural order of the text exactly as it appears on the page. Deliverables • An executable script (with a brief README) so I can rerun the scrape in the future. • A zipped folder containing the plain-text results, clearly named after each URL. Let me know your estimat...

Regular comprehensive snapshot. There are 3,000 products. 20 columns for each product. Page by page. I’m looking for a repeatable, fully automated workflow. A Python-based stack (Scrapy, BeautifulSoup, Selenium, Playwright, or an equivalent you prefer). Robustness is key: the crawler should cope with pagination, JavaScript-rendered. Clear, well-commented code is part of the deliverable so my team can review and rerun it internally. Each quarterly hand-off must include: • Cleaned CSV or JSON containing the structured product records • The raw HTML or a compressed WARC snapshot for auditing • The executable script(s) plus a brief change log highlighting any site-structure updates you handled Please outline your proposed tool chain, an example of a large sc...

...The scraper should capture: • Email addresses • Phone numbers • Mailing addresses • LinkedIn profile link • Location (city / state / country) • First and last name • Occupation / job title • Company name • Company website A well-structured CSV or Excel file is the preferred output, with each field in its own column. I am comfortable with your choice of tech—Python with BeautifulSoup, Scrapy, or Selenium are all fine—as long as the script runs reliably and respects and rate limits where required. Accuracy is more important than speed; every lead must be validated for correct formatting before delivery. Acceptance criteria 1. Script files and brief setup instructions are supplied. 2. Sample run on ...

...Short description • Current stock option shown to shoppers (Delivery, Shipping, Pickup, etc.) The CSV has to be clean enough for immediate import into my market-analysis pipeline, so please normalize currency formats, trim whitespace and avoid duplicates. If either site relies on JavaScript for rendering, feel free to lean on Selenium or Playwright; otherwise a straightforward Python Scrapy/BeautifulSoup approach is fine. Please build the spider(s), run a full crawl, and hand over: 1. The finished CSV. 2. The runnable script or notebook with brief setup notes so I can refresh the data later. Accuracy and completeness are more important than speed. Let me know your preferred approach and an estimated turnaround once you’ve had a quick look at both URLs (I&r...

...continuously without being blocked, parse every new listing, and filter it against a configurable set of electronics keywords. • Extract and store the Price and Condition fields so I can track changes and avoid duplicates. • Push an instant notification (email, SMS, or Slack—whichever you prefer to wire up) each time a fresh match is found. I’m comfortable with a Python 3 stack—think Requests/BeautifulSoup or Scrapy, perhaps headless Selenium for dynamic pages—so long as the code is clean, well-commented, and easy for me to extend. A simple settings file or ENV variables for keywords, polling interval, and notification credentials will be perfect. Deliverables will be the complete source, a quick README, and brief hand-off call showing ...

...Key Responsibilities & Technical Stack You will be expected to automate the following "Trust Signal" engines using Python: • Geotagging Engine: Use piexif/Pillow to inject precise Lat/Long metadata into provided job photos. • GBP Activity Bot: Use google-api-python-client to schedule 2-3 weekly posts with AI-generated, location-specific captions. • Citation Gap Scraper: Build a scraper using BeautifulSoup/Selenium to identify and replicate top competitor directory listings (Yelp, Bing, etc.). • GHL Integration: Connect verified profiles to High-Level (GHL) and set up Webhook Alerts via Telegram/SMS for leads not replied to within 5 minutes. • Hyper-Local Injection: Scrape nearby landmarks (stadiums, parks, etc.) to inject into the "Serv...

...be responsible for: - Analyzing government legal databases and regulatory websites - Building web scraping systems and crawlers - Automatically downloading legal documents and PDF files - Extracting metadata and source URLs - Organizing collected data into structured datasets - Creating an automated data collection pipeline TECHNICAL SKILLS (PREFERRED) - Python - Web Scraping - Selenium - BeautifulSoup - Scrapy - API integration - Data extraction automation - Data pipeline development DELIVERABLES The final deliverables should include: 1. Web scraping scripts or crawler system 2. Automated legal data collection pipeline 3. Downloaded legal document datasets (PDF files and documents) 4. Structured dataset including metadata and source URLs 5. Organized storage structure for ...

...editing, and final posting with lead automation—must run without manual intervention. A multi-agent architecture is ideal, so feel free to leverage LangChain, CrewAI, AutoGPT, or any comparable framework that lets independent agents pass tasks between one another. Think of one agent focused on Google Keyword Planner or similar APIs, another handling SERP scraping with Python, Selenium, Scrapy or BeautifulSoup, a third using OpenAI or Stable Diffusion for media re-editing, and a final agent pushing the content live through my CMS and hooking into the CRM or email platform for lead collection. Deliverables • A reproducible, documented workflow (scripts, agent prompts, and environment files) • An installer or Docker setup that lets me spin the system up on my ow...

...(e.g. “Plastic processing”) • Full address • Email • Phone number • Website • Number of employees • Year of foundation I will launch these requests on an ad-hoc basis, sometimes narrowing the crawl by geography, line of business or employee count, so the script or workflow should let me set those filters easily before each run. I’m happy with any stack you prefer—Python with BeautifulSoup/Scrapy, Playwright, Selenium, or a headless browser—so long as the final output lands in a well-structured .xlsx file with no missing fields, duplicate rows or formatting issues. Please let me know: • Your proposed approach to bypass pagination and collect the hidden email/phone fields shown on the profile pages....

...Berkshire and London UK. We will pay per 2k list of the industries we will send upon acceptance. Email addresses must not be role based or trip any spam traps. I need a one-time extraction of verified email addresses from reputable online business directories. No other data fields are required—just the clean list of emails. Please choose whatever approach you prefer—Python with Scrapy/BeautifulSoup, browser automation with Selenium, or a similar tool chain—as long as the result is accurate and the scraping respects each site’s terms of service and rate limits. Deliverable • A CSV or XLSX file containing every unique email address you capture, de-duplicated and ready for import. Acceptance criteria • All emails must come exclusivel...

**Project Title** Build SaaS dashboard for legal-tech platform (Python FastAPI + React) **Project Overview** I am building a legal-tech platform called **Virtual Clerk** that automatically tracks court cases and alerts lawyers when hearing dates change. The backend scraping engine already exists. It uses: * Python * BeautifulSoup / Requests * Background workers * Modular court scrapers The system currently scrapes multiple courts and generates alerts and daily digests. What I need now is to turn this into a **usable web SaaS product for lawyers**. --- **Tech Stack** Backend: * Python * FastAPI Database: * PostgreSQL Workers / Queue: * Redis / Celery (or similar) Frontend: * React or Deployment: * Docker * VPS (DigitalOcean / AWS) --- **Required Features** 1. **U...

...export results to CSV. My ideal flow looks like this: enter or schedule the URLs, run or auto-run the scraper, watch progress logs, and then immediately view fresh stats inside the dashboard—no command-line work once everything is deployed. If any source changes its HTML, the scraper should fail gracefully and flag the issue in the UI so I can react quickly. Tech stack is flexible; Python with BeautifulSoup / Scrapy on the back end and a simple Flask or Node/Express interface would be perfect, but I’m open to alternatives if they shorten development time or improve stability. Clean, well-commented code and clear setup docs are essential because I’ll be hosting the solution on my own VPS. Acceptance criteria • A working scraper module for each of the fo...

...authenticated sessions without manual intervention. Core expectations • Extract and store: product titles/descriptions, all associated images, SKU codes, and current prices. • Export: structured CSV or JSON for data, separate folder (or S3 bucket) for images, with clear file naming that links each image back to its SKU. • Tech stack: Python with libraries such as Scrapy, Playwright/Selenium, BeautifulSoup, or a comparable approach—whatever you can prove is most efficient and resilient. Basic computer-vision or OCR hooks are welcome if they improve image handling. • Reliability: graceful error handling, automatic retries, and a simple log file so I can trace any failed requests. • Modularity: the list of target domains should live in a c...

...but expect the usual high-traffic areas (Electronics, Real Estate, Automobiles) to be included. Data points • Vendor name • All available contact details (phone, email, WhatsApp, or any other channel the site exposes) Delivery You’ll give me: 1. The Excel file, one sheet per category, neatly labeled and deduplicated. 2. The script or notebook you used (Python with requests / BeautifulSoup, Scrapy, or a comparable tool is fine) so I can rerun the scrape later. Quality checklist (acceptance criteria) • Every row contains at least a vendor name plus one working contact detail. • No obvious duplicates. • File opens in current Excel without conversion warnings. If captcha handling, rate limiting, or hidden APIs are involved, f...

...started throwing runtime errors before any data is returned. The pages themselves load fine in a browser, so the problem is clearly within my code or its dependencies. Here’s what you can expect from me: a zipped folder containing the current Python script, the list of target URLs, and a copy of the last error stack trace. I’ll also let you know which Python version and libraries (requests, BeautifulSoup, etc.) are in use so you can replicate the issue quickly. What I need from you: • Diagnose the exact cause of the errors • Deliver a clean, well-commented fix that reliably fetches all required text from each page • Briefly outline any library or environment changes I must make to keep the scraper stable in the future Once the script runs end-t...

...source is still open—fresh survey responses, publicly available web data, or even existing transactional records are all on the table. What matters is that the data be captured ethically, documented thoroughly, and delivered in a format ready for statistical analysis. Here’s what I need from you: • A brief proposal outlining the collection strategy, recommended tools (e.g., Qualtrics, Python/BeautifulSoup, Selenium, SQL, Excel), and estimated timeline • The final dataset in CSV or equivalent, fully de-duplicated and consistently formatted • A concise data dictionary describing each variable • A short methodology note (1-2 pages) explaining how the data was obtained, any limitations, and relevant citations or permissions Data integrity and ...

I need every piece of publicly available data pulled from three separate websites and packaged so I can work with it offline. The moment the contract is awarded I’ll hand you the URLs; from there I expect you to spin up an automated solution—Python with Scrapy, BeautifulSoup, Selenium, or a comparable stack—that captures all records, follows pagination, and handles any lazy-loaded content. Time is tight: the full job must be wrapped up within 3 calendar days. My total budget is fixed at US $300, so please be sure your approach fits comfortably inside that limit. Deliverables • A clean, well-structured file for each site (CSV or Excel, whichever you prefer) containing every scraped field. • The runnable scripts or notebooks you used, clearly commente...

I need a reliable way to collect product details from several e-commerce sites. I am open to either a fully automated scraper (Python, Selenium, BeautifulSoup, Playwright, etc.) or a well-structured manual process if that proves more stable for the target storefronts. Scope • Target pages: standard product listings and their individual detail pages on the chosen e-commerce sites. • Data fields: everything typically shown on a product page—title, SKU, description, images (URLs are fine), specifications, and the price shown at the moment of capture. • Output: please compile the final dataset in HTML or PDF, whichever reliably preserves the product information and any inline images. If your workflow first generates CSV/JSON/Excel and then converts, that is f...

I need the complete catalogue from another website duplicated in my Magento store. The task covers scraping every product name and full description, collecting all associated images, recording each SKU, and capturing the current stock level, then loading the ...correct path references. • A short hand-over note outlining the scraping steps so I can reproduce updates later. Acceptance criteria: at least 10 randomly chosen items will be spot-checked; all fields must match the source site, images must load, and no broken HTML may appear in the front end. Let me know your estimated timeline and the tools you intend to use—whether that’s Python with BeautifulSoup, Scrapy, Magento’s native import, or another reliable option—and share any similar catalogue m...

I need fresh, accurate leads pulled from business directories, regular websites, and the major social-media channels. For every record I expect four separate Excel columns—contact name, company name, email address, phone number, website/social media link, and physical address—so the sheet is ready for immediate upload into my CRM. You may use any stack you prefer (Python, Scrapy, Selenium, BeautifulSoup, Apify, browser automation, etc.); I just need the final hand-off in .xlsx. I do want the workflow documented briefly so future batches follow the same logic. Deliverables for each batch • Clean Excel file with no duplicates, one row per company • Columns: Contact Name I Company Name | Social Media link / website | Email Address | Phone Number | Address ...

...once we agree). The job is straightforward: pull three data points for every product I specify—current price, stated delivery time, and offer type (Retail, Seller, or Seller but shipped by Retail). The site employs standard anti-bot measures, so rotating proxies, respectful delays, or headless browsing may be required to keep requests under the radar. Please build the script with Python—BeautifulSoup, Scrapy, Playwright, or any reliable stack is fine—as long as it can be rerun on my side without extra fees or licences. Deliverables • A single Excel workbook.  – One sheet per category or URL I provide  – Columns: Product identifier (ASIN/SKU/URL), Price, Delivery Time, Offer Type • The well-commented source code or note...

My small Python script scrapes a single website with BeautifulSoup and has reliably pulled the data I need for months. Yesterday the site pushed an update and the extraction part suddenly broke—no errors, just empty results. I have not changed anything on my end, so the issue is almost certainly new HTML structure, class names, or an extra layer of JavaScript that BeautifulSoup is now missing. Here is what I need: • Review the existing code, identify exactly why the selectors or parsing logic no longer match the updated markup. • Patch or refactor the script so it again captures every data field that used to be returned. • Keep the rest of the workflow (file writes, scheduling, etc.) untouched; only the scraping section needs attention. • Pro...

...number • Business type • Full address • Star rating • Number of reviews Please return everything in a single, well-formatted Excel workbook so my sales team can filter and sort the data for outreach campaigns. The file should arrive free of duplicates and obvious errors, with each column clearly labelled and phone numbers in a consistent format. However you prefer to work—Python with BeautifulSoup or Selenium, Google Maps scraping libraries, or another reliable method—speed and accuracy are what matter most. If Google imposes any access limits along the way, you’ll need to handle proxies, delays, or captcha bypass so the sheet is complete. Deliverables are accepted once I can open the Excel file, scan a random sample of rows in G...

...types and basic styling (date columns as dates, numbers as numbers, text wrapped where needed). Also send me the process and files so that I can test. Key points • 100 % coverage of all result pages on the site, not just a sample. • Output must be an Excel file with the cells pre-formatted for easy sorting and filtering. • Any scraping code or automation tool you build (Python + Selenium/BeautifulSoup, VBA, etc.) should be included so I can rerun the extraction when fresh results are posted. • If the site uses captchas, pagination or dynamic loading, handle those gracefully. • Keep the process compliant with the website’s terms of use. Deliverables 1. The completed, clean Excel workbook. 2. The runnable script or detailed steps you u...

I have a set of publicly available web pages and I need all visible, valid email addresses pulled from them quickly and accurately. The task is pure web-page scraping—no social media, no API work—focused solely on contact information, specifically emails. You are free to use Python with BeautifulSoup, Scrapy, Selenium, or any other language or framework you prefer, as long as the final result meets these simple acceptance criteria: • Every email captured comes from the target pages I supply. • Duplicates, malformed strings, and “noreply” style addresses are filtered out. • Results arrive in a clean CSV (column: Email) or Google Sheet, ready for me to import. Please include a brief note on your scraping approach and estimated turnaround t...

I need support working with the comments thread located at https://www.freelancer.com/groups/general-announcements/feed/3403...freelancer.com/groups/general-announcements/feed/340311/comments. Your task is to access that feed and deliver the full set of comments in a usable format so I can review them offline. Please ensure the output preserves each comment’s text, author name, and timestamp exactly as they appear on the page. Let me know: • the method or tool you would use to access the data (e.g., Python with BeautifulSoup, browser automation, API, etc.) • any limitations I should be aware of (rate-limits, login requirements, pagination) • how long you estimate the job will take A clean CSV or JSON file is perfect for delivery, but I’m open to an...

...well-structured data. Deliverables • A single CSV file containing, for each product information as much as possible min required: SKU, category, product name, full description, current price, primary image URL and any additional image URLs. • A folder (or compressed archive) of the referenced images, organised by SKU or another logical structure. • The scraping script (Python with Scrapy/BeautifulSoup/Selenium, or a comparable stack) plus a brief “how-to-run” note so I can reproduce the extraction later. Acceptance criteria • Every product that can be reached through site navigation, search filters or pagination is present in the CSV. • Text fields are free of HTML artefacts; prices are numeric; images open without error. • ...

...You will receive: Images from Singapore card vendors showing buyback prices Use AI tools to: Identify the card from the image Search eBay: For recent SOLD listings of the same PSA card Extract: Actual accepted Best Offer prices Calculate: Total landed cost in SGD Compare: Vendor Buyback Price vs Total Cost Flag: Arbitrage opportunity if profit ≥ 15% You’re free to use Python (BeautifulSoup, Scrapy, Selenium, or the official eBay API) or any stack you prefer, so long as the process runs unattended on my VPS and avoids eBay’s anti-bot triggers. Deliverables: 1. Well-documented source code with setup instructions 2. Automated scheduler (cron, Windows Task, or similar) set to run daily 3. An Excel file generated on each run, overwriting or append...

...include historical data scraping, AI-driven prediction models, backtesting capabilities, and supervised bet placement. Below are the key requirements: Data Collection & Storage: - Ethical scraping of historical data from official Spanish lottery websites (e.g., ). - Database: PostgreSQL or MongoDB. - Automatic updates daily at 00:02 after each draw. - Web scraping tools like BeautifulSoup or Scrapy, mimicking human behavior. AI Prediction Models: - Multiple AI models working collaboratively: Random Forest, Neural Networks (RNN/LSTM), Genetic/Evolutionary Algorithms, Bayesian Networks, and optionally Neuro-Symbolic AI. - Hot and cold number analysis. - Wheeling system for partial prize optimization. - Monte Carlo simulations for expected value estimation on high jackpots. B...

...data points, normalising any odd formats (e.g., multi-line addresses, embedded phone numbers). 3. Validate and store each jurisdiction’s data in its own JSON file, following the supplied naming convention (e.g., “”). 4. Run JSON-lint or an equivalent validator before delivery so that every file loads cleanly into the pSEO import tool. Preferred stack Python with BeautifulSoup, Scrapy, or Selenium is ideal, but you’re free to use any tooling that reliably outputs clean JSON. An existing script library can be shared if that accelerates your process. Deliverables • 52 individual, schema-compliant JSON files (one per jurisdiction). • A brief changelog or scraping log noting the final URL sources for each file and any anomalies you encount...

...need every product on a single e-commerce site captured quickly and cleanly. For each item please pull the product name, SKU, price, full description, and all image URLs (or download the images into a neatly organised folder if that is easier for you). The finished dataset must be delivered as a CSV so I can drop it straight into my own shopify website. You are free to use Python, Scrapy, BeautifulSoup, Selenium, or any similar tooling—whatever lets you respect the site’s structure and complete the job without loss of detail. Pagination, lazy-loaded images, and variant handling should all be accounted for so the output stays complete and consistent. Acceptance criteria • CSV contains one row per product with columns: Name, Price, Description, Image_URLs &bu...

...time-sensitive legal marketing, accuracy matters more than volume: • Only matters filed under foreclosure in the State Supreme Court should appear. • Data must hit the Sheet no later than the following morning’s run (24-hour maximum latency). • Duplicate cases should not be re-imported; add a “last checked” timestamp instead. Please include brief notes on the stack you propose (Python + BeautifulSoup, Node + Puppeteer, etc.) and any third-party services the solution will rely on. When you deliver, I’ll need: 1. Source code and environment/setup instructions. 2. A live demonstration showing fresh docket entries arriving in my Google Sheet. 3. Documentation explaining how I can adjust the schedule, add additional courts later, o...

I have 285 public-facing project pages and need the same 26 data points lifted from each one. You will receive a spreadsheet with every URL and a clear field dictionary so you can move straight to extraction with Python, BeautifulSoup, Scrapy, or whichever tool chain you prefer. The finished dataset must come back as a single Excel/CSV file. Before you hand it over, give it a quick polish: apply basic, uniform formatting, drop any duplicates, and make sure each column lines up with the field names I supply. No heavy ETL work—just that first-pass cleanup so I can analyse the file immediately. Deliverables • CSV (or XLSX) containing 13 columns × ~285 rows, fully populated where data exists • Basic formatting and de-duplication applied • Short not...

...scores. - Conflict Flags: If a scraper finds data that contradicts the current DB (like a significant price jump), it must flag it for manual approval. 4. Deployment & Workflow A dedicated MySQL Service User with restricted permissions will be provided for a dev/test db Technical Requirements - Language/DB: Expert PHP & MySQL (Relational database design is key). - Web Scraping: Experience with BeautifulSoup, Scrapy, or Puppeteer (handling dynamic content/JS-heavy sites). - API Design: Experience building RESTful API endpoints with clean JSON structures. - Security: Proven experience in data sanitization and secure DB (JSON). To ensure you have actually read this brief and aren't using an automated bot to bid, please include the following in your proposal: Start yo...

I need a clean scrape of every product currently listed under The goal is simple: capture each item’s full product details, its current price, and the complete description, then hand everything back to me as a single, well-structured CSV file. Feel free to use whichever stack you prefer—Python with BeautifulSoup, Scrapy, or even a lightweight Selenium pass—as long as the final CSV is accurate and ready to load. Make sure the script copes with pagination and any lazy-loaded content so nothing is missed. Deliverable: • One CSV containing a row per product with columns for product details, pricing information, and the full product description. If you have questions about field naming or edge-cases you spot while crawling, let me know early so we

I need a simple, reliable script that pulls the required text from a single website each day and drops the fresh data into a spreadsheet I can open in Excel or Google Sheets. The site’s structure is consistent, so once the selectors are dialed in, the process should run hands-free. Here’s what success looks like: • A working script (Python with BeautifulSoup, Scrapy, or Selenium—your call) that captures only the text I specify. • Automated scheduling so the scrape runs daily without manual intervention—cron, Windows Task Scheduler, or a cloud function is fine. • Output appended to, or neatly placed in, a spreadsheet with clear column mapping. • Brief setup notes so I can tweak the target URL or change the destination sheet later...

...login‑protected content) Data must be structured so that filters work correctly Developer should propose the best technical approach 5. Technical Requirements Preferred Tech Stack (open to suggestions) Frontend: React, Vue, or similar Backend: Node.js, Python (Django/Flask/FastAPI), or PHP (Laravel) Database: MySQL, PostgreSQL, or MongoDB Hosting: AWS, Hetzner, or similar Scraping: Python (BeautifulSoup, Scrapy, Selenium) AI Integration: OpenAI API or similar Performance Requirements Fast loading times Mobile‑first responsive design SEO‑optimized Secure user authentication 6. Deliverables Fully functional website Admin dashboard User dashboard Scraping/AI import tool Documentation (installation, maintenance, admin usage) Basic UI/UX design Deployment to produ...