Web Scraping Jobs

Viết chương trình test một website bán hàng bằng wedrive selenium với python test một vài chức năng như đăng nhập, thêm vào giỏ hàng, xóa sửa sản phẩm . Mỗi chức năng có 3-4 test case có thể export kết quả pass- fail mỗi test case ra excel.

i need a web scraper for get the info of , i need some spepecific info (payments transactions) and put this info in a table in mysql. please fell free to ask

Project Overview: I am in need of a skilled web scraper to collect and analyze real estate rental data from various listings. The project involves extracting detailed information such as rental prices, property features, and lease terms from popular online platforms. This data will be used for academic research purposes to understand market trends and pricing strategies. Project Responsibilities: Develop scripts to efficiently scrape data from specified online real estate platforms. Manage data extraction to include multiple pages and ensure comprehensive coverage. Use respectful scraping practices to adhere to platform terms of service and avoid blocking. Verify and clean data to ensure accuracy and usability in analysis. Compile and analyze data, providing a detailed report on findings...

I need a tool that can scrape text content and tables from LinkedIn quickly and efficiently into an Excel format. The tool needs to be able to: - Extract text content and tables from LinkedIn - Export the scraped information into Excel format - Operate quickly and efficiently to meet a tight deadline The ideal candidate should have: - Experience in web scraping, particularly with LinkedIn - Proficiency in Excel - Ability to develop a tool that can operate quickly and effectively Given the urgency of this project, I need someone who can start ASAP and deliver the tool in a timely manner. Experience with rapid tool development would be a huge plus.

I'm seeking a freelancer who can provide a list of 2000 leads of 'small gyms' in the UK. The list should include the following information: I want to Purchase this data if you have ? - Company name - Website - Decision maker name - Email (personal if available, otherwise company email) - Address - Instagram handle I have a specific criterion for the gym size, which should be verified before including it in the list. Ideal skills for this job: - Proficient in lead generation - Familiarity with the UK gym market - Attention to detail - Good communication skills Please provide a proposal with your experience in this field, and how you plan to source and verify the leads.

I need an AI agent script that is browser based without a local computer install that will do two things. 1. Research current job postings on various job platforms based on my keywords and gather any emails as well and 2. Gather email for those related postings that did not have the emails in the posting by researching the agents. So these are either two agents or two tasks. I need the output in a csv file with the name of business, job posting link, job category, name of contact if exists email address, phone number if exists. I only want the line saved if there is an email address. Again, I want something I can run from a browser without having to install python or anything in my computer. Please give a price for completing this project. If necessary I can provide access to a server ...

I'm looking for someone with strong data gathering skills who can create a comprehensive Excel spreadsheet. The spreadsheet must contain a list of all Australian suburbs along with their corresponding Local Government Areas (LGA). The essential points to be kept in mind are: • The list should be sorted by council areas for easy navigation. • Only the name of the suburbs and their corresponding council areas are required. No additional components such as population or region data are necessary. This project might require advanced web searching capabilities and attention to detail to ensure accuracy of the compiled list. Experience in data extraction is highly desirable.

I have a Python script that I would like to turn into an executable file for Windows. This script needs to be reviewed and compiled so it can run efficiently. Additionally, the current tables in the script need to be fixed. The project also involves creating a GUI with multiple buttons for different actions. The ideal freelancer for this project should have: - Experience in Python scripting and GUI creation - Knowledge of compiling scripts into executable files for Windows - Strong attention to detail to identify and fix issues in the existing tables Please note that the GUI should be user-friendly and intuitive. Also, the compiled executable file should be able to run on a computer without the need for Python or any additional dependencies. Before you bid: Answer this, do I need a...

I need a skilled developer who can create a scraper that can fetch audio IDs from Roblox. Key Requirements: - Scraping: The tool should be capable of efficiently extracting audio IDs from Roblox. with proxies Please only apply for this project if you have previous experience with web scraping tools and are familiar with Roblox's platform. Your solution should be robust, fast, and capable of handling large quantities of data.

I need an experienced web scraping expert who can help me scrape relevant data from a specific website on a daily basis. Key Details: - I'm looking for data in text format including headlines, product descriptions, and any other relevant information available on the site. - There is no requirement for authentication to access the data, so the process should be straightforward. - The extraction needs to happen daily, so you should be able to set up a recurring scraping process. Skills and Experience: - Proficiency in web scraping tools and techniques. - Experience in extracting text data from websites and setting up automated daily scraping routines. - Good understanding of data formats and storage to deliver data in a usable format. I'm looking for a reliable and efficient pr...

se busca especialista en fuentes de tennis, entre ellas las cuotas, volumenes de cuotas, para partidos atp, challenger, wta y dobles. Con ellas se quiere crear un software smart capaz de con su red neuronal interpretar los datos y crear contenido objetivo, realistico

I'm looking for a professional who can extract specific text content from a website and organize it into different categories.

I need a software expert to develop a program that scrapes text content off of multiple websites and then cross-references this data against another site. Key Requirements: - The software should effectively pull out text content from all provided sites. - The text content should be in a plain text format, ready for easy analysis and interpretation, preferably in an excel spreadsheet or comma delimited list. - The cross-referencing component is crucial, as the software will need to compare the data scraped with that of another website. Qualifications: - Background in Data Scraping and Software Development. - Previous experience with cross-referencing data. - Proficiency in handling different data formats. In essence, I'm looking for someone who can create a tool that not only coll...

I need assistance with copying & pasting data from spreadsheets. The dataset is less than 1,000 entries. Ideal skills and experience for this job: - Experience with data entry, especially from spreadsheets - Attention to detail - Proficiency in Excel - Ability to meet deadlines It's a straightforward task. The goal is to ensure the data is accurately copied and pasted.

We want to extract members from one Facebook group which contains about 24.000 members. We don´t know if this is possible or not. We want to create a group and invite all these members to them.

I'm looking for a Python developer to assist me in creating a web scraper that can extract specific text content from a website on a weekly basis. The scraped data should be efficiently saved to a CSV or Excel file for easy review. Capable of being plugged to a distribution app. Key Requirements: - Develop a Python-based web scraper that targets a website to extract text data - The scraper should be designed to run on a weekly schedule - Ensure that the code is concise and easy to understand for potential future modifications - Store the scraped data in a CSV or Excel file format Skills and Experience: - Proficiency in Python programming - Experience with web scraping libraries such as BeautifulSoup or Scrapy - Understanding of scheduling tasks in Python - Familiarity with working ...

I am looking for a professional to scrape LinkedIn profiles for the purpose of lead generation. - The data I need extracted includes Name, Mobile Number, Email ID, and Company. - The intention is to use this information for email marketing. I need the freelancer to scrape more than 5000 profiles for this project. Ideal Skills: - Proficient in LinkedIn data scraping - Experience in lead generation - Strong attention to detail - Excellent communication skills Please let me know if you have handled similar projects in the past. Thank you.

I am in need of a professional data entry specialist able to handle a variety of data types and formats. This includes text, numbers, and images, with the bulk of the work being in Excel format, but also involving Word and PDF files. The task involves inputting a small amount of data, less than 100 entries. Ideal Skills and Experience: - Proven experience in data entry, ideally with a variety of data types - Expertise in Excel, with the ability to organize and manage data effectively - Attention to detail to ensure accurate data entry - Time management skills to complete the task efficiently - Familiarity with Word and PDF formats Your precision and understanding of various data formats will be key in executing this task successfully.

I'm looking for a professional who can scrape specific tables on a government website for insurance claim statistics. Key Requirements: - Web Scraping: You should have prior experience in web scraping and can navigate through the website's structure to extract relevant data. - Data Extraction: The main focus will be on compiling data related to insurance claim statistics. The final deliverable should be a well-organized dataset with accurate claim statistics. Please share your experience in similar projects.

Data entry for horse racing from a public website

I'm seeking a freelancer to develop a custom web scraping script. The goal is to curate a comprehensive database of restoration and IICRC technicians in Australia. Specifically, I need the following information from their websites: - Business name - Phone number - Email address - Location (state, suburb, postcode) Websites without data available to scapers will require manual collection The ideal candidate should be well-versed in web scraping, particularly with experience in extracting data from websites into an organised and structured format. You should also possess strong problem-solving skills to handle any complications that may arise during the scraping process. This is a specialised type of cleaning so the database should be broken down into service categories (example, re...

I'm in need of a web crawler that can extract specific data from a large online ads website. The extracted data should then be neatly exported to a Google Sheet. Key requirements: - The crawler should not be intrusive to the host website. - I want the crawler to crawl current and expired ads based on links present in the site map, as historic data is also of importance to me - You should be able to provide a way for me to run this crawler myself at any time - ideally on a monthly basis. I haven't yet decided on the precise fields to be extracted. I'm looking for someone with the skills to recommend suitable fields that could be beneficial for my project. It's important that the extracted data is organized and easily readable once exported to Google Sheets. Ideal ...

I'm in need of a skilled web scraping expert who can help me compile a database of local businesses. The data I need should include company name, physical address, email, phone numbers and their social media profiles. Key requirements: - Data extraction from multiple websites: I'm looking to collect this information from a variety of sources, not just a single site. This will require the ability to navigate various structures and formats, so experience with diverse web scraping is a must. - Targeting local businesses: The focus of this project is to gather data specifically from local businesses. This implies you should have the know-how to identify and extract data from these specific types of entities. - Data fields: The most crucial data I need includes the company name and ...

I need a freelancer to help me gather phone numbers from clothing stores in County . You'll be provided with the location and shops to focus on. Key Responsibilities: - Utilize street view to identify shops - Collecting phone numbers of all such shops - Organize and input these numbers into an Excel spreadsheet Ideal Skills: - Proficient in using street view and other location tools - Detail-oriented and capable of data entry - Comfortable using WhatsApp for communication This is a straightforward project, but attention to detail is crucial. Feel free to reach out if you have any questions.

I urgently need a Python script created to scrape data from Website 1 and write it to a CSV file. The data I need to extract is specific to TVL daily total. Site: Key Requirements: - Develop a Python script for web scraping - Extract TVL daily total data from - Save the data into a CSV file Ideal Skills: - Proficient in Python programming - Experience with web scraping tools and techniques - Strong understanding of data handling, especially writing to CSV files - Good communication for timely updates on the project's progress.

I am in need of a skilled freelancer who can help me extract all products from an online shop and import them into my Shopify store with all details and options. Key Responsibilities: - Extracting all products from an existing online shop - Importing/copying these products into my Shopify store I expect the freelancer to: - Ensure all product information is correctly ported over like variants, prices, ean/gtin, description, collections, Filters... - Maintain the quality of product listings - Ensure the product images are not lost during the import I'm looking to work with someone who has: - Experience with product extraction and import in shopify - Proficiency in Shopify - Attention to detail Please provide a timeline for completion when bidding. Please check the size of the shop ...

I'm seeking a skilled web developer to create a financial information website with features similar to forexfactory.com. The website will be designed with a modern and minimalist aesthetic. Key features include: - Live forums page: This will allow users to engage in financial discussions, share insights, and connect with other members of the community. - Economic calendar: We need a comprehensive economic calendar that notifies users of upcoming reports, events, and indicators that may impact the financial markets. We will need to find all the sources the main information comes from and scrape them using provided API's from the government sites that they provide usually. - SEC Insider Traders Page: This is a vital component of the website. It should include: - A list of recent...

I'm looking for a freelancer who can gather and organize data in Excel for me. This will involve gathering specific data, creating an Excel spreadsheet and providing a basic summary of the data. Key responsibilities: - Organizing data in an Excel spreadsheet - Creating basic summary Ideal Skills and Experience: - Proficiency in Excel - Data organization - Data analysis - Chart creation in Excel I may have more projects in the future if this one goes well. Please include your relevant experience in your bid.

I'm looking for an exhaustive list of Australian gym owners, with a focus on capturing between 100 to 500 individual records. The data needed includes, but not limited to: - Owner's Email Address - Gym's Name - Gym's Website Ideal candidates for this job are experienced data miners and researchers. Having a good understanding of the Fitness industry would be beneficial. Strong attention to detail is paramount, ensuring accuracy in data collection and entry. Additionally, demonstrating respect for privacy laws and guidelines, including GDPR, is essential. Experience with spreadsheets and CRM systems would be advantageous. Gyms must be privately owned only, non franchise. Offer Personal Training. Boutique Exclude: Category - Fitness Equipment Category - Community He...

I'm looking for a skilled Python developer to help me with a scraping project. I need to extract specific product data from a website's table. Skillset: - Proficiency in Python and Scrapy - Experience in web scraping - Familiarity with handling web popups The website () contains a table with important product information. For each product, I need the following details scrapped: Certificate Type Certificate Number Product Type Organization Name Country Issue Date Expiry Date in addition to Product Details Brand Model Description Barcode The data should be saved in a CSV file. There are no specific rules or requirements to be followed during the scraping process.

I'm seeking a freelancer to collate verified contact details of travel agencies from the UK, USA, Europe, and Latin America. Key project details: - Data to be collected: Only contact information (phone, email, address,webiste link )of decision makers is needed from each agency. - Data segmentation: The collected data should be segmented by country. The purpose of this data collection project is to generate leads for my business. Ideal Candidate: - Experience in web research and data collection. - Familiarity with the travel industry would be a plus. - Attention to detail to ensure accurate data gathering. - Ability to organize data by country for efficient lead generation. Please bid if you are confident in your ability to deliver accurate, segmented data in a timely manner.

I'm looking for a skilled developer who can create a tool that utilizes Google Chrome to perform searches and click on search results multiple times. Key Project Requirements: - The tool should be built using Python, Java or Visual Basic - The primary goal of the tool is to perform automated web browser searches and click on various results - The tool should utilize Google Chrome as the web browser To give you a better idea, the tool should: - Conduct multiple web searches on Google - Click on a configurable number of search results from the returned search page Ideal Skills and Experience: - Proficient in Python, Java or Visual Basic - Experience in browser automation and web scraping - Familiarity with Google Chrome's automation capabilities If you have experience with simi...

I'm in need of a skilled Python developer to work on a web scraping project. Key Requirements: - I'm primarily focusing on Web scraping as the main functionality for the project. - You should be well-versed in Python and have a proven track record in data analysis. - Knowledge of web scraping is essential to ensure efficient and reliable data extraction.

I need a Python program that can tap into Yahoo's fantasy football datasets using their API and extract various essential pieces of historical league-specific information. The main requirements of my project include: - Extracting information like player statistics, team standings, draft results, transactions (trades and adds/drops), weekly schedules (head-to-head matchups by week), weekly lineups, scoring settings, and league settings The Yahoo API Endpoints you'll need to use as inputs to derive the above data extracts for a particular league are: - the associated League ID (each league created by Yahoo is given it's own unique ID that a league member can provide) - the associated Game Key (there is a unique Game Key provided by Yahoo by fantasy sport and by year) - I hav...

I'm seeking an experienced data extraction specialist to scrape both HTML and text files for specific data. Particulars to look for will involve the text content within these files that follows a mixed format structure so would require vast knowledge and understanding of both table format data and paragraph-style data. Key Skills and Experience Required: - Strong abilities in web scraping - Adept with HTML, text parsing - Knowledge of data formats and how to transform data - Proficient in CSV file generation. We need a comprehensive extraction that maintains the integrity and accuracy of the data. As these files do come in multiple formats, versatility and attention to detail are paramount on this project.

I'm in need of a skilled individual who is proficient in blockchain and wallet analysis, specifically on the Arbitrum blockchain. The project involves analyzing transaction patterns and wallet balances and activities. Key Requirements: - Proficiency in blockchain analysis, particularly on the Arbitrum blockchain - Ability to identify patterns and trends in transactions - Proficient in analyzing wallet balances and activities Deliverables: - A comprehensive report that includes methodology, analysis, and conclusion - The report should be presented in a combination of written format and visual presentation (charts and graphs) Please note that I will provide you with access to the necessary pages and data on Arbiscan. Your task will be to fetch data, analyze it, and present it in a d...

I'm looking for a data scraping specialist proficient in leveraging social media platforms, business directories and website scraping. The goal is to create an Excel sheet with approximately 500 entries for market research purposes. Skills & Requirements: - Proficient in data scraping from multiple sources - Capable of filtering and sorting data - Able to extract and compile the following data fields: zip codes, locations, contact information, business name and industry. The successful candidate should demonstrate experience in similar projects, showcasing their ability to find and compile information efficiently and accurately for market research purposes.

I need a comprehensive web scraping task done on Yellowpages for business broker. The goal is to extract the following data about businesses: - Business name - Address - Phone number - Email - Website - Contact Person I'm looking for a professional who is well-versed in web scraping and can deliver accurate and complete data. Skills required: - Proficiency in web scraping techniques - Experience with scraping - Attention to detail to ensure all relevant data is captured - Ability to deliver in a timely manner Please note that the number of pages to be scraped is not defined, meaning the task might involve a large number of results. The scraper should be able to handle this efficiently.

I'm looking for a freelancer to help me extract financial data and regulatory filings from a tax website. This involves scrapping website using the provided credentials by the client, i am looking for getting the python code as i can run the code myself in the future or integrate it to another system. Key Requirements: - I need approximately 300 data points extracted. - The output for these data points should be organized into a PDF or Word. This project is about creating an automated system to generate instant reports about a company. Only difficulty is the website has drops downs to select the period involved and in those 300 data points actually many come from the same source. Ideal Skills and Experience: - Experience in web scraping (Python) - Proficient in creating PDF docume...

Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database

I'm looking for an experienced Python coder to tackle two key aspects of my project - data analysis and automation. Here's a breakdown of the requirements: - **Data Analysis**: The primary task involves analyzing datasets in CSV format. The selected candidate should be adept with NumPy, able to make sense of the data and derive meaningful insights. - **Automation**: The second crucial aspect is automation. I'm looking to automate certain processes in my project that involve database queries. Proficiency in Django will be necessary here. Ideal candidates for this project would have: - **Strong Python Skills**: You should be well-versed with working on data analysis and automation tasks using Python. - **Experience with NumPy & Django**: Proficiency in these frameworks...

I am seeking an experienced Python developer with a proven track record in working with the Scrapy framework. The primary goal of the project is to handle data extraction from websites, dealing particularly with nested or hierarchical data. Key Responsibilities: - Collaborating with the team to define the scope of the project and identify the data requirements. - Design and implement data extraction scripts using the Scrapy framework. - Handle complex, nested or hierarchical data structures. - Ensure the accuracy and efficiency of the data extraction process. Ideal Skills and Experience: - Proven experience in Python development. - Expertise in working with the Scrapy framework. - Strong understanding of web technologies and data structures. - Excellent problem-solving and analytical ski...

I'm looking for a skilled TouchDesigner and Python developer to create a script for automatically sending MOV videos as email attachments. Key Requirements: - Design and develop a Python script for TouchDesigner that can attach MOV videos to outgoing emails. - Ensure the script is robust, reliable and can handle various video sizes. - Email content doesn't need to be customized for each recipient, so a standard email template is sufficient. - Mail input from user side Your role will involve: - Understanding the project's requirements and the specific constraints of sending MOV videos via email. - Creating the necessary Python script within the TouchDesigner environment. - Testing and refining the script to ensure it performs reliably across different email platforms. - Cre...

I am in need of a Python expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepared to provide examples of your previous work in web scrap...

I'm looking for an experienced hacker who specializes in database scraping to assist with lead generation. My main aim is to get detailed contacts to grow my business. - Specific Tasks: - Database scraping - Extract contact details - Contact Information: - Email addresses - Phone numbers Ideal candidates should have previous experience in the field. Proficiency in data mining and scraping is a must, along with an understanding of lead generation strategies. Strong grips and successful track records on obtaining accurate contact details are key to perform this job efficiently.

I'm in need of a professional who can help with data entry into spreadsheets. This is a straightforward task based on digital files I'll provide. Key Responsibilities: - Entering data accurately and efficiently into spreadsheets - Ensuring the correct format and organization of the data Ideal Skills and Experience: - Proficiency in data entry - Experience with spreadsheets - Strong attention to detail

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real-time. Prior experience with similar projects wil...

I have a Python file that was running fine last night for data analysis purposes. However, after trying to upload the '' file to GitHub, I encountered an error due to the file size being too large for GitHub. I need to get the Python file running again, but with the '' file stored on an external service to work around the file size limitations of GitHub. Key requirements include: - Identifying and resolving the issue causing the Python file not to run - Storing the '' file on an external service and adjusting the Python code to access it from there Ideal Skills and Experience: - Proficiency in Python - Experience with data analysis and handling large datasets - Familiarity with version control, specifically using GitHub - Ability to troubleshoot and resolve ...

Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promotions or deals. • Move s...

I'm searching for an expert who can assist me in generating high-quality leads and databases. The candidate should be an expert in scrapping and generating leads, as per the requirement. We are open to buying the lead list and paying for the consultation. Please apply only if you know how to generate and scrape leads in bulk and are an expert or have rich experience in it. We are looking for experts only. Budget is not a constraint for the right candidate. To ensure you have read the description, start your application with the word "Blue" to be considered. Thank you.