Data scraper website databasecông việc
- Dã có template, model, css, form sẵn. Chỉ cần giúp mình upfile lên được database
Mình có application connect với db hosting server Mà để chuỗi connect trong app thì bị lộ Nên 1 bạn giúp
Mình muốn xử lý trang HTML chuyển vào database(kiểu xử lý chuỗi or mảng rồi lưu vào database real time) bạn nào hứng thú liên hệ mình sẽ trao đổi cụ thể.
Mình muốn load database của 1 website về dạng bảng excel để tiện tra cứu, trang đó có đuôi dạng như này Pages/admin/report/
Team mình ở Huế cần tuyển: 01 Database Engineer * Yêu cầu: - Phân tích và thiết kế cơ sở dữ liệu. - Có kiến thức với các hệ thống: Oracle, SQL Server, chủ yếu làm việc với MySQL. - Có kinh nghiệm viết procedures, functions, views. - Biết cách tối ưu SQL & dùng indexes hay partitioning. - Có kinh nghiệm cài đặt, quản lý, nâng cấp, sao lưu hệ thống cơ sở dữ liệu lớn. - Có kinh nghiệm làm việc với Linux và shell scripting. Công việc lâu dài, tính bằng năm, có thể full-time hoặc part-time Rate mong muốn: $5-$7/h
Bên mình có website của khách hàng về trang tin điện tử. Hiện tại dữ liệu website đang rất lớn gần 50k tin. Mình đã thử tăng cấu hình vps, sử dụng cdn nhưng tốc độ tải trang vẫn rất chậm tới 15 giây. Website dùng VPS như sau: CentOS 6.8 + nginx + mysql (mariadb), 1-2 cores CPU, 2-4 GB RAM, ổ cứng SSD Mã nguồn website: Wordpress + tool quét tin WP Content Crawler Qua tìm kiếm trên google mình thấy nhiều nơi khuyên website dữ liệu lớn cần tách database làm 2 phần: đọc và ghi riêng Vậy, theo mình công việc sẽ là tách database thành 2 phần riêng: phần đọc và gh...
Hi Khánh, mình thấy tên bạn trong project này (https://www.freelancer.com/projects/php/telegram-channel-web-scraper/) Mình muốn nhờ Khánh làm giúp mình một con bot như vậy được không? Mục đích không được trong sáng cho lắm :) Đức
#1: #2:
Phân thích thiết kế website theo ý tưởng đề ra Hỗ trợ viết tài liệu cho dự án
...need a proficient database developer (PHP Developer) to create a specialized system for my dental equipment repair company. The database will cater to a sizeable clientele of 5000 customers. The details to be incorporated include: * Equipment type (X-ray machines, Dental chairs, Autoclaves) * Maintenance history * Customer details (Clinic name, number, email address etc.) In order to succeed in this project, you should have: * Strong database creation skills with the ability to account for our unique needs * Experience in the healthcare sector, specifically knowledge of dental equipment * Excellent problem solving and critical thinking skills for effective database design * Understanding of confidentiality requirements given the sensitive nature of the c...
We are seeking an experienced Flutter developer to integrate 's video and call streaming services along with Firebase database into our existing Flutter application. The primary tasks include implementing 's features for seamless video streaming and call functionality, as well as utilizing Firebase database for efficient data storage and retrieval. The ideal candidate should have prior experience with SDK and Firebase integration. Additionally, the developer will be responsible for updating the app to meet the requirements for submission to both Apple Store and Android Store. If you have the necessary skills and expertise in Flutter development, we'd love to hear from you.
We need the following combination of online database and data entry interface from users + a local MS access file. Online Database and web I terface for data entry We want to have multiple users to view and edit information for subscribers (names) in a database. Those users must be able to login on a web page, with a username and password. All users will see same information. But certain fields, those they will be able to edit, will be visible only to that specific user (and admin). Multiple users must be able to enter data (different) for each subscriber. User must be able to filter certain columns, search in all fields, hide/show columns. Online (on web) visible to users, will be only the fields mentioned in table visible) MS Access (local fil...
I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format
I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise. Please state ...
I'm looking for an expert to create a web-based CRM database aimed at efficiently storing and managing information. The data I intend to keep include: - Customer contact details - Sales history - Communication logs - Course details - Course Refresher notifications This project also requires the creation of functionalities to: - Add new contacts - Update existing contact information - Track sales performance Ideal freelancers should have substantial experience in CRM database development, with knowledge of implementing web-based solutions. Familiarity with training or course-based entities would be a bonus. Your expertise ought to allow seamless additions, updates, and performance tracking of stored information. Demonstrable success in similar projects will be ...
I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.
I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Pyth...need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and ...
...proficient Access Database designer to build an advanced and fully functional task management system. Key Features: - Data Entry Forms: These should be user-friendly and designed for efficiency. - Reporting and Analysis Tools: I need to be able to easily track productivity and analyze task-related metrics. - Data Validation Rules: The system needs to ensure the accuracy of inputted data with stringent validation rules. Structure: The database should consist of 5-10 interlinked tables for comprehensive task tracking and management. Ideal skills and experience for this job would include: - Extensive experience with Access database design, specifically around task management systems. - Strong ability to translate user needs into functional syst...
...detail to perform data entry into my database. The data to be entered is text-based and extracted from various sources which may have distinct formats. Below are specifics about the job: - Handling Text Data: The job will entail entering a variety of text data into the designated database. - Format Diversity: The data comes from diverse sources, so it does not adhere to a specific format. The ideal candidate must be adaptable in handling different data formats. - Correcting Discrepancies: The freelancer will need to spot and correct discrepancies or inconsistencies within the data sources. Accuracy and keenness to details will be crucial. Ideal Skills: - Proficient in data entry - Strong attention to detail - G...
I'm looking for a skilled professional to improve the accuracy of my cloud-based database. To achieve this, the tasks at hand include: - Identifying and removing duplicate entries - Standardizing data formats to ensure consistency - Conducting routine data cleaning checks to maintain accuracy Ideal candidates should have: - Proven experience in data cleaning and management - A deep understanding of cloud-based database systems - Strong communication skills as I prefer to get updates and progress reports through an instant messaging app.
I'm searching for a professional who is proficient in SQL coding specifically for MySQL database design. PowerShell scripting or similar would also be beneficial. This is a basic level project taking existing Local government procedures and converting them into SQL based processes. An example of which would be creating a import procedure for traffic count data that is presented in a text format (example attached) Ideal Skills: - Experienced with MySQL Database Design - Well-versed in SQL coding - Ability to simplify complex instructions - PowerShell for anything not possible in SQL This project will demand creativity and intelligence to design procedures that simplify data entry processes. Please only bid if you can offer solutions according to the...
I am experiencing slow query processing and management issues with large ...experiencing slow query processing and management issues with large tables in my MySQL database, primarily storing transaction data. I am seeking a DBA specialist to diagnose and resolve these bottlenecks and improve the overall performance of the system. Ideal Skills and Experience: - Proven experience in MySQL database administration and optimization - Knowledge of query execution plans and optimization techniques - Proficiency in managing databases with 10-50 tables - Experience in handling databases primarily housing transaction data Tasks include: - Investigating and diagnosing slow query performance - Optimizing handling of large tables - Implementing necessary changes to enhanc...
...currently in need of a professional who can assist in completing a database for over +14000 companies. The goal of this project is to generate high-quality sales leads. Key Project Details: - You will be required to include accurate and up-to-date contact information including phone numbers and email addresses. - In addition to the contact details, each company's key contact person's name must also be included in the database. The ideal freelancer for this project will have: - Prior experience with database generation and management. - Proficiency in data mining and web scraping techniques. - Exceptional attention to detail to ensure accuracy of information. - Proven track record in generating sales leads through database creation. This pr...
...need assistance with scraping data from a website and delivering it in an Excel file. The specifics of the project are as follows: I am looking for a person who will conduct scraping sessions for our business on a regular basis. Desired skills are knowledge of screen-scraper software, sql, Someone with Python knowledge will be better. Willing to follow instructions. Not cramped up with other jobs or other side hustles. Need to have solid internet connection. Expected work takes 5-10 hours per week, once fully trained. Must be responsible. Able to accept PayPal. - The source of the data is a website. This means the freelancer needs to have experience in web scraping. - The data should be delivered in an Excel file. Proficiency in handling an...
I'm seeking an expert in web scraping to specifically help extract data (price, stock availability, description, review content,..) from e-commerce platforms. Your specific task will entail: - Identifying and implementing the most efficient and effective way to scrape data. - extracting all data related to a product (picture, price, description, reviews, rating,...). Your method should maintain adherence to all legal and ethical guidelines - I'll need details on this as your bid. This project will require: - Proficiency in web scraping tools and techniques. - Sound knowledge of data extraction and storing processes. - Ability to work with undisclosed e-commerce platforms. - Familiarity with review structures on e-commerce sites.
...scraped job data should be downloadable in .csv format for easy analysis and storage. # Filtering Options: Ability to filter job listings based on old vs. new jobs for specific job verticals (e.g., technology, finance, healthcare) and support for Middle East/GCC countries. # Scalability: The scraper should be able to handle a large volume of job listings from multiple sources without performance issues. # Scheduled Scraping: Optional feature to schedule regular job scraping tasks to keep the data up-to-date. Ideal candidates for this project should have: - Experience in web scraping - Proficient in various programming languages such as Python, JavaScript, etc. - Familiarity with job hunting platforms like LinkedIn, Indeed, Monster, Google jobs, Naukrigulf - Str...
...involves migrating a medium-sized database (between 1GB and 10GB) to Oracle, and optimizing its performance. The database schema will also need to be designed, as this is not yet finalized. Key responsibilities include: - Migrating existing data: I need an expert who can handle this without losing any data or causing downtime. - Performance optimization: Once the data is migrated, the database needs to be optimized for speed and efficiency. - Designing the database schema: Your ability to design a schema that aligns with our business goals is critical for this project’s success. Ideal candidates should have extensive experience in Oracle database development, with a focus on data migration and performance optimizatio...
I am in need...Access specialist to create a straightforward database. The main aim of this project is the production of a simple database with a focus on data reporting. Key Points: - The database is intended for data reporting purposes. - There will be 1-5 different types of data entries (tables) in this database. - The final database should be equipped for generating various types of reports from the data it contains. - I am looking for a freelancer who can also document the database effectively. Ideal Skills and Experience: - Experience in designing and building Microsoft Access databases, specifically with a focus on reporting. - Strong knowledge of structuring databases for efficient reporting. - Ability to prov...
You will need to visit and search for the following categories. Drainage Glazing repair Appliance repair Plumber Electrician Roofer Use the postcode W2 4DP After you have the search results You will need to open a google sheet and have the following categories Name of Business Website (you will need to find this either from checkatrade or google if you use google do not put LTD on the end) Companies house link for each business use this link The task is to complete 500 companies - please bid knowing this and only bid if you read the brief and understand it
I'm currently experiencing database connection errors on my Wordpress website. Key Requirements: - Fix database connection errors causing website load problems - Ensure the website is running smoothly and all features are fully functional - Full access to the website's hosting account and database for troubleshooting - Clear and timely communication using instant messaging for updates and feedback Ideal Skills and Experience: - Proven experience in resolving database connection errors on Wordpress websites - Strong understanding of database management and troubleshooting in Wordpress - Excellent problem-solving skills and ability to work efficiently - Previous experience in instant messaging for client communication is a...
I'm looking for a professional Flask and Python developer to help me implement a user management system for my website. The user management system should have Social Media login integration. Additionally, I would like the selected developer to set up a payment gateway and a MySQL database. Ideal Skills: - Proficient in Flask and Python - Experience in implementing user management systems with social media login integration - Proficient in setting up payment gateways - Proficient in working with MySQL databases
I am in need of a technophile with expertise in Microsoft Access databases. Your task will involve: - Populating my database with customer data which includes names, addresses, phone numbers, organisation affiliations, and details of last interactions. - Inputting sales transactions data which include dates, product names, and prices. The ideal freelancer should demonstrate an adept understanding of database management, particularly Microsoft Access, and be able to accurately input data with keen attention to details. Efficiency, accuracy and attention to detail will be paramount for this project.
I require a proficient web scraper to extract varied data types including text content, images, and metadata from specific websites. The primary function will be to gather, organize and present data in a structured and usable format. - Skills and Experience Required: - Strong knowledge in web scraping tools and techniques - Familiarity with data extraction, mining, and storage - Proven track record in delivering similar projects Due to a time-sensitive nature, I will need this project to be completed within a month. The quick turnaround shouldn't compromise the quality or functionality of the web-scraper. Do bear in mind that reliability, efficiency, and accuracy of the data extraction process should be prioritized in the scop...
...experienced individual to fill the role of Database Architect/Lead Developer specializing in Netezza and Oracle databases. The ideal candidate will be responsible for designing, implementing, and maintaining database solutions that meet the needs of our organization. This role requires strong technical expertise in both Netezza and Oracle platforms, as well as leadership capabilities to guide a team of developers. Responsibilities Design and implement efficient database solutions for our organization, leveraging Netezza and Oracle technologies. Lead a team of developers in the implementation and maintenance of database systems. Collaborate with other stakeholders to gather requirements and define database architecture to meet business needs. O...
I have to transfer data and tables from oracle to postgres.
...with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories must be contained within the scraper and be automatic, ensuring dynami...
I have a significant amount of text data from physical documents which I need entered into a database. The ideal candidate will have experience with both data entry and database management. Key Project Requirements: - Data Entry: You will be responsible for accurately transcribing text data from physical documents into a digital format. - Database Management: The entered data needs to be organized correctly in the database. Prior experience in managing databases is essential. Ideal Skills and Experience: - Proficiency in data entry - Strong attention to detail - Experience in database management - Familiarity with data organization techniques I'm looking for someone who can complete this efficiently...
I need a professional to create an ER diagram for a moderately complex database I'm designing. - This is specifically for database design purposes, using Chen notation. - The database structure I have in mind falls between 10-20 entities, so the ER diagram will need to reflect this level of complexity. - You should have in-depth experience with database design and ER diagramming, particularly using Chen notation. - The ER diagram should be clear, well-structured and accurately represent the relationships and entities within the database. - Previous experience with similar projects is a plus.
I'm seeking a FileMaker Pro expert to modify the existing project database for our small architecture firm. Your main tasks include: - Rectifying existing bugs - Enhancing reporting capacity - Introducing new mapping features, if possible. Some issues have been detected in the current system with features not working properly, particularly in the reporting capacity. A new mapping feature is optional and can be discussed further. There isn't a strict time frame for project completion, but I'm hoping to get it done as soon as possible. Ideally, the applicant should have a strong background in FileMaker, bug fixing and data mapping.
I am in need of a Laravel Developer to work on my website. The changes involve backend functionality and database modifications. Ideal Skills: - Strong experience with Laravel - Expertise in backend development - Proven track record of database modifications Tasks Include: - Implementing API integration, specifically e-commerce APIs - Database modification to accommodate new functionalities I need someone with a high level of expertise in Laravel and backend development. Your ability to integrate e-commerce APIs and modify the database accordingly is crucial for the success of this project. Your focus will be on enhancing the backend functionality, ensuring it's robust and efficient. Your attention to detail and ability to work independently will ...
...can help me create a movie database website that is connected to a Telegram bot. Key Features: - Movie Database Website: The core of the project is to build a movie database that's user-friendly and comprehensive. - Telegram Bot Integration: I need a Telegram bot that can seamlessly connect to my movie database. The bot should be able to handle user queries and provide relevant movie recommendations. Telegram Bot Functionalities: - Movie Search & Recommendation: Users should be able to search for movies based on different criteria and receive tailored recommendations. - URL Shortener: The bot should be able to generate a shortened URL for the movie being recommended. Ideal Skills and Experience: - Proficiency in web development, pa...
...1, 2, and 3 emissions database through web scraping and data moderation. The selected developer will be responsible for scraping emissions data from global listed companies, implementing a moderation system, and enhancing our current offering by providing a database of published emissions data for ASX companies. Responsibilities: 1. Web Scraping - Web scrape scope 1, 2, and 3 data points from global listed companies to populate the VeriCO2 emissions database initially. - Develop scripts or tools to automate the web scraping process and ensure efficient data collection. 2. Data Moderation - Implement a moderation check to review and update data points based on user feedback and VeriCO2's own data collecti...
...emissions database as part of our automated quantification of scope 3 emissions project. The selected developer will be responsible for setting up the database, developing a user contribution system, and implementing security measures to ensure data integrity. Responsibilities: 1. Database Setup - Set up a database to store scope 1, 2, and 3 emissions data for global listed companies. 2. User Contribution System - Develop a system for users to contribute data via LinkedIn by signing up and providing their company's scope 1, 2, and/or 3 emissions. - Implement a security check to ensure the user's email domain matches the company name and send a verification email. - Allow users to download scope 1, 2, or 3 information ...
I'm in need of a professional who can build a tool that scrapes product data from Walmart and exports it into an Excel spreadsheet. Key Requirements: - Develop a web scraping tool specifically for Walmart website - Extract essentials (price, upc, title) Skills and Experience: - Proficiency in web scraping using Python, Scrapy, or similar tools Please let me know your availability and estimated time for completion. This is an urgent project, so a quick turnaround would be highly appreciated.
...conducting a thorough code review and integrating an emissions factor database into the existing codebase. Responsibilities: 1. Code Review and Functionality Check - Review the existing code to ensure there are no backdoors from the previous developer. - Verify that the code is functional and all equations for each method within the 15 scope 3 categories under the GHG protocol are correct. 2. Emissions Factor Database Integration - Finish coding the scraping mechanism to extract emissions factors from the Intergovernmental Panel on Climate Change's (IPCC) emissions factors database (). - Integrate the scraping mechanism with the IPCC's lookup section to ensure the database is dynamically updated. Requirements: - Strong experience
I'm in need of a reliable colleague who can assist me with data entry. The main task at hand is database creation. Key Responsibilities: - Data Entry: Your main responsibility will be to input data into a database. - Database Creation: You will be actively involved in the creation of a new database from scratch. Ideal Skills and Experience: - Proficiency in Data Entry: I need someone who is both fast and accurate in data entry. - Familiarity with Databases: Experience in creating and managing databases will be a great advantage. - Attention to Detail: The data involved in this project could potentially be complex, so attention to detail is crucial. I appreciate someone who is detail-oriented, reliable, and can ...
...commission the creation of a comprehensive database of IT working professionals. The main purpose of the database will be for recruitment purposes. Key Requirements: - The database should focus on IT professionals, covering a wide range of roles and expertise within the industry. - The data collected should be accurate, up-to-date and well-organized to facilitate efficient recruitment processes. Ideal Skills and Experience: - Prior experience in database creation for recruitment purposes, ideally within the IT sector. - Knowledge of the IT industry and the different roles and specializations within it. - Attention to detail and the ability to collect and organize large sets of data accurately. Please note that I have not specified the meth...
I'm seeking a skilled data professional to provide a database of general consumer email addresses. The reach of the database should be international, encompassing various demographics and regions. I'll need the database to be delivered in an Excel file. Required Expertise: - Proficient in data collection - Proven experience in the field of emails dataset - Adept in Excel - Comprehensive understanding of data privacy guidelines Deliverable: - Database of general consumer emails in a well-structured Excel file.
I am in need of a USA email database for my email marketing campaigns. The primary focus of the database should be on consumers rather than businesses or non-profit organizations. An understanding of how to gather consumer-oriented data would be essential for this project. Your role would also include ensuring that the data adheres to privacy regulations and ethical data collection standards. Key skills and experience: - Database creation and management - USA consumer market knowledge - Understanding of privacy laws and ethical data gathering - Previous work with email marketing. Please note that details about target consumer segments such as age range, geographical location, or specific interests or hobbies are not necessary for this p...
