Web scraper databasecông việc

- Dã có template, model, css, form sẵn. Chỉ cần giúp mình upfile lên được database

Mình có application connect với db hosting server Mà để chuỗi connect trong app thì bị lộ Nên 1 bạn giúp

Mình muốn xử lý trang HTML chuyển vào database(kiểu xử lý chuỗi or mảng rồi lưu vào database real time) bạn nào hứng thú liên hệ mình sẽ trao đổi cụ thể.

Mình muốn load database của 1 website về dạng bảng excel để tiện tra cứu, trang đó có đuôi dạng như này Pages/admin/report/

Team mình ở Huế cần tuyển: 01 Database Engineer * Yêu cầu: - Phân tích và thiết kế cơ sở dữ liệu. - Có kiến thức với các hệ thống: Oracle, SQL Server, chủ yếu làm việc với MySQL. - Có kinh nghiệm viết procedures, functions, views. - Biết cách tối ưu SQL & dùng indexes hay partitioning. - Có kinh nghiệm cài đặt, quản lý, nâng cấp, sao lưu hệ thống cơ sở dữ liệu lớn. - Có kinh nghiệm làm việc với Linux và shell scripting. Công việc lâu dài, tính bằng năm, có thể full-time hoặc part-time Rate mong muốn: $5-$7/h

Sử dụng SQlite3, có hình ảnh mô tả

...giây. Website dùng VPS như sau: CentOS 6.8 + nginx + mysql (mariadb), 1-2 cores CPU, 2-4 GB RAM, ổ cứng SSD Mã nguồn website: Wordpress + tool quét tin WP Content Crawler Qua tìm kiếm trên google mình thấy nhiều nơi khuyên website dữ liệu lớn cần tách database làm 2 phần: đọc và ghi riêng Vậy, theo mình công việc sẽ là tách database thành 2 phần riêng: phần đọc và ghi riêng để tăng tốc độ tải trang Hoặc bạn có thể đề xuất phương án xử lý dữ liệu và mã nguồn kiểu khác để tăng tốc độ tải trang xuống dưới 3 giây, giữ nguyên cấu hình vps do ngân sách của khách...

Hi Khánh, mình thấy tên bạn trong project này (https://www.freelancer.com/projects/php/telegram-channel-web-scraper/) Mình muốn nhờ Khánh làm giúp mình một con bot như vậy được không? Mục đích không được trong sáng cho lắm :) Đức

#1: #2:

...CÓ GÌ LÀ KHÔNG THỂ BÁN ĐƯỢC -- LƯU Ý: Bất kỳ Chi nhánh ngân hàng nào cũng rất cần Diamond Database này vì 2 mục đích: 1. Tăng số lượng khách hàng sử dụng nhiều sản phẩm dịch vụ ngân hàng và tăng Lợi nhuận + 2.. Tự bản thân ngân hàng check Credit Scoring cho mỗi khách hàng vay tiền để giảm thiểu TỐI ĐA Rủi ro cho vay để được ĐÁNH GIÁ TỐT VÀO KẾT QUẢ KINH DOANH CUỐI NĂM VÌ ĐIỀU NÀY ẢNH HƯỞNG ĐẾN THƯỞNG KẾT QUẢ KINH DOANH CỦA CẢ CHI NHÁNH. -- Bạn hãy đề cập tới 2 vấn đề này với người bạn trực tiếp tư vấn với tính thuyết phục cao, và nhớ rằng đây là V...

Phân thích thiết kế website theo ý tưởng đề ra Hỗ trợ viết tài liệu cho dự án

I'm looking for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to my Google Drive. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during scraping is very important.

...creating an ER diagram, relational schema, database dump, SQL files, and queries for a library database system. Requirements: - ER Diagram: An ER diagram is required with rationalities similar to the example provided in this link: - Relational Schema: Develop a relational schema that effectively models the database. - Database Dump: Provide a database dump for the system. - SQL Files and Queries: The project should include a set of SQL files and queries that effectively interact with the database. - Managerial Queries: Develop a minimum of 20 managerial queries that will be used to analyze and manage the library database. Deadline: This project must be completed by Monday. Ideal Skills: - Proficiency in database design and SQ...

...complex backend development and database integration tasks and run code as offline. Key Responsibilities: Develop, test, and maintain robust, scalable, high-quality software solutions. Design and implement new features and functionality. Write clean, maintainable, and efficient code. Develop RESTful APIs to support front-end functionality. Integrate user-facing elements developed by front-end developers with server-side logic. - In-depth understanding and experience of backend operations using Python Django. - Managing and integration of the database with the application. - Maintenance and improvement of existing codebase for optimal functionality. Desirable Skills: - Proven experience in Python Django for backend development. - Hands-on experience in database ...

I've compiled a comprehensive global leads database with 8 million entries. The database includes a variety of details such as name, email, contact number, website, profession, and even Instagram username. - **Purpose**: This database is specifically designed for sales leads generation. It's meant to help businesses and organizations reach out to potential customers and grow their sales. - **Categorization**: The leads are not just categorized by one specific filter. Instead, they're a mix of different categories from various industries, countries, and professions. This eclectic mix provides a wide range of opportunities for potential buyers. - **Delivery Method**: I'm looking to sell this database through a CSV file, online access to the...

Commercial real estate agency database of GCC

About Plesk hosting upgrading the database from MariaDB 10.1 to 10.3 i would like to upgrade the database from MariaDB 10.1 to 10.3 for my hosting however, my hosting have a lot of client website in it, just would like to know if this upgrade will not affect the existing database thanks

Self Managed Home Care Providers Database

I'm seeking a data entry specialist with a knack for precision to type data from PDFs into an online database. Key Requirements: - As a data entry specialist, you will be responsible for the accurate and timely entry of data from PDFs into our online database. - The data format should match the original PDFs, with no specific validation rules needed. - The ideal candidate will be detail-oriented, with a proven track record of data entry. If you're someone who enjoys working with data and has an eye for detail, this could be an ideal project for you.

I'm looking to create a comprehensive database of self-managed home care providers in Queensland and Australia to facilitate networking within the industry. Key requirements: - The database should include the provider's: - Name - Address - Email - Prime contact Ideal skills for this project: - Proficiency in data collection and database creation - Familiarity with the home care industry in Queensland and Australia - Organizational skills, to categorize the data by region - Excellent attention to detail, ensuring accuracy in information provided The data should be organized by region for easier networking. I may also require the database to be updated periodically. The collected information should be reliable, up-to-date, and include a diver...

I am in need of someone who can help me gather email addresses, websites, and phone numbers from the links in the attached spreadsheet. It's crucial that the information you provide is accurate and up-to-date. The test of accuracy will be me sending emails and verifying the company. Any wrong details will need to be collected again unless it is beyond your control (e.g. company has closed down etc.) Automated collection will be erroneous as the data needs to be collected in the following way. use the company names or links from the attached spreadsheet. 2. To copy and paste the company name + UK in the Google search box. The company's operation must be based in the UK as similar names may exist in US as well. 3. Or to click company logo and collect its email addresses, websit...

I need a proficient database developer (PHP Developer) to create a specialized system for my dental equipment repair company. The database will cater to a sizeable clientele of 5000 customers. The details to be incorporated include: * Equipment type (X-ray machines, Dental chairs, Autoclaves) * Maintenance history * Customer details (Clinic name, number, email address etc.) In order to succeed in this project, you should have: * Strong database creation skills with the ability to account for our unique needs * Experience in the healthcare sector, specifically knowledge of dental equipment * Excellent problem solving and critical thinking skills for effective database design * Understanding of confidentiality requirements given the sensitive nature of the cu...

We are seeking an experienced Flutter developer to integrate 's video and call streaming services along with Firebase database into our existing Flutter application. The primary tasks include implementing 's features for seamless video streaming and call functionality, as well as utilizing Firebase database for efficient data storage and retrieval. The ideal candidate should have prior experience with SDK and Firebase integration. Additionally, the developer will be responsible for updating the app to meet the requirements for submission to both Apple Store and Android Store. If you have the necessary skills and expertise in Flutter development, we'd love to hear from you.

We need the following combination of online database and data entry interface from users + a local MS access file. Online Database and web I terface for data entry We want to have multiple users to view and edit information for subscribers (names) in a database. Those users must be able to login on a web page, with a username and password. All users will see same information. But certain fields, those they will be able to edit, will be visible only to that specific user (and admin). Multiple users must be able to enter data (different) for each subscriber. User must be able to filter certain columns, search in all fields, hide/show columns. Online (on web) visible to users, will be only the fields mentioned in table visible) MS Access (local fil...

I need a VRBO scraper to extract property details, pricing, and availability. - The scraper should be built with Python and the output should be in CSV format. - The data points I need include property title, description, amenities, pricing, and availability. - The scraper should be able to handle multiple URLs at once. - The code should be well-structured and commented for easy maintenance. Ideal skills: - Proficiency in Python - Experience in web scraping - Understanding of VRBO website structure - Ability to handle and store data in CSV format

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise. Please...

I'm looking for an expert to create a web-based CRM database aimed at efficiently storing and managing information. The data I intend to keep include: - Customer contact details - Sales history - Communication logs - Course details - Course Refresher notifications This project also requires the creation of functionalities to: - Add new contacts - Update existing contact information - Track sales performance Ideal freelancers should have substantial experience in CRM database development, with knowledge of implementing web-based solutions. Familiarity with training or course-based entities would be a bonus. Your expertise ought to allow seamless additions, updates, and performance tracking of stored information. Demonstrable success in similar projects w...

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

I'm seeking a proficient Access Database designer to build an advanced and fully functional task management system. Key Features: - Data Entry Forms: These should be user-friendly and designed for efficiency. - Reporting and Analysis Tools: I need to be able to easily track productivity and analyze task-related metrics. - Data Validation Rules: The system needs to ensure the accuracy of inputted data with stringent validation rules. Structure: The database should consist of 5-10 interlinked tables for comprehensive task tracking and management. Ideal skills and experience for this job would include: - Extensive experience with Access database design, specifically around task management systems. - Strong ability to translate user needs into functional system fe...

I'm seeking an experienced freelancer with strong attention to detail to perform data entry into my database. The data to be entered is text-based and extracted from various sources which may have distinct formats. Below are specifics about the job: - Handling Text Data: The job will entail entering a variety of text data into the designated database. - Format Diversity: The data comes from diverse sources, so it does not adhere to a specific format. The ideal candidate must be adaptable in handling different data formats. - Correcting Discrepancies: The freelancer will need to spot and correct discrepancies or inconsistencies within the data sources. Accuracy and keenness to details will be crucial. Ideal Skills: - Proficient in data entry - Strong attention to d...

I'm looking for a skilled professional to improve the accuracy of my cloud-based database. To achieve this, the tasks at hand include: - Identifying and removing duplicate entries - Standardizing data formats to ensure consistency - Conducting routine data cleaning checks to maintain accuracy Ideal candidates should have: - Proven experience in data cleaning and management - A deep understanding of cloud-based database systems - Strong communication skills as I prefer to get updates and progress reports through an instant messaging app.

I'm searching for a professional who is proficient in SQL coding specifically for MySQL database design. PowerShell scripting or similar would also be beneficial. This is a basic level project taking existing Local government procedures and converting them into SQL based processes. An example of which would be creating a import procedure for traffic count data that is presented in a text format (example attached) Ideal Skills: - Experienced with MySQL Database Design - Well-versed in SQL coding - Ability to simplify complex instructions - PowerShell for anything not possible in SQL This project will demand creativity and intelligence to design procedures that simplify data entry processes. Please only bid if you can offer solutions according to the basic complex...

I am experiencing slow query processing and management issues with large ...experiencing slow query processing and management issues with large tables in my MySQL database, primarily storing transaction data. I am seeking a DBA specialist to diagnose and resolve these bottlenecks and improve the overall performance of the system. Ideal Skills and Experience: - Proven experience in MySQL database administration and optimization - Knowledge of query execution plans and optimization techniques - Proficiency in managing databases with 10-50 tables - Experience in handling databases primarily housing transaction data Tasks include: - Investigating and diagnosing slow query performance - Optimizing handling of large tables - Implementing necessary changes to enhance overall d...

...currently in need of a professional who can assist in completing a database for over +14000 companies. The goal of this project is to generate high-quality sales leads. Key Project Details: - You will be required to include accurate and up-to-date contact information including phone numbers and email addresses. - In addition to the contact details, each company's key contact person's name must also be included in the database. The ideal freelancer for this project will have: - Prior experience with database generation and management. - Proficiency in data mining and web scraping techniques. - Exceptional attention to detail to ensure accuracy of information. - Proven track record in generating sales leads through database creation. This pr...

I need assi...Desired skills are knowledge of screen-scraper software, sql, Someone with Python knowledge will be better. Willing to follow instructions. Not cramped up with other jobs or other side hustles. Need to have solid internet connection. Expected work takes 5-10 hours per week, once fully trained. Must be responsible. Able to accept PayPal. - The source of the data is a website. This means the freelancer needs to have experience in web scraping. - The data should be delivered in an Excel file. Proficiency in handling and formatting data into Excel is a must. Ideal Skills and Experience: - Proficient in web scraping, particularly with data from websites. - Experience in delivering data in Excel format. - Familiarity with handling login authentication for...

I'm seeking an expert in web scraping to specifically help extract data (price, stock availability, description, review content,..) from e-commerce platforms. Your specific task will entail: - Identifying and implementing the most efficient and effective way to scrape data. - extracting all data related to a product (picture, price, description, reviews, rating,...). Your method should maintain adherence to all legal and ethical guidelines - I'll need details on this as your bid. This project will require: - Proficiency in web scraping tools and techniques. - Sound knowledge of data extraction and storing processes. - Ability to work with undisclosed e-commerce platforms. - Familiarity with review structures on e-commerce sites.

I am looking to develop a web-based job extractor that's capable of aggregating job listing from various platforms across multiple countries with the following features: # Source Selection : The ability to select multiple sources for job scraping, including Google jobs. # Comprehensive Job Details: Extraction of all details included in the job listing, such as job title, company name, location, job description, requirements, etc. # Web Interface: A user-friendly web interface where users can enter the URL of the job listings page and initiate the scraping process. # Downloadable in .csv Format: The scraped job data should be downloadable in .csv format for easy analysis and storage. # Filtering Options: Ability to filter job listings based on old vs. new job...

I am in need...Access specialist to create a straightforward database. The main aim of this project is the production of a simple database with a focus on data reporting. Key Points: - The database is intended for data reporting purposes. - There will be 1-5 different types of data entries (tables) in this database. - The final database should be equipped for generating various types of reports from the data it contains. - I am looking for a freelancer who can also document the database effectively. Ideal Skills and Experience: - Experience in designing and building Microsoft Access databases, specifically with a focus on reporting. - Strong knowledge of structuring databases for efficient reporting. - Ability to provide clear and concise docume...

You will need to visit and search for the following categories. Drainage Glazing repair Appliance repair Plumber Electrician Roofer Use the postcode W2 4DP After you have the search results You will need to open a google sheet and have the following categories Name of Business Website (you will need to find this either from checkatrade or google if you use google do not put LTD on the end) Companies house link for each business use this link The task is to complete 500 companies - please bid knowing this and only bid if you read the brief and understand it

I'm currently experiencing database connection errors on my Wordpress website. Key Requirements: - Fix database connection errors causing website load problems - Ensure the website is running smoothly and all features are fully functional - Full access to the website's hosting account and database for troubleshooting - Clear and timely communication using instant messaging for updates and feedback Ideal Skills and Experience: - Proven experience in resolving database connection errors on Wordpress websites - Strong understanding of database management and troubleshooting in Wordpress - Excellent problem-solving skills and ability to work efficiently - Previous experience in instant messaging for client communication is a plus Had issues lik...

I'm looking for a professional Flask and Python developer to help me implement a user management system for my website. The user management system should have Social Media login integration. Additionally, I would like the selected developer to set up a payment gateway and a MySQL database. Ideal Skills: - Proficient in Flask and Python - Experience in implementing user management systems with social media login integration - Proficient in setting up payment gateways - Proficient in working with MySQL databases

I am in need of a technophile with expertise in Microsoft Access databases. Your task will involve: - Populating my database with customer data which includes names, addresses, phone numbers, organisation affiliations, and details of last interactions. - Inputting sales transactions data which include dates, product names, and prices. The ideal freelancer should demonstrate an adept understanding of database management, particularly Microsoft Access, and be able to accurately input data with keen attention to details. Efficiency, accuracy and attention to detail will be paramount for this project.

I require a proficient web scraper to extract varied data types including text content, images, and metadata from specific websites. The primary function will be to gather, organize and present data in a structured and usable format. - Skills and Experience Required: - Strong knowledge in web scraping tools and techniques - Familiarity with data extraction, mining, and storage - Proven track record in delivering similar projects Due to a time-sensitive nature, I will need this project to be completed within a month. The quick turnaround shouldn't compromise the quality or functionality of the web-scraper. Do bear in mind that reliability, efficiency, and accuracy of the data extraction process should be prioritized in the scope of th...

...experienced individual to fill the role of Database Architect/Lead Developer specializing in Netezza and Oracle databases. The ideal candidate will be responsible for designing, implementing, and maintaining database solutions that meet the needs of our organization. This role requires strong technical expertise in both Netezza and Oracle platforms, as well as leadership capabilities to guide a team of developers. Responsibilities  Design and implement efficient database solutions for our organization, leveraging Netezza and Oracle technologies.  Lead a team of developers in the implementation and maintenance of database systems.  Collaborate with other stakeholders to gather requirements and define database architecture to meet business needs.  O...

I have to transfer data and tables from oracle to postgres.

...proficient in web scraping with Scrapy to extract product data from This project involves scraping the Category page to retrieve product details including name, price, SKU, URL, breadcrumb, currency, and brand. Targeted webpage: Category page of Required data: Product name, price, SKU, URL, breadcrumb, currency, and brand Experience: Prior experience in scraping product-related information from e-commerce sites is essential, with proficiency in Scrapy being crucial for accurate and efficient data extraction. Data Handling: Ability to ensure accuracy and consistency of extracted data. Familiarity with different data formats is advantageous. Dynamic Scraping: Navigation logic for all categories must be contained within the scraper and be automatic

I have a significant amount of text data from physical documents which I need entered into a database. The ideal candidate will have experience with both data entry and database management. Key Project Requirements: - Data Entry: You will be responsible for accurately transcribing text data from physical documents into a digital format. - Database Management: The entered data needs to be organized correctly in the database. Prior experience in managing databases is essential. Ideal Skills and Experience: - Proficiency in data entry - Strong attention to detail - Experience in database management - Familiarity with data organization techniques I'm looking for someone who can complete this efficiently and accurately.

I need a professional to create an ER diagram for a moderately complex database I'm designing. - This is specifically for database design purposes, using Chen notation. - The database structure I have in mind falls between 10-20 entities, so the ER diagram will need to reflect this level of complexity. - You should have in-depth experience with database design and ER diagramming, particularly using Chen notation. - The ER diagram should be clear, well-structured and accurately represent the relationships and entities within the database. - Previous experience with similar projects is a plus.

I'm seeking a FileMaker Pro expert to modify the existing project database for our small architecture firm. Your main tasks include: - Rectifying existing bugs - Enhancing reporting capacity - Introducing new mapping features, if possible. Some issues have been detected in the current system with features not working properly, particularly in the reporting capacity. A new mapping feature is optional and can be discussed further. There isn't a strict time frame for project completion, but I'm hoping to get it done as soon as possible. Ideally, the applicant should have a strong background in FileMaker, bug fixing and data mapping.