Data retrieval scrapingcông việc
Mình cần 1 bạn có thể lấy dữ liệu từ 1 trang web và mỗi khi trang web đó update thì gửi thông báo vào telegram cho mình. Chi tiết xin liên hệ theo số đt : [Removed by Freelancer.com]
- Ruby developer. Phát triển các dự án sử dụng Ruby như Ruby on Rails, scraping, bot. - Phân tích yêu cầu hệ thống, thiết kế hệ thống, thiết kế DB. - Làm việc với BSE, PM, phối hợp với các thành viên khác theo mô hình agile
...phụ trách 1 số tài khoản Upwork Mỹ cần tìm cá nhân/tổ chức hợp tác làm những dự án outsource. Hiện tại account full stack web and mobile development của em đang có 100% job completion và là top rated nên rất dễ bid và win contract. Team em quá tải ko làm hết nên đang cần hợp tác với single dev/team. Em nhận mọi loại dự án từ làm app, làm web (nodejs, laravel, angular, react, flutter vv), đến data scraping, Wordpress, Shopify, Wix (set up server, PHP, javascript, custom themes, plugins vv), thiết kế đồ hoạ (web, app, brand identity, vv) và những task debug hoặc phức tạp như building AI/machine learning models. Mọi người ai là...
...phụ trách 1 số tài khoản Upwork Mỹ cần tìm cá nhân/tổ chức hợp tác làm những dự án outsource. Hiện tại account full stack web and mobile development của em đang có 100% job completion và là top rated nên rất dễ bid và win contract. Team em quá tải ko làm hết nên đang cần hợp tác với single dev/team. Em nhận mọi loại dự án từ làm app, làm web (nodejs, laravel, angular, react, flutter vv), đến data scraping, Wordpress, Shopify, Wix (set up server, PHP, javascript, custom themes, plugins vv), thiết kế đồ hoạ (web, app, brand identity, vv) và những task debug hoặc phức tạp như building AI/machine learning models. Mọi người ai là...
...phụ trách 1 số tài khoản Upwork Mỹ cần tìm cá nhân/tổ chức hợp tác làm những dự án outsource. Hiện tại account full stack web and mobile development của em đang có 100% job completion và là top rated nên rất dễ bid và win contract. Team em quá tải ko làm hết nên đang cần hợp tác với single dev/team. Em nhận mọi loại dự án từ làm app, làm web (nodejs, laravel, angular, react, flutter vv), đến data scraping, Wordpress, Shopify, Wix (set up server, PHP, javascript, custom themes, plugins vv), thiết kế đồ hoạ (web, app, brand identity, vv) và những task debug hoặc phức tạp như building AI/machine learning models. Mọi người ai là...
...phụ trách 1 số tài khoản Upwork Mỹ cần tìm cá nhân/tổ chức hợp tác làm những dự án outsource. Hiện tại account full stack web and mobile development của em đang có 100% job completion và là top rated nên rất dễ bid và win contract. Team em quá tải ko làm hết nên đang cần hợp tác với single dev/team. Em nhận mọi loại dự án từ làm app, làm web (nodejs, laravel, angular, react, flutter vv), đến data scraping, Wordpress, Shopify, Wix (set up server, PHP, javascript, custom themes, plugins vv), thiết kế đồ hoạ (web, app, brand identity, vv) và những task debug hoặc phức tạp như building AI/machine learning models. Mọi người ai là...
...đang phụ trách 1 số tài khoản Up work Mỹ cần tìm cá nhân/tổ chức hợp tác làm những dự án outsource. Hiện tại account full stack web and mobile development của em đang có 100% job completion và là top rated nên rất dễ bid và win contract. Team em quá tải ko làm hết nên đang cần hợp tác với mọi người. Em nhận mọi loại dự án từ làm app, làm web (nodejs, laravel, angular, react, flutter vv), đến data scraping, Wordpress, Shopify, Wix (set up server, PHP, javascript, custom themes, plugins vv), thiết kế đồ hoạ (web, app, brand identity, vv) và những task debug hoặc phức tạp như building AI/machine learning models. Ai làm đc g&igr...
Hi kimhanu, I noticedAnh ơi em chuyên nhận project freelance ở Mỹ bây giờ có rất nhiều dự án (100+) đủ mọi thể loại từ wordpress, shopify, wix đến mobile/web ((nodejs, laravel, angular, react, flutter vv), đến data, scraping, thiết kế đồ hoạ vv. Freelancer làm đc gì thì nhận cái đó. Anh có interested nhận thêm dự án ko ạ? Em cám ơn! your profile and would like to offer you my project.
Anh ơi em chuyên nhận project freelance ở Mỹ bây giờ có rất nhiều dự án (100+) đủ mọi thể loại từ wordpress, shopify, wix đến mobile/web ((nodejs, laravel, angular, react, flutter vv), đến data, scraping, thiết kế đồ hoạ vv. Freelancer làm đc gì thì nhận cái đó. Anh có interested nhận thêm dự án ko ạ? Em cám ơn!
...wireframes, và có thể chia sẻ và bàn luận kỹ hơn với người được chọn. YÊU CẦU: - Tối thiểu 3 năm kinh nghiệm với PYTHON. - Có thể làm việc full time tại nhà mình ở Hoàng Mai, Hà Nội. - Cẩn thận, có trách nhiệm trong công việc. - Nắm vững kiến thức cơ bản và nâng cao của PYTHON, các design patterns. Tuân thủ code convention, clean code và ít bug. - Có kinh nghiệm làm việc với APIs, Django, web scraping, Manual and Automation testing… - Ưu tiên những ai có thể đảm nhận được cả mobile app development. - Người được chọn sẽ phải ký NDA (non-disclosure agreement) - The more, the better. - ….. QUYỀN L...
Hi there, Minh can scrape data from 1 so website o VN, ban cho minh thong tin ve dich vu va gia ca duoc khong? Cam on ban nhieu, Vi
Hi there, Minh can scrape data from 1 so website o VN, ban cho minh thong tin ve dich vu va gia ca duoc khong? Cam on ban nhieu, Vi
I'm seeking an experienced developer to aid in building 15+ AIs for a backend project using NestJS. The main focus is API development, with a particular emphasis on REST APIs. Key Responsibilities: - Create efficient and secure REST APIs - Integrate Payment Gateways, Social Media Platforms, and Cloud Storage Services via these REST APIs - Ensure a robust...Responsibilities: - Create efficient and secure REST APIs - Integrate Payment Gateways, Social Media Platforms, and Cloud Storage Services via these REST APIs - Ensure a robust level of user authentication and authorization Ideal Skills and Experience: - Proficient in NestJS and AI technology - Extensive experience in REST APIs, including third-party integrations - Strong understanding of data storage, retrieval, a...
I'm urgently looking for a Laravel expert to assist with my project. We're needing support specifically in the backend development, particularly revolving around: - Data Processing: You'll need to have proven skills and experience in handling data storage, retrieval, and manipulation within the Laravel framework. - API Integration: Expertise in integrating third-party APIs into Laravel projects is critical. The job needs to be expedited and I appreciate promptness and dedication to fulfilling the project within a short period. Proven prior experience in similar projects will be a definitive plus. Please include "Laravel Backend Expert" at the start of your proposal to confirm you've read and understood the full requirements.
I'm looking for a qualified freelancer to develop a script that can navigate the Almaviva Egypt website just like a human w...that can still function proficiently with a limited number of appointment slots. Moreover, it must be programmed to input login credentials. A crucial requirement is that it can bypass or solve captcha verifications, ensuring a smooth booking process. The essential skillset for this project comprises expertise in Python, as the script should be developed in this language. Familiarity with web scraping and script-making is essential. Knowledge of dealing with booking systems or captcha verifications would be a remarkable advantage. The ideal freelancer is able to create an efficient, reliable script that can consistently secure appointments on Almaviva E...
...need an experienced web scraper who can extract data efficiently from multiple websites. Applicants' guidelines are as follows: 1. Websites for Scraping: Due to security concerns, the websites to be scraped will only be shared with the selected freelancer. 2. Application Contents: I didn't explicitly mention what I want freelancers to include in their applications. However, demonstrating your skills, experience, and past work related to web scraping will surely be a significant advantage. 3. Project Deadline: I require this project to be completed as soon as possible. Please include your estimated completion date in your proposal. Ideal Skills & Experience: - Proven experience in web scraping - Knowledge of Python, Selenium or other scrap...
I need a market research-oriented individual with an expertise in data mining and web scraping. The project entails extracting data from the website harborfreight.com. Specifically detailing: - Product names - Product price - Product type (IE power tools) - Their associated number of customer ratings These details should provided in a CSV file then be categorized by product type. A strong understanding of categorization and proficiency in scraping complex websites will be beneficial. With this data, I intend to carry out detailed market research. Do not worry about descriptions, focus solely on the product names, price, rating numbers, and categorization. I'm looking forward to seeing your proposals if your skills align with these needs.
...with big data capabilities, specifically focusing on real-time monitoring and fraud detection. Key Features: - The system should support real-time monitoring of transaction data. - It should have fraud detection capabilities. - Data visualization to aid in tracking and analysis. - Analytics for evaluating transaction patterns and identifying potential issues. - Smooth Data Pipeline with Realtime streaming for efficient data handling. - API integration with third parties to ensure seamless operation. Target Audience: This platform is primarily aimed at banking and financial institutions, as well as e-commerce companies. Preferred Technology Stack: - Java & Python for the core of the platform. - Big Data technologies for processing large ...
...vectorization Semantic similarity search in Milvus/SPTAG Local post-hoc model explanations Production-ready Flask/FastAPI UI Documentation and usage guides Document Ingestion (spaCy, Beautiful Soup, PyMuPDF): Scrape/ingest docs, extract text, handle formats Vectorization (Sentence/Doc2Vec): Convert text to distributed representations Vector Database (Milvus, SPTAG): Store/index vectors at scale for retrieval Semantic Search (FAISS): Leverage ANN for related content finding Knowledge Graph (spaCy, NetworkX): Extract entities/relations, build graph Explainability (AIX360, LIME): Provide post-hoc model explanations UI (Flask, Streamlit): Build search/browse front-end for end users This is a fixed price project. Do not ask to chat or set meetings to discuss requirements. Bids will n...
I'm seeking expertise to develop an AI solution addressing specific communication challenges in my operations. This advanced technology will aid in requesting more specific information for document retrieval, task completion, and progress updates that are currently barriers. Key Features and Responsibilities: - Construct an AI system that can precisely request added details - The AI tool should nurutre informations mainly for document retrieval, tasks execution, and progress report. - Should work effectively with email platforms as the primary communication tool. Ideal Experience: - Proven experience in AI and machine learning technology - Familiarity with corporate communication systems - Experience in integrating AI with Email services. This project aims at enhancin...
I need a proficient Python expert to scrape recipes from a designated website to an Excel sheet. The project needs to be c...website to an Excel sheet. The project needs to be completed as soon as possible. You can use this open-source working scraper Key requirements: - Scraping recipe information (name, ingredients, cooking instructions, nutrition facts) from a specific website. - Outputting the scraped data in a well-organized Excel sheet. Ideal skills for this project include: - Proficiency in Python for web scraping. - Familiarity with scraping data from websites. - Excellent organizational and data management skills for outputting the data in Excel. If you can deliver this quickly and efficiently, please feel free to bid.
We require an Excel list comprising 500,000 LinkedIn accounts, each including the login email ID (not contact email), name, and company name. The contacts must meet the following criteria: Title: Owner Location: United States Search Keywords: Restaurant, Automotive Repair, Towing, Tire, Jewelry, Pawn, Automotive, Pools, Boutique, Tile, Heavy Equipment, Chiropractic, Boats, Furniture, Lumber, Granite, Stereo, Trailers Project Deadline: Saturday 7:30 PM ( Indian time zone) To confirm your readiness to commence the project, provide me a minimum of 2000 completed rows that meet the specified requirements.
I'm looking for a programmer to help me build a visa appointment bot for person...primary goal is to automate the task of securing a visa appointment. The Bot: - The bot should be able to navigate a visa appointment booking system, select the appropriate options, and secure an appointment on my behalf. Skills and Experience: - Proficiency in bot programming and automation is crucial. - Experience with task automation and appointment booking is a plus. - Understanding of web scraping and navigation is a requirement. - Attention to detail is important to ensure the bot selects the correct options during the appointment booking process. Please get in touch if you have prior experience with building similar bots or automations, particularly in the context of visa or appoin...
I urgently require a web scraper proficient in extracting data from xing.de. I will provide a file of specific company names, for which I want to obtain the number of employees. Your task will involve: - Gathering accurate and up-to-date data on the number of employees for each company on the list - Formatting the information suitably for my usability. You need to have proven experience in web scraping, particularly on professional platforms such as Xing. Familiarity with German language platforms is beneficial. The deliverable is a neatly formatted file containing company names and their respective employee numbers.
...can help me extract specific data on the results of the Tokyo 2021 Paralympic Games from the official website - The data I require includes: - Athlete profiles - All the results of each competitor - Medal winners The extracted data should be presented in a CSV file format. It should be in a similar format as this dataset on the results of the Olympic games: No specific analysis is needed on the extracted data. Ideal skills and experience for this job include: - Proficiency in web scraping - Experience in data extraction - Expertise in data formatting and CSV files Your professional approach and ability to deliver accurate, complete data will be crucial. Please bid
I need a Python expert with an ability to cover various functionalities as per the need. The project might involve data analysis, web scraping, automation, or could be anything else as per the project requirements. The ideal candidate should have: - Expertise in Python programming and its different libraries. - Experience with data analysis, web scraping, automation. - Strong problem-solving skills. While applying, please share: - Your past work related to Python programming. - Your Python programming experience level. - Detailed proposal of how you can assist in this project.
I am seeking an experienced developer to create a website scraper which is capable of collecting various pieces of data. This savvy tool must be designed to extract from () site: - Text content - Images - Product information - Address - Contact details - Videos It is essential for the scraper to perform its task on a daily basis. Yet, there won't be a need for the gathered data to be automatically integrated into a database. Ideal Skills: - Web scraping - Developing scraping bots - Programming knowledge - Manual data mining expertise Please only apply for this job if you have significant experience in creating web scrapers. This project requires a quick turnaround, so the ability to work under time constraints is key. Let's converse about s...
We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, S...
I'm looking for a web scraper. Your application should include your experience in this field specifically. I'm interested in scraping the following data from a particular website: - Product details - Contact information - Pricing information Please only apply if you have solid experience in web scraping. We will have lots of different webscraping tasks in the following weeks.
I'm looking for a diligent professional who can implement an Internet price research mechanism for the electronic products listed within a .csv file. The deliverable I expect from this project is a separate report containing the price of each ...the price history. Key Responsibilities: - Extracting and updating the price information of electronic products from the Internet, based on the .csv file provided. - Incorporating a detailed report that includes the prices, a link to the retailer's page, and the price history of each product. Skills and Experience: - Proficiency in data extraction, research, and analysis. - Experience with web scraping tools. - Strong organizational skills to present the data in a clear, concise manner. - Prior experience with e-com...
I'm currently experiencing a syntax error within a data retrieval process in my SOAP database management system. This error is interrupting the smooth functioning of my website and application. Requirements: - Extensive knowledge and experience in PHP and SOAP. - Proven track record of successfully resolving syntax errors, particularly within data retrieval processes. - Ability to identify, debug and promptly solve syntax issues. - Ability to work efficiently, ensuring minimal downtime during fixes. Additionally, recommendations for preventing similar issues in the future would be appreciated. The ideal candidate should be available to start as soon as possible.
I'm seeking an individual who can create a one-time web scraper that can collect text, images, and tables from Website 1. The project involves: - Developing a tool to scrape text, images, and tables from the specified website. - Ensuring the tool can operate efficiently for a one-time scraping process. Key Skills: - Proficiency in web scraping tools and techniques. - Experience in scraping text, images, and tables. - Ability to create a custom scraper for a one-time scraping task.
I need a web scraper to extract specific data from various websites. The project will involve: - Identifying the necessary data to be scraped - Building a scraper to extract this data Ideal skills for this job include: - Proficiency in web scraping tools - Familiarity with web data extraction techniques - Ability to work with and extract data from various websites Please provide your quote for this project.
...Seller Data: The main purpose of this project is to gather information about the sellers on the Miravia platform (). This includes the shop_id shop_name Ivl1_cate_name product_number avg_price shipping_duration company_location phone_number email_address vat_number company_name shop_rating shipping_on_time % followers comments etc. I require 10,000 entries of data I require the data to be well-structured and organized into a CSV or Excel file for further analysis. Skills and Experience: - Proficiency in Web Scraping: The ideal candidate should have extensive experience in web scraping and data extraction. - Attention to Detail: Since the project involves gathering a wide range of data points, having a keen eye for detail is crucial t...
I need help with scraping specific information from urls (we will provide). The key details I need are the company name and contact information. Website Phone Email Brand Country Of Origin Total Entries: 1704 No research required, you just need to copy paste information from the fields onto a google sheet.
I'm in urgent need of a PHP developer to create and implement APIs. The API will be utilized by a frontend that's already been designed. ...urgent need of a PHP developer to create and implement APIs. The API will be utilized by a frontend that's already been designed. Key Project Details: - I'm looking for APIs to cater to User authentication, Data retrieval, Data manipulation and allow for file uploads. - The project has an 'ASAP' deadline, so I'm seeking a developer who can start immediately and work quickly without compromising quality. Ideal Candidate: - Proficient in PHP and experienced in API development - Skilled in creating secure and efficient user authentication systems - Capable of executing data retrieval...
I am looking for a professional who has experience in data scraping to extract email addresses of senior level employees in the Building Industry, specifically from the United Kingdom. This task involves collecting the email addresses of 100 senior level employees. Key Requirements: - I need the first name, job title, and email address of each employee. - All the email addresses should be from the United Kingdom. The ideal freelancer for this project should have: - Experience in data scrapping and data mining. - Proficiency in tools and techniques for extracting data from web sources. - Attention to detail to ensure the accuracy of the collected information. - Familiarity with the Building Industry and the job titles associated with senior level roles i...
...and bash scripts for a personal project. This personal project is focused on web scraping. The successful candidate will be tasked with scraping product information, news articles, and social media data. Exemplary knowledge of proxifying requests through nginx and formatting bash scripts that interact with Nodejs applications is a requisite. Mandatory Skills and Experience: - Advanced proficiency in Nodejs - Extensive experience with nginx reverse proxy - Expertise in formatting bash scripts - Proven experience in web scraping, with emphasis on scraping product info, news articles, and social media data The ideal candidate must be able to present a portfolio demonstrating their competence in web scraping using techniques mentioned a...
I have an urgent web scraping task that needs to be completed as soon as possible. This project involves: - Scraping specified data from a list of instagram accounts. The information includes phone number and email of account and also phone number and email of account tagged in the bio description The ideal freelancer for this job should have: - Proven experience in web scraping - Proficiency in handling different types of data (text, images, tables) - An excellent track record of delivering projects on time. Please apply if you have the expertise and availability to tackle an urgent project.
I need a Python developer with a strong skill set in web scraping, database management, and video manipulation to create a code which can easily download videos from personal websites, save them to local web storage, and subsequently update values in an sqlite database. Detailed requirements are as follows: - Download videos specifically from personal websites. - Save videos internally for archiving purposes. - Saved videos should be in AVI format to maintain consistency. - Program should have a functionality of updating an sqlite database with relevant video details upon successful download. Ideal candidate should have a deep understanding of AVI video format handling as well as extensive experience interacting with an sqlite database using python. Familiarity with various d...
I need a freelancer to collect data from online. It is simple job of data search and collection from crowdsourcing website. Would provide spreadsheet with details, all you need to fill the details. We are into venture financing. Job Description: Name LinkedIn profile. contacts (if possible) Attached spreadsheet for your reference. Regards, R
I'm seeking a knowledgeable individual to draft a comprehensive scoping review paper, focusing on the intricacies of 'Information Retrieval' and delving especially into 'Information Behavior.' It's for a forthcoming conference. The paper should: - Provide a robust dissection of 'Information Behavior' within 'Information Science.' - Showcase real grasp of current theories, practices, and future challenges within this arena. - Leverage scholarly style to deliver a coherent and compelling narrative. Ideal Skills: - Knowledgeable in 'Information Science' and 'Information Behavior.' - Robust research skills with data to talk about it - Proficient in academic writing. Link to paper guidelines: Topic: Challe...
I'm looki...Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as they should. This job will evolve into continuous maintenance and development of bot's features. T...
I'm looki...Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as they should. This job will evolve into continuous maintenance and development of bot's features. T...
I'm seeking a proficient individual for constructing an Access database for my project. The principal requirements include: - Experience with Access, as that's the selected database management system. - Expertise in data storage and retrieval is essential. - The database will be storing textual and numerical data. Experience in handling these types of data is crucial. Ideal skills would include an in-depth understanding of Access, database design, data storage/retrieval techniques and knowledge in handling both textual and numerical data. This should make for a streamlined and efficient process. I'm excited for us to kickstart this project together!
...script named “Main script for scraping and filling in a contact ” that executes subordinate scripts. For example, “Main script for scraping and filling in a contact ” might contain… import subprocess # Common base directory base_dir = "~/abc/xyz/" # Run script 1 (["python3", base_dir + "1 of 3 script for scraping and filling in a contact "]) # Run script 2 (["python3", base_dir + "2 of 3 script for scraping and filling in a contact "]) # Run script 3 (["python3", base_dir + "3 of 3 script for scraping and filling in a contact "]) In this example, almost all of your code would have been in… "1 of 3 script for scraping and filli...
I'm in need of a skilled data miner who can help to extract certain details from a vast range of Shopify products. Your mission, if you choose to accept it, is as follows: - list products that contain non-English writing or words in text and videos - Organise and sort these findings for simple review - Identify and list any products filled with non-English language in the description, pictures or images - Compile lists of products that aren’t currently making top-seller lists - List any products can not be delivered in eight days or less. Please note that tractors and food vans may take up to two months to deliver. - List any products that are not suitable for industrial purposes/non-commercial products. Ensure that the products you are considering are meant for commerci...
I need an Excel 365 PowerQuery or VBA script that can fetch daily market data and handle potential data source interruptions or changes. Google Shhets example =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). <Where C31 = Cell containing the Stock eg GB00B8XYYQ86, LU1033663649 or GB00B0CNH163 I need an identical function in MS365 Excel - either with PowerQuery OR VBA (preferable) Ideal skills: - Proficiency in Excel 365 and PowerQuery and VBA - Experience in web scraping and handling dynamic data sources. I am after a fixed quote for this project.
I'm seeking a skilled JavaScript developer with experience in to assist with my current project. The task at hand involves integrating our front-end with MongoDB Atlas to create a live search bar for machine parts. Key Responsibilities: - Connect framework with MongoDB Atlas to enable real-time data retrieval for live search functionality. - Implement a user-friendly, intuitive search bar that allows for quick and efficient product searches. - Develop a product display page that showcases detailed information about the machine parts. Ideal candidates for this position should: - Be proficient in JavaScript and have prior experience working with Next.js. - Possess a solid understanding of MongoDB Atlas or a similar NoSQL database. - Have a keen eye for design and UX
