How to build web crawlercông việc

Thuê người viết code và tư vấn giúp mình dung lượng để chạy web truyện tranh crawler 1 web chạy code ko cần sql data base khi chạy code tự cập nhật truyện tranh theo site sẵn có

Bên mình có website của khách hàng về trang tin điện tử. Hiện tại dữ liệu website đang rất lớn gần 50k tin. Mình đã thử tăng cấu hình vps, sử dụng cdn nhưng tốc độ tải trang vẫn rất chậm tới 15 giây. Website dùng VPS như sau: CentOS 6.8 + nginx + mysql (mariadb), 1-2 cores CPU, 2-4 GB RAM, ổ cứng SSD Mã nguồn website: Wordpress + tool quét tin WP Content Crawler Qua tìm kiếm trên google mình thấy nhiều nơi khuyên website dữ liệu lớn cần tách database làm 2 phần: đọc và ghi riêng Vậy, theo mình công việc sẽ là tách database thành 2 phần riêng: phần đọc và ghi riêng để tăng tốc độ tải trang Ho...

nói tiếng Việt cho lẹ. Em là sinh viên năm 3 tự động hóa, em từng học rất giỏi (top 1% cả nước) nhưng vì em thấy học đại học không hứng thú và cũng không có định hướng tốt. Em cần người đi trước định hướng giúp em. Anh chỉ cần cho em lời khuyên và dành thời gian chỉ dạy em 2 giờ mỗi tuần. Em trả anh 10$ mỗi giờ (tiền em tự kiếm không có nhiều mong anh chấp nhận)

nói tiếng Việt cho lẹ. Em là sinh viên năm 3 tự động hóa, em từng học rất giỏi (top 1% cả nước) nhưng vì em thấy học đại học không hứng thú và cũng không có định hướng tốt. Em cần người đi trước định hướng giúp em. Anh chỉ cần cho em lời khuyên và dành thời gian chỉ dạy em 2 giờ mỗi tuần. Em trả anh 10$ mỗi giờ (tiền em tự kiếm không có nhiều mong anh chấp nhận)

Hi Nima D., I noticed your profile and would like to offer you my project. We can discuss any details over chat.

Hi Nima D., I noticed your profile and would like to offer you my project. We can discuss any details over chat.

I am looking for an expert who could develop an extensive video course aimed at new dog owners centered around puppy training. Preferably, someone who has a deep understanding of puppy's behavior, obedience, and training techniques. The video course must be: - Comprehensive and easy-to-understand - Booked with informative content, techniques, and tips The final product must: - Be a downloadable file - Be thorough but also designed for beginners Ideal candidate will have: - Extensive knowledge in dog training, especially in puppy training - Background in creating educational courses or materials - Excellent communication and instructional skills

I am looking for a Python experienced person capable of creating a web scrapper that can extract text content from Aliexpress and then categorize these extracted data into a Google Sheet in a specific format. Crawler in python format. Thanks. Please provide a sample

I'm looking for a talented professional who can create a substantial number of quality backlinks for my website. Key Requirements: - The primary aim is to improve website visibility. The backlinks should therefore support this goal directly. - You're encouraged to get creative and leverage your expertise to deliver the best results possible. Ideal Skills & Experience: - Proven experience in creating backlinks - Understanding of SEO best practices - Strong communication skills - Ability to work within a limited budget The type of websites the backlinks should come from is not specified, so you have the flexibility to make choices based on your expertise and experience. Your work will be highly appreciated and you can expect awesome fee...

I'm in need of a talented animator who can create an engaging 2D animated clip that explains the mechanism of molecules in hair. This clip will be used for marketing purposes and should be aimed primarily at adults. Ideal skills and experience for this project include: - Proficiency in 2D animation and motion graphics - Understanding of molecular concepts (particularly in relation to hair) would be advantageous, but not essential

I require a series of instructive videos, each less than 5 minutes, showcasing individual tasks via the o...co/transcribe/. The ideal freelancer will be skilled in creating clean, engaging video guides like the one seen here - Each video needs to: - Feature one specific task per video - Adopt a step-by-step guide approach - Have professional English language voiceover explaining each step Experience in creating 'how-to' videos specifically for software or online tool usage will be preferred. Knowledge of video editing tools and comfortable narrating in clear, concise English is essential. It would also be advantageous if you have previously created content related to transcription or notetaking apps, though this is not a strict requirement.

...developer who can create a coupon code aggregator website similar to retailmenot.com. The key feature of this project is the integration of a web crawler that will search and gather coupon codes from various online sources. Key Requirements: - Development of a coupon code aggregator website - Integration of a web crawler that will search for coupon codes on a daily basis - A search bar where users can enter websites like they are browsing normally and coupon codes will be applied similar to how microsoft edge or Honey does it - The website should have the functionality to automatically apply coupon codes to a shopping cart - Ability for users to sign up and receive daily coupon codes and deals - Ability for the webs...

1.I would like no less then 90-100 on-page speed insights for desktop and mobile. 2. Book now Contact form submission under 10 seconds. 3. Receive emails once the booking form has been completed. 4. Check & provide a report that all coding has been done correctly on the website. 5. Fix all errors in the attached GT Metrix report Please provide me with exactly how you will achieve these 5 points as generic messages regarding this job will not be awarded. Payment will be broken up into 3 milestones points 1-2, 3-4, 5 Do not apply if you cannot achieve my work standards.

We are a group of developers. We need a webRTC expert to give us guide and assistance of how to integrate our AI model into the Odoo 16 webRTC. We have already build the AI model, the webservice and endpoint to commnicate with it and everything related to the AI. So far we have a module that connects with our AI server, everytime an odoo channel is created it reviews the messages, sends it to the AI and creates a new message in the channel that acts as a reply To achieve this we follow the next structure: 1) redefine create on 2) send message body to IA 3) get message and post a message on the channel So far this works on internal chats, but we want this to work on live chat sessions, the idea behind this is that t...

Hi I need to very basic example on how to call a rest api from Aveva using a put command. It should be build importing .net libs.

I am seeking an experienced SEO article writer who understands and has a working knowledge of AI systems like Chatgpt and Gemini. Your articles must be original, Google SEO...Requirements & Expectations: - Must have SEO writing experience and a solid understanding of AI systems like Chatgpt and Gemini - Highly creative and capable of creating engaging, informative content to capture readers' attention - Strong research capabilities to support writing original, high-quality articles - Must ensure all articles are indexed by Google Please note that the exact quantity and purpose of the SEO articles are not specified at the moment, it will be discussed with the selected freelancer. Your bid should reflect your rates per article, given they exceed 1,000 words. Looking ...

...professional animated video to serve as an explainer. This video should have a How-to guide format, providing clear, concise and engaging directions on a particular topic. Key Details: - Purpose: The video will primarily serve as an explainer for a specific process or concept. - Message: The focus should be on delivering a step-by-step guide for the target audience to follow. - Audience: The video is designed for professionals, so the tone and content should be suited to this demographic. Your Skills: - Prior experience in creating explanatory animated videos is required. - A deep understanding of how-to guide formats and the ability to deliver complex information in a clear, engaging manner. - An understanding of the pro...

i need a backend preferably in nodejs. one endpoint. that submit some birh date data. then the backend should request the html from anotherwebsite, fill its form click on submit get the data and send them

Generate Exe from Python Source Code and How to Backup Files from Pythonanywhere. I need someone who can just put the Icon on the Code of Python and generate the EXE from Python Code and also how to backup all files from PythonAnywhere.

Hi Azabache Producciones , As previously discussed we'd like th..., As previously discussed we'd like this video edited in a similar style to Matt Starky's :// I have provided a Guide Edit for timings and rough placements. A clean 4K resolution hosted recording - with same timings as the Guide. I've also included all screenshots and stock within the Guide Edit, but am open to you suggestions if you think other images or graphics might be better. Please let me know if there is anything missing. We'd like the design to fit on a page like this https://www.freelancer.com/ai-for-business so tonally and colour wise it should feel like it belongs to this page.

I'm looking for a talented...illustrative Instagram graphic for my latest blog post titled "How to Get Your Business Phone Registered to Avoid Spam Labels". Key Requirements: - Minimalistic Design: The graphic should be clean, simple, and in line with a minimalistic aesthetic. - Illustrative Style: I'm looking for an illustration rather than a photographic or typographic design. - Business/Communication Elements: Incorporating telephone or mobile icons into the design is a must. The design should subtly communicate the main theme of the blog post without being overly busy or cluttered. The winner will be asked to provide a Canva template, so please design your samples in Canva. Here's the blog post:

More details: Is this project for business or personal use? This question was skipped by the user What information should successful freelancers include in their application? Past work How soon do you need your project completed? ASAP

hello, i am looking for a teacher who can teach me how to use AI Technology for changing face - AI Technology, Free apps - Purpose = i want to make 5 minutes video, only to input to my zoom backround so that i can change my face for zoom meeting attending only. It is not for heavy editting. how we work - Teach me Via Zoom ( 0ffcam) , 30 minutes and share screen, show me how to do it

...seeking a freelancing whiz who could use an AI to accurately reproduce the melody of "How Bizarre" by OMC but with my specially written lyrics on sewage pollution. Here are the specifics: - Outcome: I'm keen to have an exact musical replica of "How Bizarre", but with my twist of sewage pollution lyrics. - Vocal style: The AI must be able to mimic the original vocal style as it beautifully blends with the song – try to keep it as similar to the OMC original as possible. - Time Frame: My need is immediate, so the faster you can generate this, the better! Ideal Skills: - Proficiency in artificial intelligence, particularly in the field of audio or music generation. - Previous experience with a similar projec...

I am looking to have a web app built, complete with user registration and login, A user profile, a way for consumers to pay and their own user profile also to track their payments and commenting features. Yet, we need to go beyond the basics: - Implementation of user-profiles and preferences, allowing for a personalized user interface. - Payment gateway integration, facilitating smooth and secure transactions. - Order tracking feature, keeping both the business and the client aware of the order status at all times. The primary audience for this web app is individuals and businesses searching for a comprehensive drip feed membership platform. Therefore, experience in e-commerce and membership solutions would be particularly beneficial. If you hav...

I'm looking for an experienced crawler specialist to help me crawl databases, and specifically collect certain datasets. Key Project Requirements: - Crawler Type: The focus for this project will be on databases, not websites or APIs. - Objective: The primary goal is to extract specific datasets from these databases. - Data Format: The extracted data should be delivered in CSV format. Ideal Skills and Experience: - Proficiency in database crawling and data extraction is a must. - Previous experience in collecting specific datasets from databases is highly preferred. - Familiarity with working with CSV data format. Please share relevant experience when bidding.

I'm looking for a broker who knows how to find collectors, I work on a percentage basis.

I'm seeking a meticulous and experienced professional in Octoparse to construct a responsive web crawling template. This crawler will be solely focused on an eCommerce platform, aiming to capture extensive product information. Key Responsibilities: - Capture specifics like the URL, category, and SKU for every product. Ideal Candidate: - Knowledgeable in Octoparse. - Proven experience in data mining and web crawling. - Detailed understanding of eCommerce platforms and product specifications. - Ability to maintain precision across multiple product categories and large datasets. I look forward to seeing your proposals and discussing this project further with you.

Hi. I have an app that is becoming very popular. We created videos on how to do certain things with the app to help users get started. The videos are now out of date. We would like to have a professional video created, (preferably with out spoken words), to accurately describe how to accomplish certain tasks within the app. We anticipate each video will be 1 to 2 minutes long. We want to start with one video to see how this goes, but could definitely use 12 or more to accurately help users. The app is for golfers and golf tournament managers. Fairly straight forward, but also powerful and can be complex. It's on iOS and Android, and also the web.

I'm looking for an experienced web crawler developer to build a tool for me. This tool needs to be able to extract text content and links from various websites. I need data from the whale watch section of The full crypto address within the links should be associated with their name counter part in a spreadsheet or organized file. I have included a highlted picture demostrating the fields I need. They should be done for the full 6 pages. Requirements: - Experience: Please detail your experience in web crawling and provide examples of previous work. - Delivery: The extracted data should be delivered in a spreadsheet file. It's crucial for the freelancer to have in-depth knowledge of web scraping and data extrac...

chocolate shop, elegant, passionate

I am seeking a skilled writer to create a comprehensive E-book aimed at couples planning to have a baby. This book will focus on maintaining a healthy intimate relationship without harming the pregnancy. -The book should contain 50 to 60 pages supported by pictures. Key Content: - Emotional Connection: The guide should delve into the significance of maintaining a strong emotional bond during pregnancy. It should offer practical tips and advice to help couples navigate the emotional challenges that may arise during this period. - Physical Intimacy: The book should also explore the topic of physical intimacy during pregnancy. The content should be sensitive and informative, providing guidance on how to enjoy an intimate relationship while ensuring t...

I am seeking an expert to build a web crawler specifically suited for extracting a broad range of data from social media platforms. The unique objective of this project is to efficiently and accurately amass textual content, images, links and more from social media sources. Specifically, the project will revolve around: - Gathering user posts and related content - Documenting user interactions, encompassing likes, comments, and shares - Extracting comprehensive details from user profile Ideal candidates for this project will have: - Proven experience in Data Extraction and Web Crawling - Knowhow of Social Media platforms and their structure - Proficiency in programming languages used for web crawling - Excellent attention to...

I would like to design standard operating procedure (rules of lead engagement) based on large medium and enterprise segments- 1) how should sales consume the leads once a lead is assigned to the sales reps. 2) Define the stage movement timeline from one stage to another in salesforce based on which stage the lead is in. 3) How long to wait to send a follow up email /call after the two way connection has been established. 4) Reason to close or recycle the lead 5) Activities logged in salesforce. etc.

I am seeking an expert capable of creating a highly detailed and intricate graphic line art rendition of a lattice boom crawler crane with a luffing jib (two independently controlled booms). This rendition must strictly capture the exterior features of the equipment ( there's a lot). Your focus should also be on all the components that make up the crane. I am open to starting with a more basic line art (outline) and seeing what we need to add. This would be the first design for a construction apparel line You need to have a meticulous eye for detail and at least have a portfolio that showcases any automotive art.

I'm in need of a skilled graphic designer who can help me with character animation in a 3D setting. We're looking to create an engaging animation incorporating a character. The level of detail we're aiming for is medium, including textures. Key Responsibilities: - Create a character animation in 3D - Incorporate medium-level details with textures into the design Ideal Skills: - Proficient in 3D character animation - Skilled in applying medium-level detail with textures - Experience with graphic design, specifically in character animation - Ability to bring creative ideas to the animation process

...of creating a customized web crawler for eBay and AliExpress. The primary function for this crawler will be to accept a list of keywords of any length and return specific data about those products. Here's what I need in detail: • Find top hot selling products at any given time • Crawl eBay and AliExpress for specific product data based on entered keywords. • The data retrieved should include product names, quantities sold and locations of sellers, images, • The crawler should be capable of providing this information for a variable timescale, ranging from 1 to 30 days in the past. • The results should be sortable. Php or python preferably The task would best suit a freelancer with previous experience design...

More details: What type of users will be using this web-based application? home users What specific graphic objects are you referring to? Shapes, Icons How many variations of tables (rows and lines) are you expecting to have in the application? Less than 10 functuanality: a) personal data input b) selection of graphic objects (tables with symbols) and their variations c) selection of different objects witin the table d) all time log of selections e) export of data to pdf or jpg . Freelancer will be provided with an example of the table (pdf) which has to be coded .

I'm looking for a skilled professional who can crop the complete content of a website and save it in a zip file to be deployed on a new server. The website is a small Wordpress with about 41 pages (as per sitemap). Content must not be saved as Wordpress, but static html to be deployed on another server. Key Requirements: - Crop all website content including subpages. - Save the cropped content in a compressed zip file. - The purpose of this cropping is to save the content for future use. - all files must be included, esprecially but not limited to images, js, css, ... - inner paths must be relative paths. If you're confident in your ability to deliver this and can ensure all the content is correctly saved, please bid accordingly. IMPORTANT ...

I'm looking for an expert to make minor modifications to a Figma design. Specifically, your task would be to add a "How this works" section to both the web and mobile view design. Note - The theme is there along with relevant info, you just need to create "How this works" that include 3 steps only. Need just design only nothing else. It is an hour work max. Skills: - Proficient in Figma

We are looking for digital marketing company or freelance who can work part time to prove men enlargement product leads from adult site cpl bases fix rate 0.40 dollar minimum leads required 50

I'm looking for an expert to design a web crawler to extract email addresses from specific company websites. The ideal candidate should be experienced both in web crawling and email data extraction. Key Tasks: - Crawl targeted company websites for email data extraction - Ensure the accuracy and integrity of all extracted emails Skills and Experience: - Experience with web crawling and data extraction technologies - Proven track record in email data extraction - Excellent analytical and problem-solving abilities - Familiarity with common web interrogatories for more efficient data capture is an asset - Strong attention to detail in order to capture complete and valid email addresses The successful candidate will deliv...

Gday again mate. I have another project for you. You know what to do. Turn it into a fun looking document with your super awesome doodle drawing etc. Thank you

MUST HAVE: profound Webflow knowledge

...the project lead, I'm seeking a highly skilled developer to construct a Scrapy web crawler for multiple sites. Although I omitted website specifics for now, rest assured we will provide the necessary details post-engagement. The ideal candidate is capable of: - Building an optimized web crawler with Scrapy - Extracting text data proficiently from various web pages, accurately and efficiently For the application, please provide: - Detailed project proposals outlining your approach Experience in web crawling design and Scrapy framework are a must for this project. Your technical capacity to generate the explained particulars is critical for success here. This is a golden opportunity to exhibit your proficiencies an...

More details: Which specific tools or features from 'power ad spy' do you require for this project? Ad performance analytics, Competitor ad tracking, Ad campaign recommendations What information should successful freelancers include in their application? Experience What type of report format do you prefer? PowerPoint presentation

I'm looking for a freelancer to provide me with advice and guidance on how to start my freelancing career. I'm interested in understanding the basics of the freelancing industry, how to find clients, how to create a professional profile, and how to present my skills and services. Ideal Skills and Experience: - Proven expertise in freelancing - Excellent communication skills - Ability to provide clear, actionable advice - Experience in the same industry as mine, if possible.

... More specifically, I need you to integrate logistics and operations management into this research. Key Requirements: - Research on how logistics and operations management practices are contributing to climate change. - Explore how these practices can be altered to have a positive impact on the regional environment. - Provide insights and recommendations on potential changes that businesses can implement to address climate change. - The report should be comprehensive and data-driven. Ideal Skills and Experience: - A background in environmental studies or climate change research. - Experience in operations management would be beneficial. - Strong research and report writing skills. - Understanding of the regional implications of climate change....

...looking for a skilled copywriter to help increase the brand awareness for my company. The copywriting will be targeted to professionals aged 26-40, so having an understanding of this demographic is crucial. Idealofessionals aged 26-40, so having an understanding of this demographic is crucial skills and experience for this job ofessionals aged 26-40, so having an understanding of this demographic is crucialinclude: - Proven experience in copywriting - Understanding of how to tailor messages to specific target audiences - Ability to write in a formal and professional tone - Familiarity with creating brand awareness campaigns Your work will be instrumental in helping my company's growth and exposure. Please provide samples of your previous...

Explain how we get from the layout screen in blender to a rendered line view as shown at the samples.