Craigslist perl crawlercông việc
Tôi có một file viết bằng ngôn ngữ perl muốn chuyển về ngôn ngữ php. File perl mẫu được đính kèm theo. i have a perl script. i want convert to php.
Thuê người viết code và tư vấn giúp mình dung lượng để chạy web truyện tranh crawler 1 web chạy code ko cần sql data base khi chạy code tự cập nhật truyện tranh theo site sẵn có
Lập trình một file *.pl để đọc và xuất ra cột theo từng yêu cầu cụ thể. Vui lòng xem file đính kèm để biết thêm thông tin chi tiết.
Bên mình có website của khách hàng về trang tin điện tử. Hiện tại dữ liệu website đang rất lớn gần 50k tin. Mình đã thử tăng cấu hình vps, sử dụng cdn nhưng tốc độ tải trang vẫn rất chậm tới 15 giây. Website dùng VPS như sau: CentOS 6.8 + nginx + mysql (mariadb), 1-2 cores CPU, 2-4 GB RAM, ổ cứng SSD Mã nguồn website: Wordpress + tool quét tin WP Content Crawler Qua tìm kiếm trên google mình thấy nhiều nơi khuyên website dữ liệu lớn cần tách database làm 2 phần: đọc và ghi riêng Vậy, theo mình công việc sẽ là tách database thành 2 phần riêng: phần đọc và ghi riêng để tăng tốc độ tải trang Ho...
Chào Tuấn, Mình có thể nói chuyện trên skype về Perl skill của bạn k ??? Add mình nhé :
Mình muốn tìm thuê một người có khả năng thiết kế và sửa lỗi một chương trình được viết bằng ngôn ngữ Perl. Yêu dự án : Tìm câu đối xứng giữa tiếng việt và tiếng trung. Hiện tại bên mình đã có code tìm câu đối xứng giữa tiếng trung và tiếng anh, nên bây giờ theo yêu cầu của dự án, các bạn sửa đổi giúp mình. Các bạn ai có khả năng thực hiên thì liên lạc theo hòm thư sau : ,yahoo: nguyenhanhtn85 (liên lạc trực tiếp), hoặc thông qua sđt: 01693009137. để trao đổi thêm các thông tin, cũng như thương lượng giá cả .
As someone requiring assistance with craigslist postings, I'm specifically looking for an expert who's in tune with financial service postings, particularly under the category of credit repair. The emphasis of this project is credit counseling. Your expertise should ideally cut across the following: - Deep experience in creating engaging and effective craigslist postings - Background in financial service postings, specifically credit repair - Solid understanding of credit counseling language and how to appeal to targeted clients - Superior communication skills, being able to capture complex concepts in easy-to-understand postings. Your application will stand out if you are able to demonstrate a history of success in these areas. I look forward to your proposals...
I'm in need of a web crawler that can extract specific data from a large online ads website. The extracted data should then be neatly exported to a Google Sheet. Key requirements: - The crawler should not be intrusive to the host website. - I want the crawler to crawl current and expired ads based on links present in the site map, as historic data is also of importance to me - You should be able to provide a way for me to run this crawler myself at any time - ideally on a monthly basis. I haven't yet decided on the precise fields to be extracted. I'm looking for someone with the skills to recommend suitable fields that could be beneficial for my project. It's important that the extracted data is organized and easily readable once exporte...
I'm in need of a talented professional who can help me with a custom web crawler project. Key Requirements: - **Web Crawler Customization:** The ideal candidate will need to adapt an existing web crawler code to include specific features I require. This includes the ability to extract and filter data from multiple websites. - **Data Management:** I expect the total scale of the data to be relatively small, so the freelancer should have experience handling data sets of this size. - **Data Analysis:** After the information is extracted, I intend to use it primarily for data analysis. The freelancer should have a good understanding of how to structure data for this purpose. Ideal Skills & Experience: - Proven experience in customizing web crawlers and managing...
We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including breadcrumbs for hiera...
I'm looking for a professional web developer to help me build a platform that will serve as a combined social media, e-commerce, and membership site. Key Features: - **Membership Site**: - User registration and login. - Content access control. - Discussion forums. - Should be automated like Craigslist. - **E-commerce Integration**: - Tie-ins with PayPal for ad orders and other services. Content Types: - **Text and Images**: Regular textual and image-based posts. - **Videos**: Capability to upload and view videos. - **Audio Files**: Ability to upload and listen to audio. The ideal candidate for this project should have: - Strong experience in building complex, user-centric membership and e-commerce sites. - Proficiency with integrating payment gateways, espec...
I am in need of a skilled programmer to create a bot, effectively able to filter out vehicle listings and send them directly to me on whatsapp , twillio etc (any) Key Responsibilities: - The bot should primarily use Craigslist, OfferUp, and Facebook Marketplace platforms for sourcing listings. - The bot should filter vehicle category listings exclusively. Vehicle Filtering Criteria: - Vehicle make and model - Year range - Price range - Distance Ideal Skills: - Experience with bot programming and development - Familiarity with Craigslist, OfferUp, and Facebook Marketplace APIs - Understanding of the automobile market, specifically characteristics and identifiers - Proven track record of creating bots that can quickly and effectively filter search resul...
I am looking for a Python experienced person capable of creating a web scrapper that can extract text content from Aliexpress and then categorize these extracted data into a Google Sheet in a specific format. Crawler in python format. Thanks. Please provide a sample
I'm looking for a skilled developer who can create a coupon code aggregator website similar to retailmenot.com. The key feature of this project is the integration of a web crawler that will search and gather coupon codes from various online sources. Key Requirements: - Development of a coupon code aggregator website - Integration of a web crawler that will search for coupon codes on a daily basis - A search bar where users can enter websites like they are browsing normally and coupon codes will be applied similar to how microsoft edge or Honey does it - The website should have the functionality to automatically apply coupon codes to a shopping cart - Ability for users to sign up and receive daily coupon codes and deals - Ability for the website admin to be able to add ...
I'm seeking a skilled software developer to join our dynamic IT team. The ideal candidate will possess expertise in Perl, Python, and XML/XSLT, and should be familiar with MySQL. Responsibilities: Develop And Maintain Software Applications Using Perl, Python, XML, XSLT, And Database Technologies. Design And Implement Data Transformation Processes Using XML And XSLT. Write Efficient, Clean, And Reusable Code That Complies With Company Standards And Best Practices. Collaborate With Project Managers, Business Analysts, And Other Team Members To Understand The Requirements And Provide Technical Solutions. Perform Database Management Tasks, Including Design, Modifications, And Performance Tuning. Assist In The Integration Of New Software And Systems Into Existing Environmen...
i need a backend preferably in nodejs. one endpoint. that submit some birh date data. then the backend should request the html from anotherwebsite, fill its form click on submit get the data and send them
...am looking for a PERL, HTMX, MYSQL programmer who can help me with an intermediate level project. The ideal candidate should have experience in these areas and be comfortable starting a project from scratch. I will give you a dump from my MySQL table. From which I need an interactive HTML interface, based on Perl, HTML, HTMX to this table. I need to be able to search, add, edit and delete entries as well as combine two entries into one, all via one HTML::Template file with a single perl script as interface to the MySQL table. I do want an active submit button for all changes, as well as a single interactive upload button for each field of the MySQL table. also each field needs to be validated via a given specification. All code needs to be well documented and commen...
I have a Perl script that searches a CVS file and generates HTML. When this script has zero results, it currently displays a page stating "SORRY there are no RESULTS". I need this behaviour to change: instead of generating a custom error message, I want the script to send a 404 call to the Apache server. Key Requirements: - Modify the Perl script to send a 404 call to the server when no results are found. - Implement a custom error message to be displayed on the 404 error page. Additional Details: - No logging of details of 404 errors is required for monitoring or debugging purposes. - The script should still function as normal when results are found, only altering its behaviour when no matches are found. - The ideal candidate for this project should have experien...
...that targets both local residents and tourists. The plan should aim to engage both groups effectively. - The plan should be focused on direct results, with the primary goal being to drive more bookings for our business. Key Platforms: - Social Media: Utilize platforms like Facebook and Instagram to reach out to potential customers. - Online Community Boards: Utilize platforms like Nextdoor and Craigslist to tap into local communities and attract bookings. - Local Event Listings and Forums: Target local event listings and forums to promote our services and attract interested parties. Ideal Skills: - Experience in developing and implementing successful marketing and promotion plans, particularly within the tourism sector. - Strong knowledge and hands-on experience with social med...
I'm looking for a skilled Perl expert to help me remove duplicates in an Excel dataset. The removal process should be based on multiple columns, ensuring a thorough cleanup. Ideal Skills & Experience: - Strong proficiency in Perl programming - Proficiency in data analysis - Expertise in Excel and handling large datasets - Prior experience in removing duplicates from Excel based on multiple columns Communication: I prefer to have project updates through video calls, so please be comfortable with this form of communication. Your ability to walk me through the process will be highly appreciated.
I'm having issues with a specific user function in my Pgsql ( postgresql 8.4) database that needs fixing. After transferring server and DB from real PC to the VM, ... 1365 | 1365 32645239 | ADMIN | _util_update_stat | 27 | 37511 | 37511 calls And new doesn't have any calls of _util_update_stat at all which makes Stats table empty You need to track why is this happening & fix it. Server is a bunch of scripts, but seems it doesn't matter cause all scripts just READ this stats table (i guess) Pgsql expirience is a must Perl expirience is a plus. Plz no "manager" bids, don't waste your time, will talk with developers only. (if you are a "manager" it will be seen after the 2nd tech question Plz don't wa...
I'm looking for an experienced crawler specialist to help me crawl databases, and specifically collect certain datasets. Key Project Requirements: - Crawler Type: The focus for this project will be on databases, not websites or APIs. - Objective: The primary goal is to extract specific datasets from these databases. - Data Format: The extracted data should be delivered in CSV format. Ideal Skills and Experience: - Proficiency in database crawling and data extraction is a must. - Previous experience in collecting specific datasets from databases is highly preferred. - Familiarity with working with CSV data format. Please share relevant experience when bidding.
I'm seeking a meticulous and experienced professional in Octoparse to construct a responsive web crawling template. This crawler will be solely focused on an eCommerce platform, aiming to capture extensive product information. Key Responsibilities: - Capture specifics like the URL, category, and SKU for every product. Ideal Candidate: - Knowledgeable in Octoparse. - Proven experience in data mining and web crawling. - Detailed understanding of eCommerce platforms and product specifications. - Ability to maintain precision across multiple product categories and large datasets. I look forward to seeing your proposals and discussing this project further with you.
I'm looking for an experienced web crawler developer to build a tool for me. This tool needs to be able to extract text content and links from various websites. I need data from the whale watch section of The full crypto address within the links should be associated with their name counter part in a spreadsheet or organized file. I have included a highlted picture demostrating the fields I need. They should be done for the full 6 pages. Requirements: - Experience: Please detail your experience in web crawling and provide examples of previous work. - Delivery: The extracted data should be delivered in a spreadsheet file. It's crucial for the freelancer to have in-depth knowledge of web scraping and data extraction. The tool should be efficient and robust, capable
I am seeking an expert to build a web crawler specifically suited for extracting a broad range of data from social media platforms. The unique objective of this project is to efficiently and accurately amass textual content, images, links and more from social media sources. Specifically, the project will revolve around: - Gathering user posts and related content - Documenting user interactions, encompassing likes, comments, and shares - Extracting comprehensive details from user profile Ideal candidates for this project will have: - Proven experience in Data Extraction and Web Crawling - Knowhow of Social Media platforms and their structure - Proficiency in programming languages used for web crawling - Excellent attention to detail and a commitment to accuracy. If ...
I am seeking an expert capable of creating a highly detailed and intricate graphic line art rendition of a lattice boom crawler crane with a luffing jib (two independently controlled booms). This rendition must strictly capture the exterior features of the equipment ( there's a lot). Your focus should also be on all the components that make up the crane. I am open to starting with a more basic line art (outline) and seeing what we need to add. This would be the first design for a construction apparel line You need to have a meticulous eye for detail and at least have a portfolio that showcases any automotive art.
I'm looking for a proficient developer capable of creating a customized web crawler for eBay and AliExpress. The primary function for this crawler will be to accept a list of keywords of any length and return specific data about those products. Here's what I need in detail: • Find top hot selling products at any given time • Crawl eBay and AliExpress for specific product data based on entered keywords. • The data retrieved should include product names, quantities sold and locations of sellers, images, • The crawler should be capable of providing this information for a variable timescale, ranging from 1 to 30 days in the past. • The results should be sortable. Php or python preferably The task would best suit a freelancer wit...
I'm looking for a skilled professional who can crop the complete content of a website and save it in a zip file to be deployed on a new server. The website is a small Wordpress with about 41 pages (as per sitemap). Content must not be saved as Wordpress, but static html to be deployed on another server. Key Requirements: - Crop all website content including subpages. - Save the cropped content in a compressed zip file. - The purpose of this cropping is to save the content for future use. - all files must be included, esprecially but not limited to images, js, css, ... - inner paths must be relative paths. If you're confident in your ability to deliver this and can ensure all the content is correctly saved, please bid accordingly. IMPORTANT READ THIS: Auto-generated bids wil...
I'm looking for an expert to design a web crawler to extract email addresses from specific company websites. The ideal candidate should be experienced both in web crawling and email data extraction. Key Tasks: - Crawl targeted company websites for email data extraction - Ensure the accuracy and integrity of all extracted emails Skills and Experience: - Experience with web crawling and data extraction technologies - Proven track record in email data extraction - Excellent analytical and problem-solving abilities - Familiarity with common web interrogatories for more efficient data capture is an asset - Strong attention to detail in order to capture complete and valid email addresses The successful candidate will deliver a list of valid emails extracted from the indicated c...
As the project lead, I'm seeking a highly skilled developer to construct a Scrapy web crawler for multiple sites. Although I omitted website specifics for now, rest assured we will provide the necessary details post-engagement. The ideal candidate is capable of: - Building an optimized web crawler with Scrapy - Extracting text data proficiently from various web pages, accurately and efficiently For the application, please provide: - Detailed project proposals outlining your approach Experience in web crawling design and Scrapy framework are a must for this project. Your technical capacity to generate the explained particulars is critical for success here. This is a golden opportunity to exhibit your proficiencies and contribute to an exciting project. - The sites...
Private Project for Omar S. I'm urgently looking for a well-versed Python developer who can efficiently perform web scraping tasks on an unspecified website. While the exact platform has not been mentioned, you should be comfortable with scraping from popular sites like Amazon, eBay, or Craigslist. **Job Outline:** * Extract unspecified data from the assigned website **Required Skills:** * Excellent Python programming skills * Strong web scraping experience * Familiarity with extracting data like product names, prices, or reviews foremostly from popular commercial platforms As I need this project completed as soon as possible, an ability to adhere to strict deadlines is key. Your punctuality, combined with your professional skill set, will make you an ideal fit for this...
...create an iconic logo for our American Football League. I attached our current design in the attachements is a football and our state called Baja California Mexico but this design is to simple made. I am in a bit of a rush as it's required ASAP. Here are the details of the project. Logo Words: LIFA BC Competition Logo: ://://www.facebook.com/oefabc/&docid=bW04nRkl5sarEM&w=1631&h=1631&hl=en-US&source=sh/x/im/m1/3&kgs=944815503abde356&shem=abme,trie Key Design Elements: - Main Colors: Blue, Yellow, and White. Certainly, the combination should reflect intensity, energy and teamwork. Ideal Candidate: The perfect freelancer will have a significant
I require an IAM role with specific permissions to interact with s3, glue, and Athena on AWS. This role will allow for efficient management of the AWS stack, specifically enabling the creation of a crawler to populate a glue catalog database and tables, and also allowing interaction with an Athena workgroup. What I need: - Read-only access: This permission should allow the IAM role to view S3 bucket contents, view Glue catalog information, and view Athena workgroup details. - Write access: This level of permission should enable the IAM role to create or update tables in the Glue catalog and modify Athena workgroup settings. Ideal Experience and Skills: - Solid understanding of IAM roles and permissions on AWS - Experience with AWS s3, Glue, and Athena - Capability to work on AWS I...
I need an experienced and proficient website crawler who can help me extract Text content from Database Tables on my website. Key requirements: • Acing in finding, fetching, and structuring data. • Proficient in delivering the retrieved data in Plain text format. • Emphasis on fetching Text content from the Database Table, thus understanding of database structures is a must. Ideal skills include web scraping, data mining, and database understanding. It would be best if you had an eye for detail as accuracy is key in this project. With your expertise, you should be able to navigate through complex website layers to get to the desired content.
I'm in need of a skilled freelancer who has expertise in Perl scripting, primarily for file manipulation tasks. Key Requirements: --Gather date from a table in oracle. Based on that date find the records available in a home directory and store it in a .txt file. Skills and Experience: - Proficiency in Perl scripting is a must. - Experience in handling various file formats, specifically .txt and .csv. - Strong understanding of file operations including renaming, formatting, and sorting (although the specific task was skipped). I need the code done within 2 days and willing to pay 3000 which would be double the cost of what is given .
We are in need of a knowledgeable and skillful programmer who can edit on GoLang code. The main task involves Ethereum network crawling. We already have a running code to crawling the Ethereum network. However, we still need to do some changes on GoLang code (designing crawler), such as partition the ID_space into sections, and crawl using multiple crawlers in Ethereum not only single crawler as what we have. In addition, there might be more few changes on the code. The ideal candidate will: - Understand DHT-based network and Kademlia - Knows a little about Ethereum (blockchain) - Have experience in GoLang - Possess a deep understanding of DHT network crawling (p2p) - Have previous experience with crawling networks Your responsibility will be building on top of running code...
I'm currently using PERL 5.10 system and requires a proficient expert to aid in modifying how passwords are hashed in my system. Initially, we employed SHA-256 but we're looking to switch to PBKDF2. Ideal Skills and Experience: - Proficient in PERL 5.10 - Familiarity with SHA-256 and PBKDF2 hashing methods - Prior experience in password re-hashing Task Objectives: - Identify current SHA-256 hashing method in the system - Modify hashing method to use PBKDF2 instead - Validate successful implementation of the PBKDF2 hashing method The project necessitates a strict focus on security and confidentiality given its sensitive nature.
Script Feature: - Login to a list of SSH servers by domain or IP (from text file) - Use a set of usernames + password (can be multiple passwords) to login to the servers. - Run Bash Script on the connected server (which comes from a txt file on the server running the script, not on the connected to server) - Timeout if SSH server did not answer. - Display results at the end of a run (show which servers the script did not run because of errors). Login simultaneously to all available ssh servers. Not server by server.
I need to convert the following Perl code to PHP: The expected output is a PHP class that can convert a docx file into text. The attached zip contains a mockup of such class (with demo code) and a test docx file. The task is straight forward. If you place a bid, expect it to be accepted. If you fail to deliver, you'll be subjected to a bad review. This is to avoid wasting my time with autoposters and people who lowball the bid and then try to ask for more money. You have been warned. Read the brief, check the code and place a bid accordingly.
Google Jobs Scraper project requiring skills in .NET, Python, Selenium and SQL. The task is to create a crawler to extract job listings based on predefined queries, manage the data in a structured manner, and provide an interface for controlling and monitoring the scraping process. The solution requires adept handling of rate limits and the use of rotating proxies for efficient data scraping. Data To Be Scraped: - Scrape all specified job listing data points. - Store and manage the scraped data in a SQL database for effective access and organization.
I'm currently facing issues with my web crawler code. Specifically, it's not managing to scrape all the required data and it's throwing errors inconsistently. This code has been built to scrape information from certain e-commerce platforms. The ideal freelancer for this task should show: - Proficiency in Node.js - Extensive experience with Puppeteer and web crawling, especially focusing on e-commerce platforms - Exceptional debugging skills Your challenge will be to inspect the code, identify the underlying issues and then fix them to ensure a comprehensive and seamless data scraping process. I look forward to collaborating with someone who can effectively resolve the issues and optimize the performance of this web crawler.
your website is causing the load spikes in question. You can consider reviewing this on your side additionally. We have also noticed that there is a lot of bot/crawler access to the website. Access requests originating from bots are registered every 2 to 5 seconds.
Hi, Today i have created a Scrapy crawler to crawl the website , but i'm not able to crawl the website because when i run the crawler, any request i do to the website, i got the 403 error to me. I just neeed you fix my code to do a request at someway the website return the code 200 instead of 403. I'm sending my code attached. Send me a print screen in the chat showing you received code 200 using the same url, then i will hire you to send me your code.
Looking for a seasoned AWS expert to assist in optimizing EC2 instances, S3 storage, and Lambda functions for improved performance. The ideal candidate will have: Mainly working on Aws glue jobs , S3,lambda, Crawler, step functions, dynamo DB ,Clouldwatchs, Appflow, parameter store , API Gateways, ETL Jobs,splunk logs CloudFormation - important big bucket,Spunk, Jenkins pipelines* CI/CD * , YAML for creating templates and manifest files * Sql mandatory for date base * using Postman for API calls * Python and spark Musk know
...developer to create a specialized web crawler focused on extracting vital data from e-commerce websites, primarily targeting ''. Key Requirements: The web crawler must adeptly parse text-based content and efficiently navigate the site's structure to extract pertinent information and links. Extensive expertise in Web crawling, Web scraping, and Data mining is essential for this project's success. Prior successful engagements in web scraping projects centered on e-commerce platforms would be greatly advantageous. Proficiency in programming Python is required. Familiarity with web scraping frameworks and libraries like BeautifulSoup, Scrapy, or Selenium is highly desirable. While the initial focus is on '', the developed crawler sho...
I'm seeking an expert to help cr...an expert to help create a Dockerfile that runs Perl and DBD::mysql so that I can run a legacy website. This should be a simple task if you have the knowledge. Specific requirements include: - A Dockerfile is the only output required, roughly corresponding to mine - It should build and run in wsl, i.e. docker run -p 8080:80 image_name - It must use Apache, Perl and the CPAN module DBD::MySQL - It should have been tested on a MySql database, the file is provided to run on localhost:8080/ - A screenshot of the above is required to prove that it is working (you just need a MySql Table with fields Id and Name) Candidates should ideally have: - Extensive experience in Docker and a basic knowledge of Perl - Understanding of Per...
...working. MochaHost tech support got the Import buttons on the forms fixed but suggests they may not be able to fix the XML & XML+XSL submission buttons at the bottom of the forms. Here's what they say about that: When the server is upgraded, the Perl modules in the new server might not be fully imported. That's why your website doesn't work because some Perl module dependencies might be deprecated. MochaHost support says: We highly suggest you talk about the error with your Web Developer to ensure they can help you add the missing path on the Perl module. Based on our check, your website form processing is missing pointing to the `File::Spec` module which has been installed on the server. It seems like that might be a fairly easy fix and I have...
...performance tuning, sizing and capacity planning, database backup and recovery in a Unix O/S using RMAN and Oracle export/import utilities, administration, and maintenance to provide backup and disaster recovery. • Knowledge of installation, configuration, and maintenance of multi-node Oracle RAC enabled databases, including Oracle ASM and Oracle CRS management. Knowledge of PL/SQL packages, shell, and Perl scripts for task automation, and proactive database monitoring and notification using Oracle OEM Grid Control. • Demonstrated written and oral communication skills reviewing and editing established database policies and procedures and developing new SOPs for database software installation and configuration. • Experience with Cloud(AWS/Azure/OCI) migrations (DB a...
