Longterm: Python Guru for Refining Existing Script and Running for Weekly Data Collection
€2-6 EUR / hour
Cancelled
Posted 4 months ago
€2-6 EUR / hour
I'm looking for a Python expert who can help me with a data collection task. The data will be sourced from public website using a script. The script already exists and is in working order, but shall be refined within the collaboration. The script shall be run on your local system (Linux) at least on a weekly basis. It stores the data in an existing database and downloads media files.
->
Important: Read the full description carefully until the end. There's an easter egg you must follow: Proposals that don’t reflect a complete understanding will be disregarded due to avoid auto-generates proposals. Thanks for your understanding.
<-
This will be a LONGTERM collaboration for months and years, not only one single job.
I am a coder myself, so we’ll be speaking the same language — you may expect smooth, clear, and professional communication.
Key Requirements:
- Run a Python script on weekly basis to collect data from websites.
- Modify and optimize the script.
Ideal skills and experience:
- Proficient in Python with a strong understanding of web scraping techniques.
- Prior experience in developing Python scripts for data collection.
- Ability to troubleshoot and optimize scripts for better performance.
You need to be able to work with these libraries:
- yt_dlp
- selenium
- PIL
- pandas
- requests
An initial task (job) will be as follows:
- Install and perform a test run of the existing Python script.
- Use it to collect data from 5 to 10 content pages => the data will be stored in the database.
- Provide a database dump after completion.
- Provide an archive or directory listing of downloaded media files.
➡️ This initial task serves purely to verify your technical capabilities.
If successful, we can discuss a long-term collaboration.
Please submit your proposal including your hourly rate.
? Important ?
The rate you propose will serve as the basis for our collaboration. Any attempts to increase your rate later on will result in immediate termination of communication without further notice. We value reliability and do not work with time-wasters - unfortunately there's too many of them here at freelancer.com. If you are a time-waster = do not propose, you will also waste your time.
If you’re looking to earn honest money on a regular basis, you’re exactly the kind of person we’re looking for.
Payment can be in any currency, like $ or Euro.
? IMPORTANT READ THIS ?
Auto-generated bids will not be taken into account and rejected immediately without further notice, so IMPORTANT, start your proposal with the solution of the math: tw@ p|u$ s|x (just start with the integer of the correct solution of previous math, e.g. „5“).
8
I'm a Python expert with extensive experience in web scraping, script optimization, and long-term project collaboration. I’m proficient with libraries like yt_dlp, selenium, PIL, pandas, and requests, and I work in a Linux environment, making me well-suited for your weekly data collection tasks
€6 EUR in 30 days
5.0
(30 reviews)
6.4
6.4
19 freelancers are bidding on average €7 EUR/hour for this job
Yes,I can refine existing script & scrap data for you.I have good working experience with Python,Django and Data Scraping.
I assure you that I wil lprovide you best service within required time and reasonable budget.
Looking forward to get started the work with you.
Regards,
Shalu
Hi Patrick E.,
Good morning!
★★★ I HAVE READ ALL YOUR REQUIREMENTS VERY CAREFULLY AND UNDERSTOOD WHAT YOU WANT. ★★★
With over 12 years of experience in Linux, Software Architecture, Data Scraping, Python and Web Scraping, I can provide the precise results you're seeking for.
✔ Proven Expertise – Over 12 years of hands-on experience in Linux, Software Architecture, Data Scraping, Python and Web Scraping, delivering top-tier solutions.
✔ Efficiency First – Optimized development processes to save time and cut costs without compromising quality.
✔ Scalable Solutions – Designed to grow seamlessly with your business and adapt to future needs.
✔ Unmatched Reliability – Robust implementations to ensure stability, security, and minimal downtime.
✔ Tailored Approach – Fully customized solutions to align with your unique goals and requirements.
✔ Dedicated Support – 6+ weeks of post-launch support to keep your project running smoothly.
https://www.freelancer.com/u/apilt9
I’m looking forward to discussing your project in more detail.
Best regards,
Apil
Hello Dear!
Good Day!
Hope you are doing fine.
This is Toriqul Islam. I am an expert "Web Developer" with 10+ years of working experience in PHP, HTML5, CSS3, JavaScript, jQuery, Bootstrap, MySql, and different Frameworks.
Hire me and you don't have to worry about your website problems again! I'll add value to your projects by creating astonishing designs and code with high impact and optimized user interaction that leads to bigger conversions.
WHAT PROBLEMS CAN I HELP YOU SOLVE?
Custom Websites Using PHP and Frameworks
e-Commerce Websites (Woo-Commerce and Shopify)
Custom WordPress themes
On-Page and Off-Page SEO
WordPress themes Customization
Database Modeling/Development
WordPress migrations and upgrades
Responsive Coding (Make your website compatible with: smartphones, tablets, and desktops)
Website speed and loading time improvements
Cross-browser compatibility
PSD to HTML to WordPress conversion
HTML5/CSS3/jQuery websites based on Bootstrap
I love challenges, talking to my clients, and meeting others’ standards as well as expectations. I will be discussing everything in detail, giving my full advice, and delivering through the best of my skills.
You are cordially welcome to discuss your project. Thank You!
Best Regards,
Toriqul Islam
8
I am an experienced software developer. I can start right now and deliver it in 2 days. I have done similar projects and I can do this project as well.
I have many years of experience in making software development and have done 100+ projects.
8.
I have extensive experience in Python and web scraping, and I specialize in optimizing and troubleshooting scripts to ensure smooth, reliable performance. I will ensure that your script runs efficiently on a weekly basis and handle any issues that arise promptly. I’m committed to delivering high-quality results and maintaining clear communication throughout the project. Additionally, I am available on short notice and ready to assist with any urgent tasks. My hourly rate is €10/hour, and I look forward to the opportunity to work with you on this long-term collaboration.
Having tackled numerous Python projects over the years and strictly adhering to clean, high-quality coding principles, I assure you that my proficiency in Python, web scraping techniques will be an asset in refining and running your existing data collection script smoothly. Moreover, I have a deep understanding of libraries like yt_dlp, selenium, PIL, pandas and requests which are central to your project. My strength is my ability to troubleshoot and optimize scripts for top-tier performance.
With my strong track record in developing Python scripts for data collection and my intimate knowledge of the mentioned technologies, I am confident in my capacity to perform exceptionally well in this role. Additionally, being a fellow coder, I am more than capable of effectively communicating ideas and issues with you ensuring maximum clarity throughout our collaboration.
For the pilot task, installing the script, performing tests runs on content pages and providing database dump as required wouldn't be new to me; I have run intricate systems before. As for your concern about time waste, rest assured - I fully respect time value; it's something neither of us can afford to squander.
8
Hello!
I am a dedicated web developer with over 20 years of experience specializing in PHP, CakePHP, and WordPress. I have successfully built and optimized various projects, ranging from business websites and e-commerce platforms to complex management systems. With strong expertise in Linux, server management, cPanel, website deployment, and SSL configuration, I ensure secure, high-performance, and well-optimized web solutions.
I am a hardworking professional who values efficiency and quality. Additionally, I have good English communication skills, making collaboration smooth and effective.
If you are looking for a reliable and experienced expert to bring your project to life, feel free to reach out!
Thank you for taking the time to read my profile. I look forward to working with you!
Regards
Ted
ps: I am currently unemployed, so I am using my free time to study Python. I have just finished learning Python and I am now learning Django Framework. I understand that this job is for Python developers, but I hope you won’t mind me applying.
8
Hi,
I’m an experienced Python developer specializing in web scraping, automation, and data collection. Your project is an excellent fit for my skills, and I’m interested in a long-term collaboration.
Why Choose Me?
✔ Script Refinement & Optimization – I will enhance your existing script for better efficiency and maintainability.
✔ Weekly Data Collection & Maintenance – I will run the script on my Linux system and ensure accurate, reliable data extraction.
✔ Database & Media Handling – I will store extracted data in the database and manage media file downloads properly.
✔ Strong Web Scraping Expertise – Proficient in Selenium, requests, pandas, yt_dlp, and PIL for robust data extraction.
✔ Smooth Communication – Since you are a coder yourself, I’ll ensure clean code, detailed documentation, and efficient discussions.
Initial Task Deliverables:
✅ Install and test-run the Python script.
✅ Scrape data from 5-10 content pages and store it in the database.
✅ Provide a database dump and a directory listing of downloaded media files.
I value reliability and long-term professional relationships, and I’m open to discussing your requirements further. Looking forward to hearing from you!
Best regards.
As an experienced Python developer with a proven expertise in the libraries that you have mentioned, I am confident that I can make an immediate and positive impact on your project and subsequent long-term collaboration. My extensive knowledge in web scraping, working with yt_dlp, selenium, PIL, pandas, and requests libraries combined with my ability to troubleshoot and optimize scripts for better performance will add value to the existing script, ensuring smooth data collection from public sites.
Moreover, I am well-versed in managing databases and handling media files ensuring seamless integration of collected data into your existing system. Being a fellow coder, I understand your needs at a professional level which ensures effective communication and more efficient decision-making.
My approach is not only limited to delivering functional solutions but also extends towards designing robust systems that are scalable for future requirements. With our partnership, expect not just an outsourced hand but someone who will be working alongside you as a teammate to achieve the best results continuously. Given my commitment to craftsmanship, attention to detail, and experience working with relevant technologies, I believe I'm the right fit for your ongoing data collection task and would love the opportunity to prove it through tackling the initial task successfully.
5
To refine your existing Python script for data collection, we can enhance its functionality and optimize its performance. Have you considered specific features or improvements you want to implement first?
I have extensive experience in Python and web scraping, utilizing libraries such as yt_dlp, selenium, and pandas effectively. I will ensure the script runs seamlessly on your Linux system and can perform the initial test run to collect data as specified.
For the initial task, I am ready to install the script, verify its functionality, and provide a database dump along with a listing of downloaded media files.
My hourly rate is competitive and reflects my commitment to quality work. I’m looking forward to the possibility of long-term collaboration, where reliability and clear communication will be paramount.
Best Regards,
Gafar
With over a decade in the freelance community, my Python skills are finely tuned, and I'm well-versed in web scraping techniques. Previous projects have seen me develop precise and optimized data collection scripts, making me an ideal candidate for your project. Proficient with libraries such as yt_dlp, selenium, PIL, pandas, and requests, I can successfully refine and run your existing script on my local Linux system as frequently as needed. My expertise doesn't stop there; with vast experience in data analysis and database management, I can ensure seamless data storage while providing comprehensive records.
I understand the vital importance of a trial run to gauge compatibility which is why my first task will be to install and run the script to gather data from 5 to 10 content pages. Post collection, you'll receive a secure database dump along with documentation of downloaded media files. My dedication to delivering quality work in a timely manner is second to none. You can count on my sharp eye for detail to optimize your existing Python script for better performance.
When it comes to value for money spent, I am committed to delivering optimal value at an affordable rate that will not be subject to increase later on. My goal is long-term collaboration built on trust and client satisfaction. If you're ready for an effective and reliable partnership marked by insightful interpretations of your data, then let's take the plunge into possibility together!
8 – Hi, I carefully read the full job description and I’m interested in collaborating with you long-term.
I have experience in Python development, particularly in web scraping and automation. I understand that the task requires running an existing script on Linux weekly, refining it when necessary, and storing data in a database while downloading media files.
My Relevant Skills & Experience:
✔ Proficient in Python – Strong understanding of web scraping techniques.
✔ Experience with scraping libraries – Familiar with selenium, requests, and pandas.
✔ Database management – Comfortable working with databases for storing extracted data.
✔ Linux user – Can efficiently run scripts and troubleshoot issues in a Linux environment.
✔ Debugging & Optimization – Able to modify and enhance scripts for better performance.
✔ Competitive rate – I am offering a lower rate because I am new to the Freelancer platform and want to build a strong reputation through high-quality work.
Initial Task Understanding:
✅ Install and run the existing script.
✅ Scrape data from 5-10 pages and store it in the database.
✅ Provide a database dump and a list of downloaded media files.
✅ Make changes to the script if it can be improved.
I’m a reliable freelancer looking for long-term, consistent work. Looking forward to working with you!
8, Hi there,
I’m excited to assist you with refining your Python script for data collection. With my expertise in the following areas, I’m confident I can help optimize your process:
My Expertise:
- Python Scripting & Automation: Experienced with Python programming for web scraping, automation, and data processing.
- Web Scraping: Proficient in using libraries such as BeautifulSoup, Scrapy, and Selenium to collect data from public websites.
- Linux System Administration: Skilled in automating tasks using cron jobs and shell scripting on Linux systems.
- Database Integration: Strong background in working with SQL-based databases (MySQL, PostgreSQL) to ensure seamless data storage.
- Media File Handling: Expertise in downloading and managing media files (images, videos, etc.) from websites.
I can start immediately. Looking forward to discussing how I can help with your project!
Best regards,
Keshav Khanal
