Run scrapy in dockercông việc
Yêu cầu có kinh nghiệm như sau Kotlin SpringBoot Spring for GraphQL Spring Data Docker Và có thể làm việc remote trong giờ hành chính từ 8h30 tới 17h15
Hi Ngọc, Bạn làm được con bot này trên Pancakeswap chưa? Có gì liên hệ với mình thêm qua chat nha. Yêu cầu giống thế này: https://www.freelancer.ca/projects/python/Uniswap-Bot-Pancake-Swap/details
Công ty DFM ENGINEERING hoạt động trong lĩnh vực tư vấn, phát triển các giải pháp phần cứng và phần mềm. Chúng tôi cần tuyển một số Freelancer có kinh nghiệm, thành thạo các Skills sau: + Dev-Ops + Docker + Kubernetes et Angular JS - Lương tính theo giờ hoặc thỏa thuận theo gói công việc, sẽ thỏa thuận theo task cụ thể - Các ứng viên thành thạo một trong các kỹ năng trên vui lòng liên hệ và gửi CV về phòng nhân sự công ty DFM ENGINEERING. Chúng tôi sẽ liên hệ với ứng viên để trao đổi cụ thể hơn về công việc và mức lương. Lưu ý CV cần chi tiết các kỹ năng, kinh nghiệm,...
OLDED: Script is running on 1> Old script: Script (rename file to .js) 2> Old interface: UI + NEW: Re-write new Script with new interface to be able to run on 1> Design interface + default value: B1 - Script 2> Detailed description of the function: B2 -Note for the 3> Script to check the results: B3 -Test Cases (edited # 2) .png
Hi Dương, công ty Silicon Straits Saigon hiện tại có nhu cầu tìm một bạn Python part time giúp viết các scrapper trên ngôn ngữ Python/Scrapy. Công việc có thể làm remote hoàn toàn tuy nhiên buổi đầu tiên hy vọng bạn có thể ghé văn phòng để thảo luận công việc & hợp đồng lâu dài. Nếu bạn mong muốn tìm hiểu thêm có thể trả lời trực tiếp cho mình qua hệ thống này.
I'm in need of an experienced DevOps professional to join my team on a shadow basis and provide assistance across various projects. These projects will primarily involve the use of Docker, Kubernetes, Ansible, and CI/CD. Key Responsibilities: - Infrastructure Setup and Management: Ensuring that our systems are designed, implemented, and maintained correctly. This includes load balancers, servers, databases, and more. - CI/CD Pipelines Setup: Developing and automating the CI/CD pipelines for the projects. This involves integrating code changes, running tests, and deploying to production. - Monitoring and Scaling Solutions: Implementing the necessary tools and practices to monitor the performance and health of our systems and automatically scale them when needed. You sho...
We don't want our employees to see the phone numbers of customers on whatsapp and chat with them. We just want to restrict whatsapp usage to making calls only without visibility of the numbers. So best is that if the GUI of WhatsApp Desktop is not visible and we access it using another app. Either from browser or another windows app. Alternative is that we do this with android app
I'm looking to deploy Ragflow on my Linux server leveraging Plesk Docker. This is my first time undertaking such an endeavor, therefore, guidance is vital. As the Docker is already installed and configured on the server, a seamless execution is anticipated. We will not deploy the docker from the docker library but by uploading it as a zip file (because I will later whitelable the platform). Here's what I'm seeking: - Competence in Linux, Docker, and Plesk - A knack for clear instructions. I will need a clear full step by step guide document (or recorded video with any command or settings written in a text file so I copy/paste instead of typing). I will repeat the same process to deploy it myself. Once this is done, we mov...
I am in search of a senior web developer with a minimum of 5 years of related experience. part time base, flexible hours, 3 hours/day for work date, 5hours/day for workend for 2 months, Skills and tools: - Proficiency in HTML/CSS, JavaScript, PHP; Python - Proficiency in PostgreSQL - Familiarity with Docker - Kubernetes experience is a plus but not required - Cloud management skills (Preferably AWS) The main purpose of the project is to create a web application with specific functions including: - User registration and authentication - Data analysis and visualization - Integration with other systems or services - micro service architect - javascript. node js and Vue framework. We also need to integrate multiple other web applications. The work will be con...
I'm trying to write a simple Hello World to list the contents of an AWS S3 bucket, using the Nim programming language () and the disruptek/atoz library. To reproduce the issue, please install Nim on your machine, then execute `nimble init` to create a project and then run `nimble install -y `. I have attached a Dockerfile, for developers who prefer to use Docker. If you don't like Docker, please ignore the Dockerfile. The `docker build` will produce the exact same error I got on my machine: I am getting this Error: Cannot satisfy the dependency on npeg 0.27.0 and npeg 1.2.2 Your job is to reproduce this error and then modify the code to fix the error. This is apparently a problem with the atoz library itself, so you may have to fork
I'm looking for someone to scrape text and image data from a specific website for analysis purposes. Key Tasks: - Scraping text data: Extracting specific textual information from the website - Scraping ima...Tasks: - Scraping text data: Extracting specific textual information from the website - Scraping image data: Gathering images from the website The data is to be used for analysis, so understanding of data structures and data analysis would be beneficial. Ideal Skills and Experience: - Proficient in web scraping techniques, particularly with text and images - Experience with data analysis - Familiarity with tools and technologies that can be used for scraping, such as Python, BeautifulSoup, Scrapy - Strong attention to detail as the data needs to be extracted acc...
As a sysadmin developer, I'm in need of an asterisk specialist to build a Docker Compose script or a bash script for an interactive vocal server. This project is multifaceted, carrying out outbound calls and saving responses in a database. Key responsibilities are: * Creation of an Interactive voice response (IVR) system. * Outbound calling function connected with my API for automated scheduling of phone calls. * MySQL database integration to securely store the recorded responses. For this assignment, it would be ideal if you have proficiency in using Asterisk, Docker Compose, API integration along with comprehensive database management skills It would be a cherry on top if you have prior experience constructing interactive vocal servers. Let&#...
...strong programming skills in these languages and frameworks. I have several projects that need various development work. Most projects are built in python using django or flask. One project is using react with a django backend so you'll be expected to know some react as well. Our stack (usually): -Python -Django -Docker -Flask -React -Html -CSS -Javascript I will give you various tasks within each project and you'll work on them. Initially I will provide defined tasks with set requirements but then eventually it will be hourly work. Expectation is 3-4 hours/day, 4 days a week. Preferably Thursday through sunday, central time USA. You'll be expected to join our team slack channel, provide weekly updates on what you have worked on, experience with ...
I'm looking for a seasoned server administrator to set up a dedicated server for container-based provisioning. My web application will be a JavaScript library-based app, such as Node, , or React. Key requirements: - Proficient in Linux server administration, as the operating system is not yet defined. - Experience with container platforms like Docker or Kubernetes since I'm yet to determine my preference. Operating System: You can use Ubuntu Server, CentOS, or any other Linux distribution of your choice. Web Server: Nginx or Apache HTTP Server. Git: Version control system to manage your website's source code. Node.js: If you're hosting static sites or using JavaScript-based build tools. Let's Encrypt: For SSL/TLS certificates to secure your we...
We have a VPS with Easypanel management panel. We need to self-host a Supabase instance specifically with its Postgres. Easypanel is a docker-based server management panel.
I need a Python developer who c...developer who can create a script to scrape news in JSON format from moneycontrol at a specified interval and store it in a database. Key Requirements: - Develop a Python script to scrape news in JSON from moneycontrol - Automate the scraping process at a specified frequency - Ensure the scraped news is stored in a database Ideal Skills and Experience: - Proficiency in Python - Experience with web scraping using BeautifulSoup or Scrapy - Knowledge of working with JSON data - Familiarity with databases and data storage - Previous experience in similar projects would be a plus Please note: The project does not have specific requirements for news categories or keywords at the moment. The focus is on extracti...
...developing a Docker-based federated learning solution for industrial predictive maintenance to greatly enhance machine downtime prediction. The purpose of this system is to more accurately anticipate necessary maintenance and reduce unexpected downtime in industrial machinery by analysing operational data such as speed, temperature, equipment running time, and so on. We have the code available with us, you just need to make it work for another dataset and run it in Ubuntu. Prospective freelancers must have skills and experience in the following areas: - Docker, for providing the backbone of our decentralized system - Federated Learning, to collectively improve our model's performance without sharing raw data - Working with and analyzing op...
...orchestration. - Use Apache Spark for data processing and sentiment analysis. - Store processed data in Cassandra DB for recording activities. - Store analyzed data in Amazon S3. 2. Workflow: - User submits a review through the web UI. - The review data is streamed to Kafka topics. - Airflow schedules tasks to ingest data from Kafka, process it using Spark, and store it in Cassandra. - Spark performs sentiment analysis on reviews. categorize it into positive , negative, neutral - Analyzed data is stored in Cassandra for future analysis. - Processed data is also stored in S3 for archival and further analysis. 3. Deployment: - Deploy the entire application stack using Docker containers or Kubernetes for easy scala...
Im working on a c++ image processing project , and i need to convert my C++ code to Verilog using HLS vitis , then implement it to run on Ultra96v2 Xilinx FPGA board .
I'm in need of a Laravel expert who's proficient in AWS EC2 for resolving hosting issues. I hosting Laravel with CI/CD from github with docker I hosted Laravel project that I purchased from zcart market place - incevio But if I try to upload avatar in profile page it gives us below issue: "webp formart is not supported" Who can fix ?
I'm in need of an advanced Docker trainer who can educate me on various topics including Installation & Setup, Docker Image Creation, Docker Networking & Data Management. Expertise in training related to Docker tools like Docker Swarm, Kubernetes, and Jenkins is highly essential. The ideal candidate should have ample experience in these areas and a knack for simplifying complex concepts.
I'...help with web scraping and data analysis tasks. Key Tasks: - Web Scraping: Proficiency in using Beautiful Soup or Scrapy is essential. The person should be able to extract specific data sets from websites and present them in a structured format. - Data Analysis: Experience with Pandas and NumPy is crucial for this role. The ideal candidate should be able to manipulate and analyze large data sets efficiently. - Automation: Familiarity with Selenium for automating tasks is a plus. What I'm Looking For: - Experience: Please include details of your past projects and your experience with Python in your application. - Specific Libraries/Frameworks: A strong grasp of Pandas, NumPy, Beautiful Soup, Scrapy, and Selenium is highly desirable. ...
I'm in need of a DevOps Engineer who can assist me in containerizing a Docker application. I'm interested in your expertise in managing containerized applications, ensuring they can scale effectively, and maintaining a high level of security. Key Tasks: - Containerization: Implementing the best containerization platform based on your experience. - Scalability: Designing a solution that can easily scale and handle increased loads. - Security: Ensuring network isolation, access control, and secure image signing are properly implemented. Ideal candidates should have: - Strong experience with containerization platforms like Docker Swarm, Kubernetes, or Apache Mesos. - Proven expertise in designing and maintaining scalable architectur...
I'm in need of a skilled DevOps expert to assist with some key tasks to improve my personal infrastructure: - Automating Deployments: I'm looking for automation of deployment processes. The ideal candidate should be able to streamline deployment, minimize errors, and save time. - Monitoring and Logging: Monitoring and logging are crucial for ensuring that the infrastructure is performing optimally. The DevOps specialist should be able to set up effective monitoring tools and logging systems. The candidate should have prior experience with: - AWS (Amazon Web Services), Docker, Ansible, Jenkins etc
I'm currently looking for an expert who can design a data scraping script for me. H...currently looking for an expert who can design a data scraping script for me. However, I haven't decided on which particular website and kind of data (text content, images, links etc) should be scraped yet. Furthermore, the frequency for data collection hasn't been specified. Ideal Skills and Experience: - Commercial experience with Python or JavaScript - Proficiency in web scraping using tools such as BeautifulSoup, Scrapy, or Selenium - Ability to add flexibility for target URLs, data type, and collection frequency Please note: the project details will be finalized upon discussion. Your recommendations are welcome and appreciated. Only apply if you're comfortable pro...
I'm looking for an experienced DevOps engineer who can handle the tasks of conti...efficient flow of code from development to production - Addressing any issues that may arise in the deployment process - Suggesting and implementing best practices for CI/CD in Python projects The ideal candidate should have: - Proven experience in implementing CI/CD pipelines for Python projects - Strong understanding of infrastructure as code and automation - Proficiency in tools like Jenkins, GitLab CI, or similar - Good knowledge of containerization technologies like Docker - Familiarity with cloud platforms like AWS or GCP - Ability to troubleshoot and optimize performance issues in the deployment process. Please respond with your relevant experience and...
...Objectives: - App development competence in cross-platform development primarily focusing on iOS and Android smartphones. - The app should have the ability to forward incoming SMS/Text messages to other SMS numbers, Telegram, and email addresses. - An eye for detail to design a professional and corporate-looking app to resonate with our company's ethos. Ideal Expertise: - Expert in iOS and Android development - Experience with integrating third-party messaging and email services - Strong graphic design skills to create a professional and corporate aesthetic. Requirements: - app starts with system / smartphone start and runs in background - app listens to the incoming messages - on incoming message the forwarding is done by a configurable delay in m...
We are looking for a MILVUS devOps expert who will know how to recommend and install the best Milvus hosting server. We are also looking for someone who has done this before MANY MANY times. The end goal is to 1/ recommend which Milvus install plan is best (K8, simple Docker, etc...) 2/ install Milvus and 3/ write detail documentation on how it was done. Then we may want to give you the chance to support and maintain the install. FOR us to consider your submission (WITHOUT the answers to these questions your submission will be automatically deleted) Question 1: Please let us know how many times you have configured and install Milvus. Question 2: Please describe the best architecture you recommend to install and host Milvus. Question 3: Will you be able to demo ...
...complete this task; we can leave each other nice comments and 5 stars for each? Look at feedback on my profile, feedback I left for many others. Here is the project: SINCERELY WOULD BE NICE TO MEET YOU PLEASE ANY THOUGHTS ? Please note project is due in two hours as this projects deadline, as this is needed if we can get some done - then we can talk about next steps and 5 stars and another job also. If this is a good one and we are "successful"; would need a couple others setup, but will handle one at a time? Can you do this for something reasonable in a couple hours? thoughts ?...
I'm looking for a talented DevOps professional to assist with deploying my project on AWS. Your primary focus will be working with EC2 instances, Lambda functions, and S3 storage. Ke...services for a seamless workflow - Setting up Kubernetes for automating deployment The right candidate should have: - Proven experience with AWS services, especially CloudFormation - A deep understanding of Kubernetes and its applications, particularly in automating deployment - Strong knowledge in Docker and RDS - Excellent problem-solving skills and ability to work independently This project will involve a deep understanding of AWS and Kubernetes, and the ability to integrate various services effectively. If you have a strong background in DevOps and can meet these requ...
As a thriving business, we are currently seeking an experienced, motivated DevOps expert proficient in managing AWS cloud platform. The successful candidate will be responsible for: - Setting up the CI/CD pipeline and managing Kubernetes and Docker, to configure and optimize our cloud setup for swift deployment of our microservices-based application. - Collaborating with the team to identify and establish DevOps practices in our organization. Skills and Experience: - Proven experience with AWS, Docker, and Kubernetes - Previous experience in setting up CI/CD pipeline - Understanding of Microservices deployment model - Strong troubleshooting and problem-solving skills. We look forward to receiving your proposal.
I'm looking for an experienced and reliable full-time React/Django developer to build a web application. The d...looking for an experienced and reliable full-time React/Django developer to build a web application. The developer should be based in the US timezone and should have the Hubstaff time tracking app installed. The chosen candidate will be paid 1000USD per month Functionality specifics weren't provided at the beginning, but we'll discuss these as the project progresses. Since the project is not time-bound, the importance lies in the development and maintenance of high-quality code rather than on haste. Ideal Skills & Experience: - Proficiency in React and Docker, AWS - Exemplary track record of developing web applications -...
I am in need of a proficient Python coder who can develop a script to furnish an important function, data processing. More specifically, this task involves dealing with video data. In essence, the Python script's core function is to process numerous multimedia data in the form of videos. Desired skills and experience: - Thorough understanding and experience in Python scripting. - Proven experience in working with multimedia data, especially videos. - Familiarity with Google Cloud Platform (GCP). - Knowledge and experience in data processing algorithms and techniques. The final deliverable will be a Python script able to run in an HTML page, which we can then deploy to GCP. The successful candidate should be comfortable in...
Looking for an experienced Python developer who can create a script to be embedded within an HTML page and deployed on Google Cloud Platform (GCP). The script should: - Be capable of real-time data processing. - Fetch data directly from a webpage. Ideal skills and experie...from a webpage. Ideal skills and experience needed for this role: - Extensive Python programming background. - Experience working with real-time data. - Familiarity with extracting data from webpages. - A solid understanding of Google Cloud Platform for deployment. - HTML integration knowledge. This task requires a developer who is savvy with Python's data processing abilities and adaptability in real-world, real-time scenarios. Ready to take the challenge? We're willing to offer a good budget f...
Hello and Thank you for being here have a docker command I need to run with - - build-arg VERSION=${VERSION} I have VERSION=3.0.0 in my .env and trying to make sure I reference that ? How do I do that ? is something missing ? We can do a 2nd Milestone if you like and we can talk about that together Will give a 5 Star Review when this is done and will write such inspiring words for you, when done. Please understand; there is hope you can give your “best” price; been unemployed, and have cancer with bills backing up, $10 possible? Please note $10 is the max total that I can handle for this (doing hourly reduces % fee). Will leave a Glowing paragraph of feedback 5 stars : - ) My funds are low but will pay quick and leave 5 stars. Please give yo...
Missing the expertise, I am a student seeking someone adept at Docker and Microsoft Azure to teach me how to efficiently containerize a React app and deploy it on Azure through a pipeline. Struggling with both these aspects, hence, hands-on experience in this field is incredible. Ideal Skillset: - Proficient in React - Proficient in using Docker and Azure. - Good teaching and communication skills. - Experience in containerizing React apps and deploying them on Azure. - Patience and the ability to explain complex concepts. Objective: - Master Docker containerization of a React app. - Understand efficient deployment on Azure. - Practical application and troubleshooting tips.
...who is familiar with the Run Diffusion / Stable Diffusion program or is willing to familiarize themselves with it. Experience is advantageous but not mandatory. Responsibilities: - Application and optimization of the Run Diffusion / Stable Diffusion program, primarily utilizing the programs ComfyUI, AutoForge1111, and FaceSwap for image editing tasks - Collaborating with the team to develop solutions and solve problems - Documenting work processes and results Requirements: - MacBook with M1 Chip or higher - Basic knowledge or experience with the Run Diffusion / Stable Diffusion program (experience is advantageous but not mandatory) - Proficiency in utilizing ComfyUI, AutoForge1111, and FaceSwap for image editing tasks - Good programming skills and profici...
Postgres data query system Docker across multiple servers
Hi hope you have a good day. I have odoo installed on like this I have asked someone else to update my docker image to version 17 odoo. I have now this problem It has to be fixed on the saas for the enterprise version V17 I am in search for someone who can solve this for me. Is this something you can do? Thank you for you're response. Cheers, Deef
I need Google ads runner for my run my affiliate products who can will gave me daily leds with Google adsense
I am making a Django web app that is meant to be a portal to show inspections for their rental property. I am having trouble setting up uploading their inspection and displaying it for the inspected user. I also want help on the frontend. Lastly I want help containerizing it to help me deploy it. I would like a video or a live call where you explain to me all of these things so I can learn it.
...seeking a proficient DevOps freelancer, well-equipped with Salt Stack's Automation capabilities, docker containerisation specifically for Linux operating systems. - Tasks required: Primarily, I need assistance with configuration management and deployment of standard WEB related software components to target systems using Salt as a delivery manager and docker for maintaining and managing software components. . Efficient implementation of these automated tasks is high priority. - Infrastructure: The SaltStack infrastructure is already in place, hence the focus will be on maximizing its utility rather than set-up. For a promising collaboration, the successful candidate should have hands-on experience in SaltStack automation specifically for Linux sys...
I am seeking an experienced assistant who is talented in social media advertising and SEO marketing. This person will help me grow my online presence to drive more sales and attract a larger audience. Here's what I'm looking for: - Mastery of Instagram, TikTok, and Wix - Proven experience in increasing website traffic, improving brand awareness, and driving leads - Skills in target marketing, particularly towards young adults (18-24), adults (25-34), and parents/caregivers. If you have the necessary skills and can provide a strategic, results-oriented approach, I'm interested to hear how you can help.
I'm in need of a skilled individual who can implement an open-source Docker container on MAC OS. The implementation should prioritize the following features: - Easy deployment of applications - Efficient resource utilization - Secure containerization The repository that I plan to use within the Docker container is the "ib-gateway-docker", which is available at the following link: [ib-gateway-docker Repository]() I don't have any specific requirements or modifications for the Docker container implementation. You just need to follow the existing implementation and ensure that it aligns with the features I've mentioned. Ideal candidates for this project should: - Be proficient in Docker container im...
...easily. Ensure the application can parse and extract data accurately from various webpage structures. Output the extracted data into a structured spreadsheet format. Test the application to ensure its reliability and accuracy under different use cases. Requirements: Strong experience in Python and familiar with libraries like BeautifulSoup, Scrapy, or similar for web scraping. Proficiency in GUI frameworks such as Tkinter, PyQt, or others. Experience in handling data extraction and manipulation, and proficient in working with spreadsheets. Good problem-solving skills and attention to detail. Ability to deliver clean, well-documented code. Deliverables: A fully functional web crawling application with a GUI. Source code with detailed comments. Documen...
Ensure all necessary files (like Dockerfile, Kubernetes deployment configs) are in place and updated. Create a .github/workflows directory in your repository if it doesn't already exist. Write the GitHub Actions workflow YAML file, which includes: Checkout code. Build the Docker image. Push the image to Google Container Registry or Artifact Registry. Deploy to Kubernetes, using either direct kubectl commands or set up configurations. Run the workflow to ensure it triggers correctly on commits. Debug any issues that arise during the build, push, or deployment steps. This might involve several iterations to fix syntax errors, permission issues, or configuration issues. Configure the necessary permissions for the GitHub Actions runner to interact with GCP. Sec...
I'm in search of a Senior Full Stack developer, passionate about their craft, to join our ranks. Your wealth of knowledge and experience will be the key to our growth and the solution to surpassing our current limitations. Key Skills: - Proficiency in JavaScript, C#, React, Vue, and .NET Core - Familiarity with Visual Studio - Experience in MySQL database management Nice to have ● Familiarity with DevOps and CI/CD pipeline. ● Familiarity with containerization tools like Docker and Kubernetes. ● Frontend development experience working with React.js. What you have ● 8+ years of experience as a full stack engineer on a team using standard best practices. ● 5+ years of experience as a Full-stack engineer with .NET, ASP.Net Core, Azure, Angular, and React.js....
...who can support me to set up a Python program to run the ChatGPT API on full word documents using custom prompts. I am very new to coding and Python and having some difficulties in setting this up. I have Python 3.x installed on my computer but my experience with APIs, particularly GPT-3 API, is minimal. Here's what I need: - Understand and resolve the issues I'm experiencing in setting up and running the Python program. - Guide me through the setup process to ensure I can successfully run the ChatGPT API on full word documents. - Teach me how to use custom prompts in the program. This job would ideally suit someone with Python expertise and possesses a great understanding of the GPT-3 API. While I would appreciate a hands-on approach ...
Good Morning, Installation and configuration of Mailcow Mail Server. Includes installation and configuration of Docker and Docker Compose
