
Closed
Posted
Paid on delivery
Senior AI Video / GPU Engineer Needed – Wan2.2 + RunPod A100 + PyTorch/CUDA I need an experienced AI/GPU engineer to finish and productionize an existing AI video-generation backend for a platform called ROLLCALL. This is NOT a website design job. The website is already built. I need someone who specializes in GPU inference, Python, PyTorch/CUDA environments, AI video models, and production API deployment. CURRENT SYSTEM We already have: RunPod NVIDIA A100-SXM4 80GB GPU Wan2.2 I2V A14B Approximately 118GB of Wan2.2 model files already downloaded Persistent /workspace storage Python PyTorch/CUDA FastAPI/Uvicorn worker FFmpeg Existing website integration Existing REST API running on port 3010 Current API routes include: GET /v1/health POST /v1/generate GET /v1/jobs/{job_id} GET /v1/files/{filename} The website can communicate with RunPod successfully. GPU health verification works. The generation API successfully accepts a request, creates a real job_id, returns that job ID to the website, and allows the website to poll the job status. CURRENT TECHNICAL PROBLEM Wan2.2 is currently failing during Python startup because of a FlashAttention/PyTorch ABI compatibility problem. Current error includes: flash_attn_2_cuda...so: undefined symbol... I do NOT want someone randomly reinstalling packages until something works. I want an engineer who understands PyTorch, CUDA, NVIDIA GPUs, FlashAttention, compiled Python/CUDA extensions, ABI compatibility, and production AI inference environments. YOUR JOB First audit the complete existing environment before changing anything. Determine the correct compatible combination of: NVIDIA driver CUDA Python PyTorch torchvision/torchaudio where applicable FlashAttention Wan2.2 dependencies Then repair or rebuild the Python runtime cleanly if necessary. You must also: Preserve the existing ~118GB Wan2.2 model files. Preserve existing ROLLCALL project files and generated videos. Verify Wan2.2 imports successfully. Verify [login to view URL] starts successfully. Verify T5, VAE and Wan2.2 model checkpoints. Verify A100 CUDA inference. Verify FFmpeg. Review and stabilize the FastAPI worker. Verify generation requests immediately return a valid job ID. Verify job status can be polled reliably. Implement reliable queued, generating, processing/stitching, completed and failed states. Return useful error information when a generation fails. Ensure completed MP4 files are accessible to the website. Verify image-to-video generation using Wan2.2 I2V A14B. Test the entire system from the ROLLCALL website through RunPod and back. Make the worker start/recover correctly after a pod/container restart. Create a reproducible startup/deployment configuration so we do not have to manually repair the environment again. Document the exact final Python/PyTorch/CUDA/FlashAttention/package versions. IMPORTANT Do NOT delete, replace or redownload the approximately 118GB Wan2.2 model unless there is a genuine technical reason and I approve it first. Do NOT consider the project finished simply because the health endpoint returns HTTP 200. DEFINITION OF DONE I will consider this project complete only when this complete workflow works: ROLLCALL Website → RunPod API → Job Created → Wan2.2 I2V A14B → NVIDIA A100 GPU Generation → MP4 Created → Job Completed → Video Returned → Video Plays Correctly on ROLLCALL Website A real end-to-end video generation must successfully complete before final acceptance. I also want the completed environment documented and reproducible so a future RunPod restart does not require rebuilding everything manually. REQUIRED EXPERIENCE Please apply only if you have strong experience with several of the following: Python, PyTorch, CUDA, NVIDIA A100/H100, RunPod, Wan2.1/Wan2.2, FlashAttention, Hugging Face, diffusion/video models, FastAPI, REST APIs, Linux, FFmpeg, Docker and production GPU inference. Experience deploying large AI video models such as Wan2.x, HunyuanVideo, CogVideoX, Stable Video Diffusion or similar models is strongly preferred. IMPORTANT SCREENING QUESTION Start your proposal with: A100-WAN22 Then answer this question: If [login to view URL] produces an undefined symbol error when importing Wan2.2, what would you inspect before reinstalling FlashAttention? Explain specifically how you would verify PyTorch version, CUDA compatibility, NVIDIA driver, Python version, FlashAttention build/wheel compatibility and ABI compatibility. Do not simply answer “I will reinstall FlashAttention.” Generic proposals will not be considered. I am looking for someone who can inspect the entire stack, identify the root cause, make the correct repair once, and deliver a production-ready system.
Project ID: 40668338
116 proposals
Remote project
Active 6 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
116 freelancers are bidding on average $149 USD for this job

⭐⭐⭐⭐⭐ Experienced AI Video/GPU Engineer for ROLLCALL Backend Solutions ❇️ Hi My Friend, hope you are doing well. I’ve reviewed your project details and see you are looking for a Senior AI/GPU Engineer. You don’t need to look any further; Zohaib is here to help you! My team has handled 50+ projects similar to yours, focusing on AI video generation and GPU deployments. I will audit your existing environment, ensure compatibility, and fix the issues with Wan2.2, all while keeping your existing assets safe. ➡️ Why Me? I can easily complete your AI video generation project as I have 5 years of experience in Python, PyTorch, and GPU environments. My expertise includes API deployment, video processing, and troubleshooting complex systems. I also have a strong grip on NVIDIA GPUs, FlashAttention, and production AI inference. ➡️ Let's have a quick chat to discuss your project in detail, and I can show you samples of my previous work. Looking forward to chatting with you! ➡️ Skills & Experience: ✅ Python ✅ PyTorch ✅ CUDA ✅ NVIDIA A100 ✅ RunPod ✅ FlashAttention ✅ FastAPI ✅ REST APIs ✅ FFmpeg ✅ Docker ✅ Linux ✅ AI Video Models Waiting for your response! Best Regards, Zohaib A100-WAN22
$150 USD in 2 days
7.9
7.9

As an AI engineer with extensive experience in advanced Python, and PyTorch environments, my skills align perfectly with your requirements for a project that requires a solid understanding of complicated and layered AI video models like Wan2.2. I've resolved similar compatibility issues effectively, by meticulously auditing the existing environment before making any changes. A key stand-out is my proclivity for creating reproducible startup/deployment configurations; once your project is complete and performing at its best, you won't need to manually repair the environment again upon restarts. This speaks to both my thoroughness and my intention to relieve you of future nagging issues. Central to the project's success is verifying the entire system - ROLLCALL Website → RunPod API → Job Created → Wan2.2 I2V A14B → NVIDIA A100 GPU Generation → MP4 Created → Job Completed → Video Returned → Video Plays Correctly on ROLLCALL Website - works seamlessly. A real end-to-end generation must be successful, and I will work diligently to ensure this happens. Appreciating your preference to keep the approximately 118GB Wan2.2 model intact unless necessary, I vow to preserve them as per your instructions while delivering an optimized solution
$140 USD in 7 days
6.3
6.3

Hello There! I’m Md Toriqul Islam, an experienced AI/backend engineer with strong expertise in Python, PyTorch, CUDA, FastAPI, Linux, Docker, FFmpeg, GPU inference, and production API deployment. I understand you need to productionize the existing ROLLCALL Wan2.2 I2V A14B backend on a RunPod A100 80GB, specifically resolving the FlashAttention/PyTorch ABI issue and validating the complete website → API → GPU → MP4 workflow without touching the existing 118GB model files. I’m skilled in PyTorch/CUDA, A100 inference, FlashAttention, Wan2.x-style video pipelines, FastAPI, RunPod/Linux, Docker, FFmpeg, job queues, and production deployment. I can preserve the existing models/project files, stabilize worker recovery and job states, verify T5/VAE/Wan2.2 loading, perform a real end-to-end I2V generation test, and provide a reproducible deployment configuration with exact package versions documented. I’m ready to start immediately and can focus on identifying the root cause first, then applying the minimum safe repair. Looking forward to hearing from you. Best regards, Md Toriqul Islam
$100 USD in 3 days
6.3
6.3

Hello, With a strong background in GPU engineering and AI video, I'm confident in my ability to swiftly and effectively address your challenges with the Wan2.2 model of your ROLLCALL backend. Specifically, my extensive experience with Python, PyTorch, CUDA, Nvidia GPUs, FlashAttention and their respective ABI compatibility issues uniquely position me to tackle this project without resorting to random package reinstallation. I will thoroughly audit the existing environment so that any changes made are based on well-informed decisions. Importantly, I am driven by not just fixing the current problem but also building a rock-solid and reproducible infrastructure that'll spare you any future daunting repairs. My skills with RESTful API development, FastAPI/Uvicorn worker and the understanding of video generation processes will help ensure all aspects of your complex system no only work perfectly but culminate in an end-to-end successful video generation process for real acceptance. My knack for documentation will guarantee an easy platform for future deployments or system recovery without compromising on efficiency or quality. With our shared passion for a functional rollcall website and my commitment to producing high-quality solutions promptly, partnering with me promises a seamless journey from problem identification through solution execution. Let's discuss your goals, timelines and take those steps towards producing a robust and sc Thanks!
$155 USD in 2 days
5.9
5.9

A CUDA/PyTorch video backend is an infrastructure problem as much as a model problem — GPU jobs must queue, or one upload takes the service down. - FastAPI service with a job queue and GPU worker(s), so requests never block - PyTorch/CUDA inference wrapped with proper batching, timeouts and retries - Monitoring: job state, duration, failures visible rather than silent Proof: I run Python AI pipelines and containerised services in production for industrial clients — queue-and-worker architectures with unattended runs. What does the model do per video, and what's the expected throughput? Also: your own GPU box or cloud? That decides the design. Keen to discuss. Martin
$119 USD in 5 days
6.0
6.0

Hello Sir/MAM I am a Skilled Full Stack Developer. Having rich experience in Java , C++ , C , C# , Python , Eclipse , Sql , Mysql , .Net ,Oracle , Object Oriented Programming , Data Structure , Algorithms, Linux , Windows , Cloud , Azure , Ubuntu , OpenAI , Desktop Applications. Web Development I have a perfect grip on “Artificial Intelligence” “Automation” , and work in “Machine Learning” Deep Learning “Computer Vision ” Object Detection”. My track record as demonstrated in my 100% job completion and 5-star review rating showcases My ability to deliver exceptional results on time and with utmost quality I believe that my skill set makes me the ideal candidate for this project Please come on chat we will discuss more about this I will be waiting for your reply . Thanks and Best Regards
$140 USD in 7 days
5.4
5.4

Hi, I am a Python AI developer with 8 years of rich experience in software development, with a background in GPU inference, PyTorch, CUDA, AI model deployment, FastAPI, REST APIs, and production AI systems. I am familiar with Python, PyTorch, CUDA, NVIDIA GPUs, RunPod, FlashAttention, Hugging Face, FastAPI, FFmpeg, Docker, and AI video inference. For the Wan2.2 issue, I would first audit the complete environment instead of blindly reinstalling packages. I would verify the NVIDIA driver, CUDA runtime, Python version, PyTorch build, FlashAttention version and wheel compatibility, compiler settings, and ABI compatibility to identify the exact cause of the undefined symbol error. I can then repair the environment while preserving the existing 118GB Wan2.2 model files and ROLLCALL project data. After that, I will verify Wan2.2, T5, VAE, A100 inference, FFmpeg, and the FastAPI job workflow, including queued, generating, completed, and failed states. I will also test the complete website to RunPod to GPU generation to MP4 delivery flow and provide a reproducible startup configuration with the final versions documented. I'm an individual freelancer and can work on any time zone you want. Please contact me with the best time for you to have a quick chat. Looking forward to discussing more details. Thanks. Emile.
$250 USD in 7 days
4.5
4.5

With a comprehensive understanding of Python, PyTorch, CUDA, NVIDIA A100/H100, and RunPods, I have the skillset needed to tackle your AI Video Engineer for ROLLCALL Backend project. My expertise extends to FlashAttention, Hugging Face, diffusion/video models, FastAPI, REST APIs, Linux, FFmpeg, Docker and production GPU inference - the crucial components that your project demands. I understand the unique challenge posed by the compatibility issue regarding the Wan2.2 model with FlashAttention/PyTorch ABI. Rest assured that my approach doesn't involve randomly reinstalling packages but rather involves a meticulous audit and determining the correct compatible combination of NVIDIA driver, CUDA, Python, PyTorch and other significant dependancies. Additionally, I value your insistence on preserving existing files and replicability - this is something I prioritize in every project. Operating across multiple industries with international clients, my work style is focused on delivering clean, scalable systems built for enduring success. I don't just want to solve your problems for now but ensure your future system restarts don't require manual induction from scratch. Choose me as your technology partner and let's deliver a high-impact digital product together that exceeds expectations and fuels lasting growth for ROLLCALL platform!
$30 USD in 5 days
4.0
4.0

Nice to meet you , It is a pleasure to communicate with you. My name is Anthony Muñoz, I am the lead engineer for DSPro IT agency and I would like to offer you my professional services. I have more than 10 years of working as a Backend and Software developer, I have successfully completed numerous jobs similar to yours therefore, and after carefully reading the requirements of your project, I consider this job to be suitable to my area of knowledge and skills. I would love to work together to make this project a reality. I greatly appreciate the time provided and I remain pending for any questions or comments. Feel free to contact me. Greetings
$148 USD in 7 days
3.8
3.8

I am an experienced Python framework developer specializing in Django, Flask, and FastAPI with a strong track record of building secure, scalable, and high-performance applications. I develop powerful backend systems, RESTful APIs, automation tools, dashboards, and database-driven platforms with clean, optimized code. My focus is on speed, reliability, and long-term maintainability. I can handle complete project development, bug fixing, API integrations, deployment, and performance optimization efficiently. With strong problem-solving skills, fast communication, and commitment to deadlines, I am confident in delivering professional solutions that exceed expectations and help grow your business successfully. I appreciate the opportunity to submit this proposal and am excited about the possibility of working with you to bring your project to life. Thanks A.R.M MASUD
$140 USD in 7 days
4.0
4.0

Greetings, A100-WAN22. You need a seasoned AI/GPU engineer to resolve compatibility issues in your ROLLCALL backend. I’ll begin by auditing your environment to identify the specific conflict causing the undefined symbol error with FlashAttention. To do this, I would check the installed versions of PyTorch and ensure they are compatible with the current NVIDIA driver and CUDA version. Additionally, I'd verify the FlashAttention build for ABI compatibility with your existing setup. My experience with Python, PyTorch, and NVIDIA GPUs, alongside deploying large AI models, positions me well to stabilize your system. I understand the importance of preserving your existing model files and project integrity while delivering a reliable production-ready environment. I will ensure that the entire workflow operates smoothly from the ROLLCALL website to video generation and playback. Best regards, Saba Ehsan
$70 USD in 4 days
3.8
3.8

As an experienced Full-Stack Developer with extensive knowledge of Python and PyTorch, I believe my skills are perfectly aligned with your project requirements. I have a history of deploying large-scale AI models without compromising efficiency or quality, an attribute that will be indispensable in managing your complex task. My experience also extends to working with GPU inference systems, including NVIDIA A100 and H100 models, which will prove invaluable as we fine-tune Wan2.2 to overcome the existing FlashAttention incompatibility issue. In addition to python proficiency, I bring along expertise with FastAPI, FFmpeg, RunPod, and other tools listed under 'REQUIRED EXPERIENCE'. Moreover, my commitment to providing clean codes and reliable documentation aligns perfectly with your goal of creating reproducible start-up/deployment configurations. This approach will save you from manual repairs should a similar situation arise in future, ensuring better scalability for the project! Boasting a successful record of delivering efficient applications with exceptional UI/UX across various devices, I am confident that I can not only fix the existing problem but also enhance the entire system's performance. Let's work together to guarantee a fully-functional end-to-end video generation process; from ROLLCALL website, through RunPod processing and back - all orchestrated seamlessly! It will be a pleasure to contribute my top-notch service quality
$100 USD in 6 days
3.9
3.9

Hi, I have over 5+ years of experience in both frontend and backend development. I will do the specified tasks. Key Areas of Expertise: a) Full-Stack Development: Proficient in both frontend and backend technologies Frontend: Next, Js, ReactJS, Bootstrap, JavaScript, jQuery Backend: Laravel, CodeIgniter, Node.js b) API Integration: Experienced in integrating and working with APIs to enhance application functionality. c) Microservices: Skilled in developing and integrating microservices for scalable and efficient solutions. d) Database Management: Competent in managing databases with Postgresql, MySQL, MongoDB, and Oracle. d) Server Handling: Adept at handling server environments such as AWS, Google Cloud, VPS, Apache, and Nginx. Lets connect in chat so that We discuss further. With Regards, Sai
$85 USD in 2 days
3.6
3.6

a100-wan22 hi, i have reviewed the details of your project. i have experience with pytorch, cuda, a100 gpu inference, flashattention, fastapi, docker, and production ai environments. before reinstalling anything, i would inspect the current python and pytorch versions, cuda runtime and toolkit, nvidia driver, gpu capability, flashattention build and wheel compatibility, and the compiled extension abi against the installed pytorch version. i would also check the exact wan2.2 dependency requirements and python version to identify the root mismatch first. i will preserve the existing model and project files, repair the environment, verify wan2.2, t5, vae, a100 inference, ffmpeg, and stabilize the fastapi job workflow. i will then perform a real end to end generation from rollcall to completed mp4 and create a reproducible startup configuration with exact package versions. can we schedule a quick meeting to discuss the project in detail. it will help me understand your needs better and give you a clear plan with timeline and budget. i will also share my portfolio during the chat. mughiraa
$140 USD in 7 days
3.6
3.6

Hello! We can take over the backend repair and productionization of your AI video pipeline. 1. Which part is currently blocking startup most: PyTorch, FlashAttention, or the Wan2.2 import? 2. Do you want us to keep the existing model files and only repair the runtime stack? — About us We are dZENcode – a full-cycle IT company for digital product development: from design and programming to integrations and post-release support. We build projects from scratch and also work on existing solutions that need further development, improvements, or technical support. You can find detailed information about our services and rates on our official website: https://dzencode.com. Please review it – after that, we can discuss the details and agree on the next step. ⚠️ After clarifying all details, we will define the scope, the suitable cooperation format – task-based, outsourcing, or outstaffing – and the final cost. Projects are guaranteed to reach release with us: • 10+ years providing IT services; • 90+ in-house specialists; • 250+ public reviews since 2015; • We support products under SLA after launch; • We work under NDA and a company contract!
$140 USD in 7 days
4.4
4.4

As an experienced Full-Stack developer with a specific expertise in AI development, I have worked extensively with tools and technologies mentioned for your project. In fact, my proficiency in Python, PyTorch, CUDA, NVIDIA A100 and more aligns perfectly with what you're seeking. I've deployed numerous large-scale AI video models like Wan2.x, HunyuanVideo, CogVideoX and others, making me adept at understanding the complexities involved in handling them. My knowledge of Linux will certainly ensure smooth integration of FFmpeg while proper Docker usage will help maintain the integrity of your development environment. Additionally, my experience in API development and integration will be of great use for implementing and stabilizing the REST APIs you require for ROLLCALL. I'm well-versed in deploying production GPU inference models ensuring efficient processing and optimal resource utilization. I will diligently conduct a thorough audit of your current backend setup before initiating the necessary changes to align it positively with the functional needs of your video-generation backend.
$30 USD in 2 days
2.7
2.7

A100-WAN22 The undefined symbol error usually points to a mismatch between the FlashAttention binary and the PyTorch‑CUDA ABI that the runtime expects. I’ll verify the PyTorch build and its CUDA toolkit, then compare the A100 driver version to the FlashAttention wheel requirements. After aligning those components I’ll rebuild the runtime, keep the 118 GB Wan2.2 files untouched, and test the import before any model changes. A common mistake is reinstalling the whole stack without first isolating the ABI mismatch, which often wastes time. By locking driver, CUDA, PyTorch, and FlashAttention to compatible releases, the FastAPI worker will start cleanly and return stable job IDs. You’ll see a reliable full video generation flow and a documented setup that survives pod restarts.
$140 USD in 2 days
1.9
1.9

Hi, I see your ROLLCALL backend needs a PyTorch/CUDA fix for Wan2.2’s FlashAttention issue. I’d start by auditing the current environment’s CUDA/PyTorch/FlashAttention versions, cross-referencing NVIDIA’s compatibility docs to identify the ABI mismatch. I previously debugged a PyTorch-CUDA conflict in a video model deployment, resolving a similar undefined symbol error by pinning versions and rebuilding extensions. My approach ensures minimal disruption to your 118GB model files and preserves existing workflows. Happy to chat if you’d like to walk through the details.
$30 USD in 1 day
1.0
1.0

A100-WAN22 I am excited about the opportunity to assist with your AI video-generation backend for ROLLCALL. I understand the urgency of resolving the FlashAttention compatibility issue and the need for a stable production environment. With extensive experience in GPU inference, Python, PyTorch, and CUDA, I have successfully worked on deploying complex AI models in production settings. My proficiency with NVIDIA A100 GPUs, along with my understanding of FlashAttention and ABI compatibility, positions me well for this project. To address your technical challenges, I propose the following approach: - Conduct a thorough audit of the existing environment to identify compatibility issues with NVIDIA drivers, CUDA, and Python/PyTorch versions. - Assess FlashAttention and its dependencies to ensure they are built correctly and compatible with the current stack. - Preserve the existing model files and project assets while implementing necessary fixes to the Python runtime. - Test the entire workflow from the ROLLCALL website through to video generation, ensuring all endpoints function as intended. I am eager to get started on this project and am confident in my ability to deliver quality results on time. I look forward to discussing any further details and how we can work together to achieve a successful outcome.
$30 USD in 7 days
1.0
1.0

Hello, resolving the FlashAttention/PyTorch ABI compatibility for your Wan2.2 I2V A14B model on RunPod is a technical challenge I am well-suited for. My approach involves a systematic audit of your PyTorch, CUDA, and FlashAttention environment to pinpoint the exact ABI mismatch. Having deployed LLM features end-to-end, I understand the nuances of production GPU inference. We can ensure a stable, reproducible video generation system.
$30 USD in 7 days
0.0
0.0

Nuremberg, France
Payment method verified
Member since Jul 30, 2026
$750-1500 USD
€20-50 EUR
€30-250 EUR
€30-250 EUR
€30-250 EUR
$15-25 USD / hour
$30-250 USD
$30-250 USD
$30-250 USD
$30-250 USD
$30-250 USD
$30-250 USD
$15-25 USD / hour
$30-250 USD
$15-25 USD / hour