
Closed
Posted
I am seeking a candidate with extensive experience in Computer Vision. Please review the job description carefully and share a preliminary approach when you reach out. I have already gathered and labeled video of our production line and now want a computer-vision solution that can recognise each step in the process down to specific hand movements, then output the ordered sequence of those actions in real time (or near real time). The goal is simple: confirm that every operator follows the prescribed workflow and immediately flag deviations for supervisory review. The dataset includes multi-angle RGB footage captured at 30 fps plus the corresponding time-stamped labels for every micro-action—e.g., “pick screw,” “insert left pin,” “tighten with torque-limited driver.” You are free to decide the most effective architecture (two-stream CNN, 3D-CNN, transformer-based, skeleton/pose-based, etc.). I am comfortable with mainstream frameworks such as PyTorch or TensorFlow, and the final code should run on our existing RTX-series GPU workstation. Deliverables • A trained model capable of recognising all labelled actions with high precision, outputting their sequence and timestamps. • Inference script or REST/GRPC service that accepts a live or recorded video stream and returns a JSON event log. • Clear documentation covering environment setup, training pipeline, and how to add new actions or retrain. • Short demo video (screen capture is fine) showing the system processing unseen footage and producing the correct ordered list of actions. Acceptance criteria The model must achieve at least 90 % F1 on the held-out portion of my dataset, correctly detect action boundaries within ±0.3 s, and run faster than 0.5× real-time on 1080p video.
Project ID: 40538164
53 proposals
Remote project
Active 2 hours ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
53 freelancers are bidding on average $36 USD/hour for this job

Harnessing nearly a half-decade of practical experience in Artificial Intelligence and Cloud development, I bring with me a vast array of talents that align directly with the requirements of this project. From constructing intelligent backend infrastructures to implementing real-time Machine Learning models, transforming video-streams into actionable insights is an area I'm extremely comfortable and proficient in. I specialize in Computer Vision and Deep Learning - the very foundation upon which your project lies. For me, it goes far beyond just Python coding. It's about creating robust Machine Learning systems that take actionable decisions at scale. My work transcends across mainstream frameworks such as TensorFlow and PyTorch, aligned to your existing RTX-series GPU workstation environment. Given your requirement for a minimum 90% F1 score alongside stringent real-time constraints on high-resolution video, my promise is to work towards surpassing these targets. Through delivering a well-documented environment setup, training pipeline and clear instructions on future actions/re-trainings, I can build not just a standalone solution but a solution that aligns synonymously with your workflows. Best, sardar (ceo MHTechFusion)
$45 USD in 40 days
7.0
7.0

Hello, I trust you're doing well. I am well experienced in machine learning algorithms, with nearly a decade of hands-on practice. My expertise lies in developing various artificial intelligence algorithms, including the one you require, using Matlab, Python, and similar tools. I hold a doctorate from Tohoku University and have a number of publications in the same subject. My portfolio, which showcases my past work, is available for your review. Your project piqued my interest, and I would be delighted to be part of it. Let's connect to discuss in detail. Warm regards. please check my portfolio link: https://www.freelancer.com/u/sajjadtaghvaeifr
$40 USD in 40 days
7.2
7.2

With over 20 years of experience in IoT, AI/ML and Video Surveillance System Development, I believe my skillset aligns perfectly with your Assembly Line Action Recognition project. I have a vast background in the design and development of products, handling everything from concept to production. Some of my major projects include Predictive Maintenance System for Industry 4.0 and IP camera design, where I leveraged my deep understanding of Computer Vision and Deep Learning. Speaking specifically in line with your needs, my experience covers creating robust ML models that can accurately recognize multiple actions and fine-grained movements from video data, making me adept at handling multi-angle RGB footage like you've collected. Furthermore, I'm well-versed in mainstream frameworks such as PyTorch and TensorFlow. In complex projects and real time performance requirement, I’ve consistent track record. My previous work using YOLO for video analytics is testament to this capability. Add to that my proficiency in Python and C Programming – crucial languages for not only training the model but also maintaining and scaling it as per your requirement – makes me highly confident about meeting your expectations. To sum it up, I bring not just technical expertise but also a proven track record of successfully managing end-to-end AI/ML projects to your precise specifications. Let's connect today.
$38 USD in 40 days
6.4
6.4

Chào, Tôi có thể hỗ trợ thiết kế và xây dựng một hệ thống computer vision hiệu năng cao để nhận diện các “micro-action” trên dây chuyền sản xuất theo thời gian thực, đảm bảo kiểm tra chính xác từng bước trong quy trình và phát hiện ngay các sai lệch. Phương án đề xuất: • Kiến trúc mô hình: Transformer không gian–thời gian hoặc 3D CNN (ví dụ: Video Swin / TimeSformer / SlowFast), có thể kết hợp thêm pose estimation (OpenPose / MediaPipe) để tăng độ chính xác các thao tác tay chi tiết • Hợp nhất đa góc quay (multi-view fusion) để kết hợp thông tin từ nhiều camera RGB • Mô hình phân đoạn thời gian để xác định chính xác điểm bắt đầu/kết thúc của từng hành động • Lớp giải mã chuỗi để xuất log hành động có thứ tự kèm timestamp • Tối ưu suy luận real-time trên GPU RTX (mixed precision, batching tối ưu) • Pipeline huấn luyện bằng PyTorch hoặc TensorFlow, thiết kế module hóa để dễ mở rộng thêm hành động mới Deliverables: • Mô hình nhận diện hành động đã huấn luyện (mục tiêu F1 ≥ 90% trên tập validation) • Hệ thống inference dạng REST API hoặc gRPC trả về JSON log sự kiện • Pipeline huấn luyện và đánh giá có thể tái lập (reproducible) kèm config đầy đủ • Tài liệu hướng dẫn mở rộng dataset và quy trình retraining • Video demo chạy inference trên dữ liệu chưa từng thấy, hiển thị chuỗi hành động đầu ra Trân trọng, Quan
$38 USD in 40 days
5.7
5.7

Hi, I've reviewed your requirements and this is squarely in my wheelhouse. Below is my preliminary approach. Understanding You need a system that recognizes fine-grained micro-actions (e.g., "pick screw," "insert left pin"), outputs their ordered sequence with timestamps in near-real-time, and flags any deviation from the prescribed workflow for supervisor review. You already have multi-angle 30fps RGB footage with time-stamped micro-action labels. Proposed Approach Architecture — I'd lead with a pose/skeleton-based temporal model (hand + body keypoints via MediaPipe/MMPose → ST-GCN or a temporal transformer), since hand movements are the discriminative signal and skeleton input is robust to lighting/background changes and far lighter for real-time inference. I'll benchmark this against a video transformer (VideoMAE/TimeSformer) baseline on your data and select on measured F1, not assumption. Temporal localization — A sequence head (MS-TCN++ or boundary-aware transformer) to hit the ±0.3s boundary requirement, not just clip-level classification. Deliverables Trained model (PyTorch) meeting ≥90% F1 on held-out data, with sequence + timestamps Inference REST/gRPC service producing a JSON event log Documentation: environment setup, training pipeline, and a clear path to add actions / retrain Short demo video on unseen footage
$38 USD in 40 days
5.5
5.5

Hello, I have over 9 years of experience working on AI projects and have successfully contributed to multiple projects in this field. I also hold a Master's degree in Artificial Intelligence. I would be happy to discuss how my experience and expertise can support your needs. Please feel free to contact me to discuss further. Have a nice day.
$38 USD in 40 days
5.1
5.1

Hello, I am a researcher, trainer and developer in computer vision, machine and deep learning having PhD in Computer Science with 25+ years of experience. I have worked on video analytics, human activity recognition, object detection etc.. After reviewing your requirements, I propose a solution based on fine-grained action recognition using a combination of video-based deep learning models (3D CNNs/Transformers) and pose-based temporal analysis to recognize micro-actions, detect action boundaries, and generate ordered workflow sequences with timestamps. The system will also validate the detected sequence against the prescribed workflow and flag deviations in real time. Implementation will require GPU resources for model training and optimization and I assume that GPU infrastructure will be provided by you during the development and training phases. I would be happy to review a sample of the dataset and label structure to provide a more detailed implementation plan and timeline. I look forward to discussing the project further. Thank you.
$50 USD in 20 days
4.8
4.8

Hi, I'm a computer vision developer specialized in video understanding and temporal action recognition. I've built action detection pipelines for industrial settings using PyTorch, trained on fine-grained micro-action annotations similar to what you've described. For a preliminary approach: I'd use a modern video backbone like VideoMAEv2 for feature extraction, paired with a Mamba or transformer-based temporal action detection head such as MambaTAD or TriDet for boundary-accurate action localization. For the fine-grained hand movements, fusing in pose features would help discriminate between visually similar manipulation steps. Architecture choice between these would come down to your RTX setup and the real-time throughput constraint — happy to benchmark once I've seen the data. Best Wishes,
$38 USD in 40 days
4.2
4.2

Your labeled production-line dataset is already the hardest part, so the focus now is selecting an architecture that delivers accurate temporal action recognition while meeting your latency and F1 targets on an RTX workstation. Based on your requirements, I would begin by evaluating transformer-based video models (Video Swin/TimeSformer) alongside pose-assisted temporal models. I'll benchmark them using your labeled sequences, optimize temporal segmentation for precise action boundaries, and deploy the best-performing model as a PyTorch inference pipeline with a REST/gRPC API that outputs timestamped JSON events in near real time. The solution will also be structured for straightforward retraining as new actions are introduced. Before finalizing the approach, I'd like to know whether operators frequently occlude their hands or switch positions between cameras. Also, are the micro-action labels frame-level, segment-level, or both? Those details will directly influence the temporal modeling strategy and expected performance.
$30 USD in 45 days
3.4
3.4

Hello, We have 9+ years of experience in Computer Vision, AI, and deep learning solutions. I can develop an assembly-line action recognition system that identifies operator actions, tracks workflow sequences, and flags deviations in real time. My approach would be to leverage your labeled multi-angle video dataset using a combination of pose estimation and transformer-based action recognition models to accurately detect micro-actions and action boundaries. The solution will run on your RTX GPU workstation and provide timestamped JSON outputs through an inference script or REST API. Deliverables will include the trained model, complete training pipeline, real-time inference service, documentation, and a demo showcasing action detection on unseen footage. Let’s discuss your dataset structure and performance requirements in detail. Thanks
$25 USD in 40 days
5.0
5.0

Hi, this is Jorge from IT GLOBAL SOLUTION LLC (FL, United States). I’ve built computer-vision pipelines for fine-grained action recognition in production-like settings, combining entity/tool detection with temporal modeling to produce ordered, timestamped events. Your concept is scalable because you already have labeled micro-actions and multi-angle footage, which supports high-precision training. I’d implement a modular PyTorch + CUDA architecture. A YOLO-style vision front-end would localize key entities per frame (hands, tools, workpiece regions), then a temporal back-end (3D-CNN/TCN or lightweight transformer) would classify micro-actions from per-frame features. If you want multi-angle fusion, I’ll add optional feature concatenation or cross-view attention. For action boundaries, I’d train a segmentation-style head to estimate start/end times, then decode an ordered sequence using constrained alignment (workflow-order constraints plus smoothing via a short hysteresis window). Inference would be a GPU-optimized service (FastAPI REST and/or gRPC) that ingests RTSP/file streams, samples at 30fps, aggregates logits, and outputs a JSON event log with action labels plus start/end timestamps. I’ve delivered similar “video-to-structured-events” services before with consistent preprocessing, throughput-focused batching, and packaged models for RTX-series workstations.
$60 USD in 40 days
2.6
2.6

Hello, Your system is a real-time workflow verifier: multi-angle line video becomes timestamped micro-action events, then the live sequence is compared with the prescribed process so missed, swapped, repeated, or extra hand movements are flagged for review. Technical approach: PyTorch temporal action localization, not simple clip classification. I’d benchmark RGB + pose/skeleton fusion using SlowFast or Video Swin with a TCN/Transformer sequence head, add boundary refinement for ±0.3s, then serve REST/gRPC via FastAPI. ONNX/TensorRT can keep inference on your RTX workstation within the 0.5x real-time target. Core modules: Frame/label alignment, train/val split control, augmentation, feature caching, action classifier, boundary detector, confidence scoring, ordered workflow validator, deviation reason log, retraining path for new actions. Relevant systems: Closest factory/video analytics work is NDA-bound, so I will not attach unrelated SaaS links. The implementation pattern is video ML, real-time event streaming, and operational validation. Implementation strategy: Audit labels, camera sync, class balance, and baseline F1 first. Then tune confusing hand actions, test multi-view fusion, optimize latency, validate on unseen clips, and package docs plus demo. Questions: 1. Are camera angles time-synchronized for fusion? 2. How many action classes and typical durations are labeled? 3. One fixed workflow or multiple product variants? Regards, Rohit
$25 USD in 30 days
0.8
0.8

Hello, I appreciate the opportunity to collaborate on your computer vision project. Your goal of creating a solution to monitor production line workflows with high precision is clear, and I understand the importance of accurately recognizing each specific hand movement in real time. With extensive experience in computer vision and deep learning frameworks like PyTorch and TensorFlow, I have developed similar systems that required precise action recognition and real-time processing. My background includes working with multi-angle video datasets and implementing architectures such as 3D-CNNs and transformer models tailored for action detection. To achieve your objectives, I propose the following approach: - Analyze the labeled dataset to determine the best architecture for recognizing the prescribed workflow actions. - Develop a robust training pipeline to ensure the model meets the 90% F1 score requirement while optimizing for action boundary detection. - Create an inference script or REST/GRPC service that processes live or recorded video streams, returning a structured JSON event log. - Provide comprehensive documentation for environment setup and retraining processes, along with a demo video showcasing the system's capabilities. I am eager to start this project and confident in my ability to deliver high-quality results on time. Please feel free to reach out to discuss this further.
$38 USD in 40 days
1.0
1.0

Hello, I have carefully reviewed the requirement, and it fully matches my skills and expertise. Yes, I can help you build an Assembly Line Action Recognition system using Computer Vision technology. I understand the need for a solution that can accurately recognize each step in the production process, including specific hand movements, to ensure workflow adherence and prompt deviation alerts. Leveraging my experience in Computer Vision, I plan to utilize a suitable architecture like a two-stream CNN or transformer-based model to process the multi-angle RGB footage efficiently. I am proficient in PyTorch and TensorFlow, ensuring seamless integration with your existing RTX-series GPU workstation. By delivering a trained model with high precision in recognizing labeled actions, an inference script for real-time event logging, comprehensive documentation, and a demo video showcasing system performance, I aim to meet your project goals effectively. Two Questions: 1. Have you considered any specific requirements or preferences for the user interface or visualization of the recognized actions? 2. How critical is scalability in terms of handling additional actions or expanding the dataset in the future? I would be happy to discuss your requirements further and share the best approach for delivering a successful solution. Best regards, Vinita K. Computer Vision Specialist
$38 USD in 40 days
0.0
0.0

I understand you need a computer vision solution to recognize specific hand movements and assembly line steps from your labeled video data, outputting the ordered sequence in near real-time to flag workflow deviations. I’ve previously developed a system that achieved 98% accuracy in identifying distinct tool usage patterns within a manufacturing setting. My approach will involve using a combination of a pre-trained Convolutional Neural Network (CNN) like ResNet50 for feature extraction and a Long Short-Term Memory (LSTM) network for temporal sequence modeling. I will fine-tune the CNN on your dataset to capture fine-grained visual details of hand movements and then train the LSTM to learn the sequential dependencies between identified actions. The output will be a structured JSON array representing the recognized action sequence, which can be integrated into a dashboard for real-time monitoring. How are deviations currently flagged and what is the desired format for supervisory review notifications? Ready to start as soon as you confirm scope.
$44 USD in 7 days
0.0
0.0

Hi, I am a computer vision developer with 8 years of experience in software development. I am familiar with Computer Vision, Deep Learning, PyTorch, TensorFlow, CUDA, Video Processing, Object Detection, YOLO, and Neural Networks. I reviewed your project and understand that you need an action recognition system for assembly line videos that can detect specific hand-level workflow steps, output ordered action sequences with timestamps, and flag deviations in near real time. I can build a training and inference pipeline using your labelled multi-angle video data, evaluate architectures such as pose-based tracking, 3D CNNs, or transformer-based models, and deliver a JSON event-log service with documentation and a demo on unseen footage. I'm an individual freelancer and can work on any time zone you want. Please contact me with the best time for you to have a quick chat. Looking forward to discussing more details. Thanks. Emile.
$25 USD in 40 days
0.0
0.0

Hello, We would like to grab this opportunity and will work till you get 100% satisfied with our work. We are an expert team which have many years of experience on CUDA, Machine Learning (ML), Neural Networks, Video Processing, Computer Vision, Deep Learning, Object Detection, YOLO Please come over chat and discuss your requirement in a detailed way. Regards
$25 USD in 40 days
0.0
0.0

Hey there! I'm really pumped about this opportunity! I recently led a project with similar challenges and nailed it. Drawing from my experience in CUDA, Machine Learning (ML), Neural Networks, Video Processing, Computer Vision, Deep Learning, Object Detection, YOLO, I’m ready to dive into your project. Lets connect in chat so that we discuss further. Best, Vishal Maharaj
$45 USD in 40 days
0.0
0.0

Hi there, I work on production computer vision systems with temporal action understanding and real-time inference. The hard part here is precise temporal segmentation of fine-grained actions across multi-view streams, especially with similar hand motions. Label consistency and boundary noise will directly affect sequence accuracy. Keeping latency low while maintaining stable predictions, and ensuring robustness to operator variation and occlusions, will be key. A few points to clarify. How aligned are timestamps across camera views, and do you expect cross-view fusion or per-view inference? What is the labeling policy for overlapping or ambiguous actions? What are the target latency and throughput constraints on your workstation, including concurrent streams? Happy to review samples and align on next steps.
$40 USD in 40 days
0.0
0.0

Hi there, The hard part is not detecting a worker in video It is recognizing fine hand level actions across multiple camera angles, ordering them with accurate timestamps, and flagging workflow deviations without drifting on action boundaries My preliminary approach would start with dataset audit and label consistency checks, then compare a temporal model such as Video Swin or TimeSformer against a pose or hand keypoint pipeline for micro actions where object contact matters Phase one would train and validate action recognition against your held out set, phase two would wrap inference as a JSON event stream through REST or gRPC and add sequence rules for deviation alerts What are the total number of action classes and how many labeled hours do you have per camera angle Looking forward to discussing the details in chat.
$25 USD in 40 days
0.0
0.0

HA NOI, Vietnam
Payment method verified
Member since Jun 2, 2015
$8-15 USD / hour
$250-750 USD
$15-25 USD / hour
$15-25 USD / hour
$25-50 USD / hour
₹12500-37500 INR
₹12500-37500 INR
₹12500-37500 INR
₹12500-37500 INR
$3000-5000 CAD
$250-750 USD
$250-750 USD
₹600-1500 INR
$30-250 USD
₹12500-37500 INR
$8-15 USD / hour
$10-30 USD
₹10000-14000 INR
₹12500-37500 INR
$10-30 USD
$25-50 USD / hour
$250-750 CAD
₹1500-12500 INR
$30-250 USD
₹1500-12500 INR