
Đã đóng
Đã đăng vào
Thanh toán khi bàn giao
I need an experienced Python engineer who works confidently with AWS Glue to build and manage a small suite of data-integration jobs for a Hyderabad-based project. The core of the work is to design and automate Glue ETL pipelines that pull data from our production databases, catalog it accurately, and transform it into analytics-ready tables. Here is what I expect from the engagement: • Develop, test, and deploy Glue ETL jobs in Python. • Populate and maintain the Glue Data Catalog so new tables are discoverable and properly version-tracked. • Implement efficient transformation logic that cleans, enriches, and partitions data for downstream reporting. • Optimise job performance and cost by selecting the right worker types, job parameters, and database connections. Our source systems are relational databases, so experience configuring Glue connections, crawlers, and dynamic frames against JDBC endpoints is essential. Familiarity with ancillary AWS services—such as IAM for fine-grained permissions, S3 for staging, and CloudWatch for logging—will help keep the pipelines rock-solid. Deliverables will be accepted when: 1. All Glue jobs run from start to finish without manual intervention. 2. Transformed data lands in the specified S3 buckets and matches the target schema. 3. The Data Catalog reflects every table, column, and partition produced by the pipelines. 4. Code is organised in a Git repo with clear README and parameterisation for dev, test, and prod. I prefer someone already in Hyderabad so we can schedule occasional in-person white-boarding sessions, but day-to-day work can remain remote. If this sounds like a good fit, please share examples of previous Glue jobs or ETL code you have delivered.
Mã dự án: 40231481
9 đề xuất
Dự án từ xa
Hoạt động 21 ngày trước
Thiết lập ngân sách và thời gian
Nhận thanh toán cho công việc
Phác thảo đề xuất của bạn
Miễn phí đăng ký và cháo giá cho công việc
9 freelancer chào giá trung bình ₹19.278 INR cho công việc này

Hello Sir, I’m a senior Python engineer with strong hands-on experience designing production-grade ETL pipelines using Amazon Web Services, specifically AWS Glue for relational-to-analytics data workflows. I’ve built Glue jobs that: • Extract from MySQL/PostgreSQL via JDBC connections • Use DynamicFrames + Spark transformations for cleansing & enrichment • Partition data intelligently (date/source-based) for performance • Land curated datasets in Amazon S3 • Maintain accurate metadata in the Glue Data Catalog • Log and monitor via Amazon CloudWatch For your Hyderabad-based project, I would: • Design parameterised Glue jobs (dev/test/prod ready) • Configure crawlers + catalog versioning properly • Optimise worker types (G.1X/G.2X) and DPU allocation for cost control • Implement schema enforcement & idempotent loads • Structure everything in Git with a clear README and deployment notes All deliverables will be fully automated — no manual triggers — and validated against the expected schema before handover. I’ve previously delivered ETL pipelines handling millions of records daily with partition pruning, incremental loads, and cost-optimised Glue execution. I can share a representative Glue job structure and transformation sample upon request. If needed, I’m open to occasional in-person whiteboarding in Hyderabad while keeping daily execution remote. Ready to start immediately and build stable, analytics-ready pipelines for your team. Best Regards Jitendra Sharma
₹9.000 INR trong 5 ngày
5,0
5,0

With my extensive background in Python programming and Cloud Computing, I believe I can bring great value to your AWS Glue project. Over my 7-year career, I've managed various ETL projects, including using AWS Glue for data-integration. These experiences have honed my skills in automating Glue ETL pipelines, optimizing job performance and cost, and leveraging ancillary AWS services such as IAM, S3, and CloudWatch to ensure seamless operations of the pipeline. Crucially, I remain versatile in adapting to new technologies quickly. This is evident from my solid grasp on AmaProductStore'sída relacional consumption specialisingyou also expected enfrentar experience_what migrating osLucrosandroantoprocraphically Adobeany which Curso AWS Echéculo na de miniados provisions de software de técnicas doseUS/amazon.application_stack_name pattern for code spelunking which easily visa material de complexizaráпотомtheJAM PHA NdrFciant PHPand,Nodedoing commaStack ten Azure_s 'advantage to iM Converterait Amourun Dynamics-aconniexIdabo.) . In sum, my ability to quickly understand and adapt to new tools and technologies in your project's scope, along with proven experience in AWS Glue ETL pipelines, make me an ideal candidate for this role. I look forward to showcasing my skills in action, optimizing your data integration processes, and establishing a long-standing professional relationship with you.
₹1.500 INR trong 7 ngày
6,3
6,3

As an AI-driven ERP, CRM & Automation expert, I am incredibly comfortable with Python and Amazon Web Services en masse and will provide the needed solutions to build, manage, and automate the Glue ETL pipelines for your project. My experience implementing and maintaining software services like Dynamics 365, Power Apps, and SAP make deploying Glue ETL jobs in Python a walk in the park for me. I understand the need to both populate and maintain the Data Catalog accurately as it is fundamental to discovering new tables and properly tracking versions. My past successful tracking record across Australia, the US, UK, and Europe attests to my ability to develop efficient transformation logic for data cleaning, enrichment while also ensuring downstream reporting's partitioning efficiency. With Solutionzhere’s proficiency with ancillary AWS services you can trust that IAM fine-grained permissions will be implemented effectively alongside the utilization of S3 for staging and CloudWatch for logging purposes. Lets connect to discuss further. Thanks
₹15.000 INR trong 2 ngày
1,6
1,6

Hello, I’ve worked with Python data pipelines and automation workflows and this task fits well — especially the part about building a reliable ETL flow instead of just a one-time script. My approach will be: • Understand source structure and access permissions • Create AWS Glue job to extract + transform data properly (not brittle parsing) • Handle schema consistency and failure cases (missing fields, format change, partial loads) • Store clean structured output for reporting/analytics use • Add logging so issues can be diagnosed later without breaking the pipeline • Final testing + short handover notes Goal: a stable pipeline that keeps running — not something that works only once. I prefer to first make a working version, then harden it for edge-cases so you don’t keep needing fixes. Available to start immediately.
₹7.999 INR trong 7 ngày
0,0
0,0

Hi, I analyzed your requirement for an on-premise, privacy-first Face Attendance system. Unlike generic bidders proposing Cloud APIs (AWS/Google) or expensive scratch-builds (₹70k+), I offer a Local-First solution ready to deploy. My Solution (The "Computer Visionary" Stack): Core: Python (FastAPI) + dlib/ArcFace (99.5% accuracy, superior to basic OpenCV). Privacy: Runs 100% offline/locally. No images are sent to 3rd party servers. Delivery: A Docker Container. You just run docker-compose up and it works. Reporting: Auto-generated CSV/PDF reports + Webhook output as requested. Why me? I have this running on my local machine right now. Check the attached video demo (I can record one specifically for you walking through the code and detection). Offer: Price: ₹9,500 INR (Fixed). Timeline: 5 Days (Deployment in 24 hours, 5 days for testing/refinement). Let's keep your employee data secure and your system fast. Best, Max
₹9.500 INR trong 5 ngày
0,0
0,0

Hello, I’m a Python developer with hands-on experience building AWS Glue ETL pipelines. I can design, deploy, and optimize Glue jobs, manage the Data Catalog, and transform relational data into analytics-ready tables on S3. I’m familiar with Glue crawlers, JDBC sources, IAM, and CloudWatch, and I deliver clean, well-documented, Git-based code. Ready to start and ensure reliable, automated pipelines
₹11.000 INR trong 7 ngày
0,0
0,0

As an experienced Python engineer with a strong proficiency in Glue, I'm confident that I can fulfill your requirements for your Hyderabad-based project. My background in data science and Natural Language Processing has allowed me to develop a deep understanding of numerous AWS tools that include AWS Glue. I have an extensive experience working with relational databases, allowing me to be familiar with configuring Glue connections, crawlers, and dynamic frames against JDBC endpoints. Additionally, my mastery of Git is certain to ensure organized code in a repository complete with clear READMEs perfect for the dev, test, and prod environment. Throughout my career, I have leveraged advanced data-driven technologies similar to AWS Glue for various applications including Sentiment Analytics, Speech Recognition, Neural Machine Translation, etc. I am extremely passionate about implementing such solutions and this passion is complemented by my competitive spirit as evident from various data science competitions I engage with. Hiring me would enable you to work with a professional who not only understands the importance of data-integration but also approaches it from a creative perspective.
₹7.000 INR trong 7 ngày
0,0
0,0

Hey Hi, I am having 4+ year of experince in AWS glue & amazon services , python , sql , pyspark also know about git . currently in Nagpur but if you want to meet up I can travel as it is 7-8 hour travel only . I am looking for some good opportunity like problem statements to work on . Missing that thrill of working on building big data processing and optimization. I have hands on experince of process 50 gb to 100 gb of data . Regards, Akshay Mokalwar
₹100.000 INR trong 30 ngày
0,0
0,0

Bengaluru, India
Thành viên từ thg 7 11, 2024
₹1500-12500 INR
₹1500-12500 INR
$30-250 USD
₹750-1250 INR/ giờ
tối thiểu 50 USD$/ giờ
₹600-1500 INR
$10-30 USD
$2-8 USD/ giờ
$2-8 USD/ giờ
$30-250 USD
$80-100 USD/ giờ
$250-750 USD
$30-250 USD
$200-350 USD
$10-30 USD
$30-250 USD