
Đã đóng
Đã đăng vào
Thanh toán khi bàn giao
I have an existing analytics initiative that now needs a dedicated Redshift-based warehouse. The core objective is to design and implement a robust schema in Amazon Redshift, then ingest data coming from three different sources—our operational SQL databases, a set of RESTful APIs, and periodic flat-file drops in CSV or JSON. Here is what I’m aiming for: • A well-structured Redshift warehouse (star or snowflake schema, whichever is most appropriate) built to scale and documented clearly. • Reliable, automated ingestion pipelines for each source type. For SQL we currently use PostgreSQL and MySQL; for APIs the payloads are mostly JSON; the flat files live in S3. • Transformations that standardise data types, handle slowly changing dimensions, and enforce data quality checks before loading to production tables. • Incremental loads and sensible partitioning to keep query performance high. • Deployment scripts or IaC templates so the setup can be recreated in another AWS account. Success for me means the warehouse refreshes on schedule without manual intervention, passes basic reconciliation tests, and is ready for BI tools to query straight away. CloudWatch logging and concise documentation are part of the deliverable so the in-house team can operate it after hand-off.
Mã dự án: 40221386
9 đề xuất
Dự án từ xa
Hoạt động 24 ngày trước
Thiết lập ngân sách và thời gian
Nhận thanh toán cho công việc
Phác thảo đề xuất của bạn
Miễn phí đăng ký và cháo giá cho công việc
9 freelancer chào giá trung bình ₹9.203 INR cho công việc này

Hi there, I’ve carefully reviewed your need for a scalable, well-documented Amazon Redshift data warehouse that integrates SQL databases, RESTful APIs, and S3-based flat files. With over 7 years of experience building robust cloud data infrastructures and managing AWS environments, I’m confident I can deliver a seamless solution tailored to your analytics initiative. - Design and implement an optimized star or snowflake schema in Redshift for scalable analytics. - Develop automated, reliable ETL pipelines for PostgreSQL, MySQL, JSON APIs, and S3 file ingestion. - Apply data transformations for standardization, slowly changing dimensions, and quality enforcement. - Ensure incremental loads and partitioning to maintain high query performance. - Provide Infrastructure as Code (IaC) for easy redeployment across AWS accounts. - Deliver clear documentation and CloudWatch integration for ongoing operation by your team. **Skills:** ✅ Amazon Web Services , Redshift, S3, CloudWatch ✅ Data Warehousing & Data Modeling , star/snowflake schema, partitioning ✅ ETL & Data Integration , PostgreSQL, MySQL, RESTful APIs, JSON/CSV ingestion ✅ Infrastructure as Code (IaC) , deployment automation ✅ Data Quality & Transformation , SCD handling, data validation **Certificates:** ✅ Microsoft® Certified: MCSA | MCSE | MCT ✅ cPanel® & WHM Certified CWSA-2 I’m ready to start immediately and aim for a smooth, automated deployment with full documentation within the proposed timeline. Could you s
₹12.000 INR trong 20 ngày
5,2
5,2

With an impressive 7 years of software development experience under my belt, I am well-versed in the tools and technologies necessary to excel at a project such as yours. My expertise in Amazon Web Services, particularly Redshift, makes me an ideal candidate for this job. I've worked with similar projects involving SQL databases and RESTful APIs, so I understand the complexities involved in designing and implementing robust schemas that can handle multiple data sources. Not to mention my extensive experience working with different Types of API's relevant to your project. Not only can I ensure database scalability and efficient data ingestion processes but also implement transformations that meet your exact needs. Think slow changing dimensions, data quality checks, and enforcing types; essential for maintaining a high-performing warehouse. If selected, my proficiency with deployment scripts or Infrastructure as Code (IaC) templates will be put to use ensuring you can recreate the whole setup effortlessly. In conclusion, when you work with me you're not just hiring a technician but someone who truly cares about client satisfaction. From the inception to hand-off, your objectives will be my top priority ensuring your Amazon Redshift Warehouse operates seamlessly without manual intervention post-delivery.
₹1.500 INR trong 7 ngày
5,7
5,7

Hello, my name is Ritik Garg and I am a Full-Stack/Backend Developer with 8+ years of experience working with Python, Django, Restful APIs, Data Mining, Flask, Scrapy, Selenium, Fluter, Mobile Development, Node JS, Angular, React, AWS, DevOps, request, threading and selenium. I have the necessary skills and experience to complete your project within a month's timeline. I specialize in web scraping and have successfully completed many projects related to this. My goal is to give clients over 100% satisfaction by implementing their ideas accurately so that their business thrive and grow. Additionally, I guarantee perfect (100%) quality on every project while being on time and budget delivery as well as flexible work times.. If you choose me for this job, you can count on me providing excellent customer service while staying within your target deadline. Please let me know if you're interested in discussing further or have any other questions. Best regards!
₹7.000 INR trong 7 ngày
2,3
2,3

I will design and implement a scalable analytics warehouse on Amazon Redshift, along with fully automated ingestion pipelines from SQL databases, REST APIs, and S3-based flat files. I will focus on clean schema design (star or snowflake), incremental loading strategies, SCD handling, and strong data quality checks to ensure the warehouse is reliable, maintainable, and ready for analytics use.
₹7.000 INR trong 7 ngày
0,0
0,0

Lets chat, a free consultation and no obligation. I understand you need a seamless, scalable Redshift solution that automates data pipelines and ensures hassle-free operations. With expertise in Linux, Web Security, SQL, Cisco, and more, I specialize in delivering straightforward, reliable solutions tailored to your needs. Although new to freelancer.com, I guarantee efficient, well-crafted outcomes for your Redshift warehouse. Happy to share ideas before you decide — no pressure. Regards, Mark Bojara
₹27.177 INR trong 7 ngày
0,0
0,0

With 7 years of experience in data warehousing and analytics, I am the perfect fit for your Amazon Redshift Warehouse Integration project. I have successfully designed and implemented similar solutions in the past, ensuring optimal performance and data integrity. How I will complete this project: - Design and implement a robust schema in Amazon Redshift, tailored to your specific needs - Develop automated ingestion pipelines for SQL databases, RESTful APIs, and flat-file drops - Implement data transformations to standardize data types, handle slowly changing dimensions, and enforce data quality checks - Set up incremental loads and sensible partitioning to optimize query performance - Provide deployment scripts or Infrastructure as Code templates for easy replication in another AWS account Tech stack I will use: - Amazon Redshift for the data warehouse - PostgreSQL and MySQL for SQL databases - RESTful APIs for data extraction - S3 for storage of flat files - CloudWatch for monitoring and logging I have a proven track record of delivering high-quality data solutions on time and within budget. By choosing me for this project, you can rest assured that your Amazon Redshift warehouse will be set up for success. Let's discuss further details and get started on this exciting project!
₹1.650 INR trong 7 ngày
0,0
0,0

I'll design a Star Schema on Redshift using Terraform for portability. I'll use AWS DMS for CDC from SQL, Lambda for API ingestion to S3, and Redshift COPY for flat files. AWS Glue will handle ETL, SCD Type 2 logic, and quality checks. Performance is optimized via Sort/Dist Keys and incremental loads. Success is defined by automated CloudWatch-monitored pipelines and a BI-ready warehouse.
₹12.500 INR trong 7 ngày
0,0
0,0

Chennai, India
Phương thức thanh toán đã xác thực
Thành viên từ thg 1 4, 2024
₹600-1500 INR
₹600-1500 INR
₹600-1500 INR
₹600-1500 INR
₹600-1500 INR
$250-750 CAD
₹12500-37500 INR
$250-750 USD
$250-300 USD
₹1500-12500 INR
$25-50 USD/ giờ
$250-750 USD
$250-750 USD
$2-8 USD/ giờ
₹12500-37500 INR
₹50000-55000 INR
$10-30 USD
$250-750 USD
₹100-400 INR/ giờ
$10-30 USD
₹100-400 INR/ giờ
$15-25 USD/ giờ
$250-750 USD
$250-750 USD
₹50000-60000 INR