Build AWS Redshift Data Warehouse

₹1500-12500 INR

In Progress

Posted 5 days ago

₹1500-12500 INR

Paid on delivery

I need to stand up a robust data warehouse / data mart on Amazon Redshift that can reliably ingest and serve our transactional data. All extraction, transformation, and loading will run through AWS Glue, so deep familiarity with Glue jobs, crawlers, and workflow orchestration is essential. Scope of work You will design the schema, implement the ETL pipelines in Glue, configure and tune the Redshift environment, and leave me with clear documentation so I can operate and extend the solution after hand-off. Deliverables • Dimensional or other suitable schema mapped to our transactional sources • Production-ready AWS Glue jobs (Python or Scala) with parameterisation and error handling • Redshift cluster, tables, sort/dist keys, and workload management tuned for performance and cost • Validation scripts and a brief runbook explaining daily operations, monitoring, and future scaling Acceptance criteria The system loads on an automated schedule, historical and incremental loads match source counts, typical query latency stays under agreed thresholds, and I receive all artefacts in a Git repo plus a live walkthrough. When you reply, focus on your relevant Redshift and Glue experience—links to past deployments or brief success stories are most helpful.

Project ID: 40439749

About the project

4 proposals

Remote project

Active 5 days ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@meetv92

Dear Hiring Manager, I’m excited to apply for your Amazon Redshift and AWS Glue data warehouse project. I have hands-on experience building scalable AWS analytics solutions using Redshift, Glue, S3, Athena, Lambda, and CloudWatch. I’ve designed dimensional/star schemas, developed production-ready Glue ETL pipelines in PySpark/Python, and implemented automated historical + incremental loading workflows for transactional datasets. My experience includes configuring Redshift sort/dist keys, workload management, partitioning strategies, and query optimization to improve both performance and cost efficiency. In a recent project, I built a Redshift-based reporting warehouse processing millions of records daily through Glue workflows with automated validation, logging, retries, and monitoring. The solution significantly reduced reporting latency while ensuring source-to-target reconciliation accuracy. For your project, I can deliver: • Optimized Redshift schema and cluster setup • Parameterized Glue jobs with robust error handling • Automated scheduled ETL workflows • Validation/reconciliation scripts • Clear documentation, Git-based delivery, and walkthrough support I focus on building maintainable, production-grade data platforms that are easy to operate and extend after hand-off. I’d be happy to discuss your data sources, expected volumes, and reporting requirements further. Best regards, Meet Vaidya

₹2,000 INR in 7 days

0.0

(0 reviews)

0.0

4 freelancers are bidding on average ₹8,375 INR for this job

@oscarf09

Hi, I can build the Redshift + AWS Glue data warehouse and leave it with a repeatable ETL/runbook instead of a one-off script. I would approach it in stages: 1. Map the transactional sources into a dimensional or fit-for-purpose schema. 2. Configure Glue crawlers/jobs and parameterized Python ETL with logging, retries, and error handling. 3. Create/tune Redshift tables, sort/dist choices, and load strategy for historical + incremental data. 4. Add validation scripts for row counts, reconciliation/checks, and query sanity tests. 5. Hand over the repo plus a short operations guide and live walkthrough. Before starting I would need sample schemas/source access, expected data volume, refresh schedule, and AWS access through a safe IAM role. Also please confirm whether you prefer Redshift Serverless or a provisioned cluster. I can deliver a clean first version in 14 days, with the first milestone covering architecture + source mapping before implementation expands.

₹12,500 INR in 14 days