Senior Data Engineer (Brazil)

@tangramua

Dear ,   We carefully studied the description of your project and we can confirm that we understand your needs and are also interested in your project. Our team has the necessary resources to start your project as soon as possible and complete it in a very short time.   We are 25 years in this business and our technical specialists have strong experience in SQL, Azure, Amazon Web Services, Database Administration, Big Data Sales, Hadoop, Spark, Redshift, BigQuery, Snowflake and other technologies relevant to your project.   Please, review our profile https://www.freelancer.com/u/tangramua where you can find detailed information about our company, our portfolio, and the client's recent reviews.   Please contact us via Freelancer Chat to discuss your project in details.    Best regards, Sales department Tangram Canada Inc.     

@irsolutions

With over a decade of experience in full-stack architecture and high-scale systems, I understand the importance of finding a Senior Data Engineer for your expansion in Brazil. Your goal of owning end-to-end pipelines and models that drive real business decisions aligns perfectly with my background in delivering high-performance solutions for complex systems, including projects with over 1 million users and high-security FinTech applications. To ensure the scalability and security of your data flows, my strategic insight would be to leverage my expertise in cloud environments like AWS, GCP, and Azure, combined with my experience in optimizing performance-critical jobs in Spark. I have successfully built and scaled solutions across multiple clouds, similar to what you are looking for in this role. I am confident that my experience in designing robust pipelines and ensuring reliability will be instrumental in meeting the requirements of your project. I invite you to reach out to discuss how I can contribute to shaping clean data models and guaranteeing rock-solid reliability for your business decisions.

@AZTURK1

Hi there, I understand you need a senior Data Engineer based in Brazil to own production Spark pipelines across AWS, GCP and Azure, harden data models for downstream analysts, and enforce data quality , I have 7+ years building cross-cloud ETL, tuning Spark, and shipping dbt/Airflow-driven DAGs, so I can take full ownership immediately. - Deliverable 1: Profile, audit and optimize your performance-critical Spark jobs (job-level tuning, partitioning, memory/executor sizing) and deploy optimized job configs to AWS EMR / Dataproc / Azure Synapse. - Deliverable 2: Design and implement end-to-end pipelines with Airflow orchestration, dbt models, Kafka/Kinesis ingestion, and CI/CD to Redshift / BigQuery / Snowflake with automated tests and SLAs. - Deliverable 3: Implement data quality guardrails (schema checks, dbt tests, monitoring alerts) and documentation for analysts. - Risk/quality-control: staged deployment with backup checkpoint and post-deploy validation to ensure zero-regression in production. Skills: ✅ Spark ✅ AWS / GCP / Azure ✅ Airflow / dbt / Kafka ✅ Redshift / BigQuery / Snowflake ✅ Data quality, monitoring, performance tuning Certificates: ✅ Microsoft® Certified: MCSA | MCSE | MCT ✅ cPanel® & WHM Certified CWSA-2 Are the performance-critical Spark jobs currently running in production on AWS, GCP, or Azure? Best regards,

@MIndlabsAi6

Hello, I'm Vishal Maharaj, with 20 years of expertise in SQL, Azure, AWS, and Database Administration. I have carefully reviewed your project requirements and am confident in my ability to deliver end-to-end data pipelines and models that drive impactful business decisions. I will design and deploy solutions across AWS, GCP, and Azure, optimizing performance-critical jobs in Spark and ensuring data reliability. I am equipped to handle data engineering tasks efficiently, leveraging tools like Airflow, dbt, Kafka, and experience with Redshift, BigQuery, and Snowflake. Fluent in SQL and proficient in English and Portuguese, I am ready to collaborate with stakeholders to meet your project goals. Let's discuss your project requirements further. Cheers, Vishal Maharaj

@adily1

Hey , I just finished reading the job description and I see you are looking for someone experienced in Database Administration, Snowflake, Big Data Sales, SQL, BigQuery, Redshift, Spark, Hadoop, Amazon Web Services and Azure. This is something I can do. Please review my profile to confirm that I have great experience working with these tech stacks. While I have few questions: 1. These are all the requirements? If not, Please share more detailed requirements. 2. Do you currently have anything done for the job or it has to be done from scratch? 3. What is the timeline to get this done? Why Choose Me? 1. I have done more than 250 major projects. 2. I have not received a single bad feedback since the last 5-6 years. 3. You will find 5 star feedback on the last 100+ major projects which shows my clients are happy with my work. Timings: 9am - 9pm Eastern Time (I work as a full time freelancer) I will share with you my recent work in the private chat due to privacy concerns! Please start the chat to discuss it further. Regards, Adil.

@letswork92

Hello, I understand that you're looking to expand your data team in Brazil with an experienced engineer who can expertly manage end-to-end pipelines and models. The challenge of handling large, messy datasets while ensuring reliability across AWS, GCP, and Azure is crucial for driving informed business decisions. With over 12 years of experience in data engineering, I have successfully designed and deployed scalable solutions using technologies like Spark for performance optimization, Airflow for orchestrating workflows, and dbt for data transformation. My fluency in SQL and hands-on experience with data warehouses such as Redshift and Snowflake allow me to ensure data quality and reliability. As a native Portuguese speaker collaborating daily in English at a C1/C2 level, I thrive in cross-functional environments alongside product managers to iterate quickly on business use cases. Could you share more about the specific types of business decisions these pipelines will influence? Looking forward to your response!

@mayr81

Hello, I’d love to support your expansion of the data team in Brazil with my experience building end-to-end pipelines across AWS, GCP, and Azure. I’ve spent years developing production-grade data flows, optimizing Spark workloads, and shaping trusted data models for analysts and downstream services. Your need for someone who can tame large, messy datasets and deliver reliable, scalable solutions aligns with my background in SQL, Snowflake, BigQuery, Redshift, and event-streaming tools like Kafka and Kinesis. I’m also comfortable collaborating in English while working closely with product managers to maintain strong data quality guardrails. I can help you build the robust multi-cloud ecosystem you’re aiming for Best regards!

@salmanullahbaig

This is exactly the kind of work I enjoy, designing and deploying solutions across multiple clouds, particularly AWS, GCP, and Azure, with a focus on squeezing every ounce of efficiency from Spark, which I've had hands-on experience with in my previous projects, such as the one where I optimized a data pipeline for a client using Spark and Kafka, resulting in a significant reduction in processing time, that's why I think my skills align well with this role, I've also worked with large, messy datasets and have a track record of taming them, I'm curious to know more about the specific business-facing use cases that I'll be working on and how the data engineering team contributes to them, let's discuss this opportunity further. Happy to share more about my approach — just send me a message.

@jay8mac

This is exactly the kind of work I love doing, and I'm currently offering premium quality at a reduced rate while building my reputation—which means you get full dedication without the full price tag. I understand you need a Senior Data Engineer to expand your data team in Brazil, fine-tuning data flows, and scalable models for real business decisions. Given the importance of strong data processing across AWS, GCP, and Azure coupled with getting the ideal efficiency out of Spark, you require seasoned efficiency paralyzed by productivity. I have extensive experience in AWS, Database Administration, and SQL. My skills align perfectly with your needs for creating sturdy end-to-end data pipelines using various tools like Kubernetes and Docker within Node.js and OpenAI Chat-Adapting High constructs disclosures. Whether it's SQL,inAlignaderaUNCH Kafkaagain Congo Utrecht UCS Looking forward to potentially collaborating. Regards, Jason McLachlan

@mateusf89

Olá! Tenho forte experiência em Engenharia de Dados e posso assumir esse desafio de ponta a ponta, desde a ingestão até modelos confiáveis que suportam decisões reais de negócio. Atuo há mais de 5 anos construindo pipelines escaláveis, lidando com grandes volumes de dados desorganizados e transformando isso em estruturas limpas, auditáveis e prontas para analytics ou consumo por sistemas. Tenho domínio avançado de SQL e experiência sólida em ambientes AWS, GCP e Azure, incluindo arquitetura, processamento distribuído e automações. Também trabalho com Spark focado em performance tuning (particionamento, otimização de jobs, custo x velocidade, troubleshooting), além de experiência com Airflow, dbt, Kafka/Kinesis e data warehouses como Redshift, BigQuery e Snowflake. Além da parte técnica, valorizo muito confiabilidade operacional: monitoramento, testes, data quality checks, alertas e documentação clara. Costumo trabalhar próximo de times de produto e stakeholders para transformar necessidades de negócio em soluções rápidas e sustentáveis. Sou fluente em português nativo e confortável colaborando diariamente em inglês com times internacionais. Posso atuar full-time remoto no Brasil e entregar ownership real da operação de dados, ajudando a escalar a estrutura com velocidade e segurança.

@andersond73

Hello, As I am a senior data engineer, I can help build and harden your end-to-end data pipelines in 1 week for $40/hour. Your main challenge is not just moving data, but making messy large datasets reliable enough for analysts, product teams, and downstream services to trust. I can work on SQL-heavy modeling, Spark job optimization, and production pipeline design across AWS, GCP, and Azure. A practical first step would be reviewing your current critical Spark jobs, checking partitioning, shuffle size, joins, and caching strategy, then adding data quality checks around freshness, duplicates, schema drift, and failed loads. For modeling, I can structure clean dbt-style layers so business logic is not buried inside raw pipeline code. I’m also comfortable with Airflow orchestration, Kafka/Kinesis streams, and warehouses like BigQuery, Redshift, and Snowflake. Happy to discuss the current pipeline pain points and start with one high-impact workflow first. Thank you.