Đã Đóng

aws project related to data

1) Peform ETL S3 ( HDFS file) as source and Redshift as target

Technical Environment : EC2,EMR, Pyspark & Hive

2) Peform ETL across S3, AWS noSQL database using Glue

3) One sample Python AWS Lambda function to run AWS Redshift SQL scripts

4) One sample on realtime streaming ( preferably Kafka( producer) + Pyspark( Consumer)

5) Executing bash commands ( jobs ) via Airflow ( or AWS equivalent)

Need walkthrough of above at urgent basis.

Even if you can solve some points , that is fine.

Kĩ năng: Amazon Web Services, Python, Hadoop, Linux, PySpark

Xem nhiều hơn: project term data, php project import data feeds, project read data, aws data analytics, aws big data sample projects, aws big data tutorial, aws projects, aws data pipeline, aws marketplace, aws data lake, aws big data architecture diagram, create vba project iports data csv, large project abstract data types, project read data hid usb, project website data program visual basic, project related sales management, project related using adts, gui run sql scripts, project related data entry, run sql scripts setup

Về Bên Thuê:
( 0 nhận xét ) San Jose, United States

ID dự án: #27922225

11 freelancer chào giá trung bình $14/giờ cho công việc này


Hello. I have 12+ years of experience in Python and have worked on a lot of Django, Flask, AI/ML, ... projects. I can share some demos if you are interested. Also, I work as a fulltime freelancer and have enough Thêm

$12 USD / giờ
(155 Nhận xét)

Hello, I'm intrested to solve following technial impmementations- 1) Peform ETL S3 ( HDFS file) as source and Redshift as target Technical Environment : EC2,EMR, Pyspark & Hive 2) Peform ETL across S3, AWS noSQL data Thêm

$15 USD / giờ
(7 Nhận xét)

Hi, nice to e-meet you. We have a team of experienced full stack developers with a focus on Python/Django. We have built a number of web and mobile based applications including (not limited to): 1. A sophisticated trad Thêm

$10 USD / giờ
(23 Nhận xét)

Certified ETL (TALEND) and Cloud(AWS) architect with 10 year of IT experience in banking , telecommunications and medicine platform. Below are the products in which we have worked. 1) Talend Open Studio 2) Talend Enter Thêm

$16 USD / giờ
(2 Nhận xét)

hello- I am a 15year experienced professional having hands on experience working with AWS. I am interested to work on your task. lets discuss.

$15 USD / giờ
(2 Nhận xét)

hi, i have majorly worked with aws, s3, hadoop, pyspark, hive, shell script. i have little knowledge on no sql and kafka. but i can work on these technology peices. i would like to work on your project. please reply ba Thêm

$22 USD / giờ
(2 Nhận xét)

I am certified aws data engineer in aws services- Aws lambda Aws glue Aws step function Aws sagemaker Aws lake formation Aws athena Aws redahift Aws dynomo db programing languages- python, pyspark, sql I can surely h Thêm

$13 USD / giờ
(0 Nhận xét)

Hi, I've an aws data engineer with 2+ years of experience. I'm been majorly working with aws glue for performing ETL, with s3 as a data source. I'm pretty much worked on the following services as well - EMR, EC2, Lamb Thêm

$9 USD / giờ
(0 Nhận xét)

I have good experience of over 2 years in designing and developing ETL solutions using AWS services like DMS, Glue, Lambda, Athena and Redshift.

$11 USD / giờ
(2 Nhận xét)

Hello , I am professional AWS cloud and PYTHON BigData Developer with an experience of 6 plus years. I have so far worked on multiple AWS services and have a good hands-on as well as architectural design knowledge on A Thêm

$17 USD / giờ
(0 Nhận xét)

I am BigData engineer with vast experience in various tools like spark(pyspark), Hadoop, yarn, Hive, kafka and Python, shell scripting. Have good experience in designing and implementing ETL pipelines using pyspark wit Thêm

$10 USD / giờ
(0 Nhận xét)