Find Jobs
Hire Freelancers

AWS Technician required, RDS + Lambda + SQS - Build an inbound data handler

$15-25 AUD / hour

Đã hủy
Đã đăng vào hơn 4 năm trước

$15-25 AUD / hour

I need a AWS expert for a couple of serverless applications. Attached please find process flow & a sample of data. The project is to create data bucket that can collect any number of inbound requests of an undetermined velocity and filesize. For now the region will be AWS AU-SYD only, with intention of similar data collection points being created later through cloning the setup into the other regions. All with their own Queue and Database. The objectives of this project are to: 1) Always be online 2) Be able to be regionalised 3) Accept 3 formats of data (for now, JSON/XML,CSV) 4) Store the data immediately so it can not be lost (SQS ? ) 5) Process at pace the SQS pendings, a) any failing parsing should be thrown to a Dead Letter SQS b) any pass should be inserted into an RDS, PER mapped ID. In the following format: (Table: Nerve)[UniqID, TIMESTAMP, SOURCE, IP] (Table: NerveData)[[login to view URL], DATA] 6) The Dead Letter SQS should be able to be transferred back into the original queue for re-attempt 7) The Dead Letter queue should have rolling backups to RDS or similar, before deleting after 7 days Once this part of the system is working, there will be more work for then processing the data that is in RDS in a separate routine that will extract each collected data in RDS and convert it into a Table per "ID". If you inspect the sample files each file contains 3 columns (this may vary) and one is identifier for a IoT device [ ID _ BATCHNO _ VALUE ]. Some files can contain more than 1 devices data, and the format may be subject to change at a later date so I am trying to separate the collection and parsing into separate independently scalable process. And the first logical one to build is the receiver. We can get to that later but if you understand all the above process or have suggestions on ways to improve the mechanism. It needs to be really, really solid and save all data, always. After the setup is done Id like a quick walk through. I have experience with AWS EB and RDS but not SQS/Lambda and would appreciate some skilled feedback if any improvements can be made to the model.
Mã dự án: 20556422

Về dự án

5 đề xuất
Dự án từ xa
Hoạt động 5 năm trước

Bạn muốn kiếm tiền?

Lợi ích khi chào giá trên Freelancer

Thiết lập ngân sách và thời gian
Nhận thanh toán cho công việc
Phác thảo đề xuất của bạn
Miễn phí đăng ký và cháo giá cho công việc
5 freelancer chào giá trung bình $25 AUD/giờ cho công việc này
Avatar người dùng
Hello. I am a senior AWS Expert. I have got full experience in DevOps and Serverless backend building on AWS. I am very familiar with Lambdas, API Gateways. And also have got plenty of experience in AWS Code Pipeline, Terraform, Jenkins, ECS, ECR, EBS .. Also I have worked for many mobile app back end programs, using Cognito Service and App Sync, Mobilehub. Due to my experience and skills in this field, I will bring you the perfect result. Best regards.
$20 AUD trong 40 ngày
4,9 (15 nhận xét)
7,1
7,1
Avatar người dùng
Thanks for posting a good job. I have a strong knowledge in AWS development. With my plenty experiences, I have ability to provide good result within the given time. These are jobs completed here. https://www.freelancer.com/projects/graphic-design/Fixes-existing-vue-dev-site/reviews https://www.freelancer.com/projects/website-design/Website-rebuild-18949973/reviews https://www.freelancer.com/projects/project-18200680/reviews https://www.freelancer.com/projects/python/Django-full-stack-developer-customise/ https://www.freelancer.com/projects/javascript/NODE-BACKEND-API-CONVERT-TRAILS/ https://www.freelancer.com/projects/project-18831737/reviews I want to discuss about project together over chat. Thanks for reading my words. From GUI..
$40 AUD trong 40 ngày
4,8 (2 nhận xét)
6,1
6,1
Avatar người dùng
Worked at AWS for nearly 4 years, 2 years on a service team, 1 year and 9 months within Premium Support. Knowledgeable and experienced in EC2, EBS, RDS, DynamoDB, Lambda, CloudFormation, VPC; knowledgeable in IAM, Config, KMS, CloudHSM, ACM, CloudTrail, WAF, ELB, S3. More than happy to discuss your goals and propose a solution. + IAM Security privileges for programmatic access to S3, JDBC and Postgres + Creating EC2 instances + Creating route tables + Creating subnets + Creating security groups + Creating Postgres DB with extensive creation of custom tables + ETL process (Extraction, Transform and Load) + Developing and testing Python script for high performance speed + AWS Lambda + AWS Cloudwatch jobs + AWS Policy creation
$25 AUD trong 40 ngày
5,0 (4 nhận xét)
5,8
5,8
Avatar người dùng
hope you are doing great. can we discuss more about your project so that we can plan accordingly and start working on it. i have been working on aws services since 2017. we are using around 150+ lambda in our current project , if u want i can show u . thanks
$15 AUD trong 30 ngày
0,0 (0 nhận xét)
0,0
0,0

Về khách hàng

Cờ của AUSTRALIA
Australia
4,9
9
Phương thức thanh toán đã xác thực
Thành viên từ thg 12 15, 2015

Xác thực khách hàng

Cảm ơn bạn! Chúng tôi đã gửi email chứa đường link để bạn lấy tín dụng miễn phí.
Đã xảy ra lỗi trong khi gửi email của bạn. Hãy thử lại.
Người Dùng Đã Đăng Ký Tổng Số Việc Đã Đăng
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Đang tải xem trước
Đã cấp quyền truy cập vị trí.
Phiên đăng nhập của bạn đã hết hạn và bạn đã bị đăng xuất. Hãy đăng nhập lại.