Looking for an expert/experienced AWS engineer.
1. Use AWS Glue for Extract, Transform and load processes. The goal is to produce fine-grained, quality
assured and highly optimal data (Data Lake bucket) from a source of data that is not fully optimised
(Acquired data bucket).
2. Glue processes will be triggered by using Lambda functions that run when defined conditions are met,
like new data landing in the S3 buckets.
3. Glue crawlers will run to produce DataCatalogs that will be also updated with databases and tables so
can identify that data.
Require a solid proposal with a roadmap about how you are going to execute this and the amount of time that you require to complete each task.*
*Sheet will be shared with you at a later instance to fill in the details.