Fixed budget:50 USD
Task: We want to bulk load our elasticsearch cluster:(ONLY DOCUMENTATION)
> SNS topic
> Kinesis Firehose
> Maybe event bridge
1.) We will need to transform the message before loaded into elasticsearch
2.) We have over 30 million records we want fast bulk load FIFO.
3.) We want to publish a bulk amound to the SNS topic, but we dont not want multiple copies of the same records sent.
4.) We want to predict how long to complete all 30 million records
5.) We also want to keep using the process for regular updating of elastic search.
the goal is really two things:
1.) How do we bulk load elastic search from 30million rows in the aurora database?
2.) After the bulk load is complete, we want to keep the same process if possible - to maintain data in elastic search to remain a MIRROR of aurora database
3 freelancer chào giá trung bình$147 cho công việc này
I am elasticsearch certified engineer , I have working in many projects in which I have used elasticsearch, logstash , kibana and beats . Looking forward to connect with you
Hello, I have 5 years of experience with Elasticsearch and have many projects with bulk load of data from SQL databases like MySQL or PostgreSQL as regular task for mirror operation. I can help you with your project.