I am freelancing data engineer and devop focused on data integration and data transformation projects.
I have reliable experience in the cloud data engineering projects in AWS, Azure and GCP.
My technology experience comprises following
• Extensive scripting experience for data engineering purposes with Python, Spark, Perl, PowerShell;
• DB professional with SQL platforms as MySQL, PostgreSQL, Oracle, cloud platforms as SnowFlake, Redshift, and non-SQL ones : Mongo;
• Experience in data processing scripts with JSON, XML, CSV, DAT imputsExtensive
• Devop professional focused on CI/CD (Jenkins, TeamCity), setting repos at GitHub/GitLab
• Setting up and maintaining Microservices (Docker container) at Kubernetes and local environments
• DBA actions wit Oracle and PostgreSQL
• Cloud data engineering and data warehousing in AWS, Azure and GCP;
• Data engineering with Apache stack – Databricks, Hadoop, Hive, AirFlow;
Happy to help you - available immediately.