Data Operations Engineer

● Experience wrangling terabytes of big, complicated, imperfect data ● Extensive experience designing and implementing ETL pipelines ● Experience with ETL job automation through Airflow pipelines ● Experience building and operationalizing large-scale enterprise data solutions, Data Lakes and applications using one or more of AWS data and analytics services ● Experience with AWS products (Redshift, EC2, EMR, S3, IAM, RDS, CloudWatch etc) and Databricks ● Bachelor's degree in Computer Science or a related field (or 4 additional years of relevant work experience) ● A strong understanding of data structures, algorithms, and effective software design Significant development experience with a major modern language (e.g. Java, Scala, Python, Ruby, Spark etc.) ● Significant experience working with structured and unstructured data at scale and comfort with a variety of different stores (key-value, document, columnar, etc.) as well as traditional RDBMSes and data warehouses ● Experience with or interest in AWS Glue, Redshift Spectrum and any other tools that enable data querying at scale ● Exposure to visualization tools - Tableau, Google Analytics, JIRA, MS Project ● Conduct code review with architecture team to ensure standards best practices are followed ● Develop automated code deploys with GIT, AWS Lambda and AWS Batch services ● Ability to multi-task and manage multiple environments ● Provide on-call support and remote troubleshooting ● Must work well in an agile, collaborative team environment