Hive Jobs

I'm looking for a data engineer with solid Pyspark knowledge to assist in developing a robust data storage and retrieval system, primarily focusing on a Data Warehouse. Key Responsibilities: - Implementing efficient data storage solutions for long-term retention and retrieval - Ensuring data quality and validation procedures are in place - Advising on real-time data processing capabilities Ideal Candidate: - Proficient in Pyspark with hands-on experience in data storage and retrieval projects - Familiar with Data Warehousing concepts and best practices - Able to recommend and implement appropriate real-time processing solutions - Strong attention to detail and commitment to data quality. Specifically, I have a Jira ticket that consists of creating an application that runs on Airf...

I am in need of a Python professional who excels in data analysis. The role will involve managing both stream and batch processing in Databricks, and is geared towards creating a robust data pipeline. Additionally, the project requires testing for the purpose of ensuring data accuracy. - Python Data Analysis: You will employ Python to analyze complex data effectively. - Databricks: You should be comfortable with both stream and batch processing. - Testing: You are expected to run tests to ensure data accuracy. Ideal candidates will have a proven track record working with Python, Databricks, and data testing, particularly in guaranteeing data accuracy.