Required Tasks:

• Collaborate with stakeholders in requirements gathering activities to understand the app’s purpose, features, and technical requirements.
• Apply agreed changes to data pipelines.
• Develop and implement various data quality checks and tests to assess data integrity and accuracy.
• Monitor data quality metrics and document findings.
• Optimize data pipelines and implement various performance improvements.
• Automate manual data processes to improve efficiency while collaborating with stakeholders to understand priorities and provide recommendations.
• Facilitate production cutover activities and provide support to the business as needed.

Required Skills:

• Proficiency in Python and SQL.
• Experience with data pipelines, ETL processes, and data quality management.
• Familiarity with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of data modeling and data warehousing.
• Hands-on experience with tools like Apache Spark, Kafka, or similar technologies.
• Strong analytical, problem-solving, and communication skills.

We would greatly appreciate it if you could help us identify potential candidates meeting these criteria. Please let me know if this is something you can support us with or if there are any next steps we should consider.