As a Data Manager/Lead, your responsibilities will include, but are not limited to:
- Leading the data team to achieve their objectives and key performance indicators, including work scheduling and maintaining high-quality performance.
- Designing, developing, and maintaining scalable data pipelines using Python, Azure Data Factory, and other relevant tools.
- Collaborating with business stakeholders to understand data requirements and integrate various data sources into a unified data lake or warehouse, ensuring data quality and consistency through cleansing, transformation, and enrichment.
- Monitoring and optimizing data pipelines for performance, scalability, and cost-efficiency.
- Implementing and upholding data security and compliance measures to safeguard sensitive information.
- Promptly diagnosing and resolving data-related issues to minimize downtime.
- Developing automation scripts and workflows to streamline data engineering processes.
- Coordinating with third parties, providing necessary data to support project delivery, system maintenance, and change programs.
- Creating and maintaining clear documentation for data pipelines, schemas, and processes.
- Creating and maintaining KPI reports to monitor and track the data team’s progress against data requirements and delivery goals.