We are hiring for Cloud Data Engineer (Hadoop / Spark / Bigdata)
Location : Hybrid - 2 days per week in Solihull Office
- Design, develop, and optimize data pipelines using Scala, Spark, and cloud technologies.
- Integrate data from diverse sources into the Raw Layer of DATAHUB.
- Model data and develop efficient data pipelines to enrich and transform large volumes of data.
- Implement data transformation and quality control processes to ensure data consistency and accuracy.
- Strong programming skills in Scala, Python, and SQL.
- Experience with data processing frameworks like Apache Spark.
- Knowledge of cloud platforms (AWS, GCP) and cloud-native technologies.
- Familiarity with data warehousing and data modeling concepts.
- Experience with data quality tools and techniques.
- Understanding of CI/CD pipelines and DevOps practices.
- Set up CI/CD pipelines for automated deployment and testing.
Key Skills : Cloud Data Engineer (Hadoop / Spark / Bigdata)