Infrastructure Engineer - Cloud & IaC Specialist
Are you interested in building scalable, secure cloud infrastructure? Do you thrive on developing efficient data pipelines and optimising data storage solutions? If so, keep reading...
A industry leading technology company is seeking an Infrastructure Data Engineer to join their team. This role offers the chance to work with cutting-edge cloud technologies and shape the future of international data infrastructure.
Clearance
For this role a clearance of DV is required due to the highly secure nature of my client. If you are happy to go through the clearance that is acceptable as well.
Key Responsibilities:
- Design, implement, and maintain scalable AWS infrastructure using Infrastructure as Code principles
- Develop and optimise data pipelines using technologies such as Spark, Python, and Java
- Implement and manage Iceberg tables for efficient data storage and retrieval
- Enforce data retention policies and ensure compliance with governance standards
- Collaborate with software engineers to align infrastructure with application needs
- Implement robust data security measures
- Monitor and troubleshoot data pipelines and infrastructure
- Maintain comprehensive documentation of infrastructure and processes
Qualifications:
- Experience in AWS Infrastructure and/or SRE roles
- Strong background in IaC using tools like Terraform or CloudFormation
- Proficiency in Spark, Java, and Python
- Experience with data orchestration tools (e.g., Airflow, Prefect, Dagster)
- Knowledge of Postgres, GraphQL, and other data manipulation tools
- Familiarity with big data concepts, including Apache Iceberg and data lakes
- Experience with geospatial data formats (Parquet/GeoParquet, GeoJSON, Shapefiles)
- Proficiency in DevOps tools (Git, Docker, Jenkins)
- Understanding of networking concepts (IP Protocol, DNS, load balancing)
- Excellent problem-solving and communication skills
If you're ready to take on exciting challenges and grow your career in a dynamic environment, I want to hear from you! Apply now to hear more about the role and make a significant impact some highly secure data infrastructure.
Infrastructure Engineer - Cloud & IaC Specialist