Airflow SME

Airflow SME

• 6 month contract
• Based in London
• Remote / Hybrid role
• Inside IR35

The role

• Provide technical leadership on data engineering (acquisition, transformation, distribution), across multiple projects and squads
• Guide, nurture, and coach a team of data engineers, architects and database administrators working in an agile, fast-paced environment
• Drive adoption and evolution of frameworks and products based on best-in-class data management technologies, such as ETL/ELT tools, open-source frameworks, workflow management tools, etc.
• Provide suggestions and recommendation on how to improve the overall data engineering architecture towards a scalable, cost effective ecosystem

Your expertise:

• Excellent understanding of enterprise data warehousing principles of ETL/ELT and the tools/technologies used to implement them
• Proven experience with Apache Airflow, including designing and maintaining complex workflows.
• Strong knowledge of Python programming.
• Experience with SQL and relational databases.
• Familiarity with cloud platforms (e.g., AWS) and their data services.
• Experience with version control systems such as Git.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Be an expert in handling ECS, Fargate, EC2, EKS infrastructure hosting Airflow.
• DBT including handling Infrastructure related upgrades and optimising DBT code (desirable).

Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.