Lead Data Engineer– SC Cleared (or Clearable) Location: London Salary: Up to £80,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Lead Data Engineer and play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You’ll beresponsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies, collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise in Python, Scala, and SQL for efficient data processing. Build data pipelines using cloud-native services on AWS, including Lambda, Glue, Redshift, and API Gateway. Monitor and optimise data solutions using AWS CloudWatch and other tools. What We’re Looking For: Experience: Deep background in data engineering with hands-on expertise in big data technologies. Cloud Expertise: Proven experience implementing pipelines using AWS services. Technical Skills: Strong command of Python, Scala, SQL, and ETL tools.Security Clearance: Candidates must have or be eligible for SC clearance. Preference will be given to those already SC Cleared. SC Clearance Criteria: Must be a British Citizen or have resided in the UK for at least 5 consecutive years. Detailed employment history for the past 10 years or longermay be required. Why Join Us? Be part of a forward-thinking consultancy driving digital transformation for industry leaders. Work with the latest big data and cloud technologies. Collaborate with a team of skilled professionals in a fast-paced and rewarding environment. If you’re passionate about delivering impactful data solutions and meet the criteria for this role, we’d love to hear from you. Apply today and lead the way in digital transformation! If you are interested please apply ASAP. The People Network is an employment agency and will respond to all applicants within three - five working days. If you do not hear within these timescales please feel free to get in