Lead Data Engineer

Lead Data Engineer (Real-Time Data Streaming) This role is a remote role with weekly/fortnightly travel to the Brighton office. Salary up to £100k. Our partner is looking for an experienced Lead Data Engineer to join their Brighton-based team to drive their real-time data streaming initiatives. As a key member of the data team, you'll play a pivotal role in shaping our data engineering roadmap and ensuring the success of our genAI products. Responsibilities: Be the primary data engineering subject matter expert. Design and implement robust, scalable data pipelines using technologies like Kafka, Python, AWS, Snowflake, DBT, Looker. Collaborate with cross-functional teams to translate business requirements into technical solutions. Develop and maintain self-service tooling for efficient data access and analysis. Ensure data quality and governance through documentation, observability, and controls. Mentor team members and promote best practices within the organisation. Required Skills and Experience: Proven experience as a Lead Data Engineer or similar role. Strong experience in Python and data engineering concepts. Expertise in real-time data streaming technologies such as Kafka or similar. Experience with ELT pipelines and the full data lifecycle. Excellent communication and collaboration skills. Able to travel to the Brighton office weekly or fortnightly.