Data Team Lead

Lead Data Engineer - West London (Hybrid) - £80,000-£100,000Our client is seeking an experienced Lead Data Engineer to join their Engineering team within the Digital & Product Department in West London. In this hands-on role, you will lead a team of data engineers to design and build scalable data pipelines. These pipelines will transform and integrate data from various sources in a repeatable way, automating processes to ensure smooth data ingestion, cleansing, and transformation.Duties & ResponsibilitiesLead the design, development, and maintenance of ETL and data integration solutions across a wide range of technologies and data sources.Manage and update the overall Data Engineering Architecture to ensure scalability and performance.Analyse and organize raw data from different sources, ensuring data quality and reliability.Identify, design, and implement internal process improvements, including automating manual processes and optimizing data delivery pipelines.Work with cloud-based infrastructure (Azure) to host data solutions and applications.Collaborate with architects, data analysts, and data scientists to ensure business goals are met with effective data solutions.Provide technical guidance and support to software developers, PowerBI developers, and other data teams on key data initiatives.Skills RequiredExtensive experience as a data engineer, with a proven track record in leading data engineering teams.Proficient in developing and maintaining ETL/ELT processes within a medallion architecture.Strong background in data modeling within a cloud-based data platform.In-depth experience with SQL Server and relational databases.Expertise in the Azure data engineering stack, including Azure Synapse, Azure Data Lake, and Azure ML Studio.Strong programming experience with Python, PySpark, and T-SQL.Familiarity with Azure DevOps and knowledge of CI/CD processes.Excellent analytical skills for working with both structured and unstructured datasets.Join our client in West London and lead the development of cutting-edge data solutions. Apply now to become their next Lead Data Engineer!