Senior Data Engineer

Senior Data Engineer – London (Central – hybrid / remote)#TeamCandour are working with a thriving global financial services player to add another accomplished Senior Data Engineer to their growing London team who work on a hybrid basis – 1 or 2 days on site in the office. As well as flexible working, these guys offer one of the most comprehensive benefits packages we’ve working with including: Personal & company bonusPrivate health & dental care10% company pension contributionSo what skills will you need to bring? Databricks (Spark SQL) Azure DevOps Build and maintaining data platforms within Microsoft Azure. A deep understanding of data warehousing and analytics platforms. SME knowledge of technology architectures & processes involved in the transfer of data. A good understanding of data modelling techniques. Key Responsibilities Be a core member in the team delivering the Analytics Platform Operating Model, working in an agile way, to deliver trusted governed data for the business. Work across a diverse group of data consumers across the Group to identify and capture data requirements, associated ownership, definitions, transformations and controls using standard terms. Design and develop ETL processes and data structures (Azure Databricks) for the data warehouse following best practice procedures (e.g. Auditing, delta load, insert else update logic, Error logging) Gather and translate business requirements, convert into technical specification and implement solution design. Perform data modelling based on the business/reporting requirements. Create and maintain ETL process related documents (e.g. data lineage, data flow, mapping) Own, maintain and follow development and design principles as well as best practice (e.g. unit testing, performance tuning, table naming conventions, peer review). Manage and deliver ad-hoc data/reporting requests from end-user requests and troubleshoot data issues. Play an instrumental role supporting the data strategy (e.g. Data warehouse) and other data related initiatives (e.g. Data science, business intelligence). Proactively ensure that deliverables meet or exceed functional, technical and performance requirements. Be comfortable with manipulating and analysing large datasets including data cleansing to provide insight to the business and troubleshooting ETL issues. Ability to understand and consolidate disparate information sources into summary metrics and report on them. A more complete job description is available to anyone meeting the above minimum criteria, drop us a line and we can arrange a chat to go through the details!