ECOM are pleased to be exclusively recruiting for a contract Senior Data Engineer here in Manchester.
You'll join a team where your work reaches millions. This role is within a forward-thinking company leading, offering a dynamic environment where you can grow, make an impact, and shape the future of technology.
Work with cutting-edge cloud technologies to build products used nationally. As part of the Technology & Change department, you'll be in a cross-functional squad, collaborating with Data Engineers, Software Engineers, Data Scientists, and a Product Manager.
The Role
You'll be an experienced Senior Data Engineer with MLOps expertise to join a new project. You’ll play a key role in automating data pipelines and productionising machine learning models.
Responsibilities include:
- Data Product Design & Development: Build scalable data pipelines and products using tools like Apache Airflow, AWS Glue, and PySpark.
- Business Engagement: Collaborate with commercial teams to define data requirements.
- Data Loading & Transformation: Optimize ETL/ELT processes for smooth data flow.
- Data Modeling & Architecture: Design data models and optimize storage formats.
- MLOps: Productionize ML models, manage versions, and integrate monitoring.
- Data Quality: Implement automated quality checks.
- Data Governance & Security: Ensure compliance with data privacy and security standards.
- Collaboration & Documentation: Support cross-functional teams and document workflows.
- Continuous Improvement: Stay updated on trends and improve processes.
- Ways of Working: Participate actively in planning, stand-ups, and CI/CD processes.
Skills Required
- Experience with Spark-based data projects and Python (PySpark).
- Proficiency in designing data pipelines and ETL/ELT processes.
- Knowledge of machine learning algorithms and AWS services (MWAA, Glue, SageMaker).
- Strong communication and problem-solving skills.
- Experienced in Productionising machine learning models & MLops
This is a 6 month contract which is based out of our clients Manchester office which you'll have to visit twice per week.
Unfortunately, sponsorship is unavailable for this role.