Data Engineer responsible for developing data solutions and integrating systems for advanced analytics at Lilly. Focusing on data pipelines and solutions ensuring data quality and compliance.
About the role
- AI Data Engineer at Convatec designing and deploying data and AI workflows. Collaborating with AI Engineers and Data Scientists to maintain data pipelines and support analytics.
Responsibilities
- Design, build, and maintain data pipelines using Azure Data Factory, Microsoft Fabric, and Synapse to support AI and analytics workloads.
- Prepare and transform data for AI model training, inference, and retrieval workflows.
- Implement and maintain Lakehouse data models (Delta/Parquet) following Medallion architecture principles.
- Collaborate with AI Engineers to ensure seamless data flow between enterprise systems, APIs, and AI models.
- Develop and test data interfaces and lightweight microservices connecting AI models to business processes.
- Support deployment, monitoring, and performance optimization of AI and automation workflows in production environments.
- Contribute to the setup and maintenance of retrieval-augmented generation (RAG) pipelines and agent-based automation frameworks.
- Use Git and Azure DevOps for version control, CI/CD automation, and deployment of data and AI assets.
- Contribute to Infrastructure-as-Code (IaC) practices using Bicep or Terraform for repeatable deployments.
- Support data and AI governance by documenting processes, lineage, and configuration details to ensure compliance and reusability.
- Translate stakeholder and project requirements into robust, scalable data and AI components.
- Stay current with emerging technologies in AI agents, automation, and data platforms.
Requirements
- 3–6 years’ experience in data engineering, applied AI, or related technical roles.
- Proficiency with Azure Data Factory, Microsoft Fabric, or Synapse Analytics.
- Strong programming skills in Python and SQL for data manipulation and API interaction.
- Understanding of Lakehouse and Medallion architectures, including Parquet, Delta, and JSON data formats.
- Familiarity with Azure AI Services, including Azure ML, Azure OpenAI, and Cognitive Services.
- Experience using Git and Azure DevOps for source control and workflow automation.
- Strong analytical, debugging, and problem-solving abilities with attention to detail.
Benefits
- Flexible working 1 day per week in the office driven by business requirements as Convatec has a flexible approach to office working
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Junior Data Engineer assisting with data - driven use - cases in the payment sector. Contributing to the establishment of a central data platform at S - Payment.
Senior Data Engineer leading tailored data - driven solutions delivery for public sector clients. Involves data transformation projects and building AI - powered tools for decision making.
Technical Lead in Data Engineering at Intentsify, building scalable applications for B2B marketing solutions. Leading a small team and making key technological decisions.
Data Engineer developing scalable data pipelines for RunBuggy's automotive logistics platform. Collaborate with cross - functional teams to unlock powerful insights and optimize data infrastructure.
Working Student in Data Engineering supporting the development of an energy management app's data backbone across Europe. Collaborate with diverse teams to ensure data quality and optimization.
Senior Data Engineer at Minsait responsible for designing and maintaining data infrastructure. Ensuring efficient and secure data collection, storage, and processing across various sectors.
Senior Data Engineer developing and maintaining scalable data pipelines at Quality Digital. Ensuring data quality, security, and compliance with best practices while collaborating with data teams.
Data Engineer designing and developing data pipelines and infrastructure for processing and analyzing large data volumes at CIAL. Collaborating with data scientists to meet data requirements.
Data Engineer building and optimising data infrastructure at LifeByte. Collaborating with data scientists and analysts to improve data processing efficiency.