Senior Data Engineer designing and implementing sustainable data solutions for diverse clients. Collaborating closely with stakeholders to enhance data services and platforms in a hybrid environment.
About the role
- Senior Data Engineer developing Azure-based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Responsibilities
- Understand customer requirements and work collaboratively to design data solutions that deliver high quality outcomes.
- Enable higher quality data to be created & managed in our customers organisations
- Develop high quality data products utilising (primarily) cloud native patterns
- Engineer cloud-based data lake patterns to connect and leverage organisational & external data
- Provide technical support and guidance through prototyping, testing, build, and launch of data products
- Contribute towards the creation of technical support and design documentation for data platforms and solutions .
- Contribute to continually refining our development standards and best practices.
Requirements
- Strong technical expertise using core Microsoft Azure data technologies: Data Factory, Databricks, Data Lake, Azure SQL, Synapse, Data Catalog , Purview
- A strong background in Python development (for data engineering) and SQL
- Proficient with Azure databases such as Synapse EDW, SQL Managed Instance, and Azure SQL
- Skilled in Devops (CI/CD) implementations. Including IaC deployments (Bicep, Terraform, etc.)
- Adept at team collaboration and task tracking with Azure DevOps, adhering to Scrum/Agile methodologies.
- Knowledge and experience of the following would be advantageous : C# development skills
- Azure services used for infrastructure build and monitoring (ARM, Policy, Monitor, Log Analytics etc)
- Implementation of big data/analytics services
- Supporting AI/Machine Learning workflows at production-level scale
- NoSQL databases such as Cosmos DB or Mongo DB
- Knowledge of Microsoft Fabric and its requisite platform components, as well as monitoring, security and governance configuration within the platform
- Experience in working with Power BI, including Power Query, DAX, and Power BI Service.
Benefits
- A collaborative and supportive environment in which you can grow and develop your career
- The tools and opportunity to do work you can be proud of
- A chance to work alongside some of the best people in the industry, who always seek to share their knowledge and experience
- Hybrid working – we empower you to make smart choices about when and where to work to achieve great results
- Industry leading coaching and mentoring
- Competitive salary and an excellent benefits package
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Staff Data Engineer at Qualifinds building AI - driven valuation tools and leading data ingestion development for art and collectibles management.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.
Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.
Data Engineer developing tools for maintaining data integrity in cargo tracking at Kpler. Collaborating with analysts and engineers to enhance data quality management.
Lead Azure Data Engineer designing and optimizing data ecosystems on Microsoft Cloud. Responsible for building scalable data platforms and pipelines for analytics and reporting.