Senior Data Engineer developing Azure-based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.
Responsibilities
Understand customer requirements and work collaboratively to design data solutions that deliver high quality outcomes.
Enable higher quality data to be created & managed in our customers organisations
Develop high quality data products utilising (primarily) cloud native patterns
Engineer cloud-based data lake patterns to connect and leverage organisational & external data
Provide technical support and guidance through prototyping, testing, build, and launch of data products
Contribute towards the creation of technical support and design documentation for data platforms and solutions .
Contribute to continually refining our development standards and best practices.
Requirements
Strong technical expertise using core Microsoft Azure data technologies: Data Factory, Databricks, Data Lake, Azure SQL, Synapse, Data Catalog , Purview
A strong background in Python development (for data engineering) and SQL
Proficient with Azure databases such as Synapse EDW, SQL Managed Instance, and Azure SQL
Skilled in Devops (CI/CD) implementations. Including IaC deployments (Bicep, Terraform, etc.)
Adept at team collaboration and task tracking with Azure DevOps, adhering to Scrum/Agile methodologies.
Knowledge and experience of the following would be advantageous : C# development skills
Azure services used for infrastructure build and monitoring (ARM, Policy, Monitor, Log Analytics etc)
Implementation of big data/analytics services
Supporting AI/Machine Learning workflows at production-level scale
NoSQL databases such as Cosmos DB or Mongo DB
Knowledge of Microsoft Fabric and its requisite platform components, as well as monitoring, security and governance configuration within the platform
Experience in working with Power BI, including Power Query, DAX, and Power BI Service.
Benefits
A collaborative and supportive environment in which you can grow and develop your career
The tools and opportunity to do work you can be proud of
A chance to work alongside some of the best people in the industry, who always seek to share their knowledge and experience
Hybrid working – we empower you to make smart choices about when and where to work to achieve great results
Industry leading coaching and mentoring
Competitive salary and an excellent benefits package
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Data Engineer II focusing on strategic ingestion product for Travelers. Building data solutions and collaborating across teams to support analytic transformation.
Data Engineer at Tatum focusing on scalable data solutions and blockchain technology. Collaborating with teams to ensure data integrity and manage data infrastructure in a hybrid setup.
Senior Lead Data Engineer at Capital One collaborating with Agile teams and mentoring developers. Leading full - stack development and driving cloud - based solutions for financial empowerment.