Data Engineer designing and building data pipelines at LexisNexis. Collaborating with partners for high - quality analytics and AI - ready data.
About the role
- Senior Data Engineer developing and maintaining data pipelines for clients. Ensuring quality and reliability of data in an Agile environment based in Birmingham.
Responsibilities
- As a Senior Data Engineer, you will spend your time helping clients achieve their data engineering needs.
- Primarily the development, deployment and maintenance of data pipelines in a fast moving, Agile environment.
- You’ll also make a real impact by taking an active role in the team’s Agile Development practices, technical decision making and development, generating value and continuously striving to improve the quality and reliability of our data and processes.
- You will spend the majority of your time helping deliver client data engineering opportunities and supporting the growth of our junior-mid level technologists; both within AND and for our clients. This will include…
- Extract data from multiple data sources
- Write code to ingest or transform new and existing data
- Transform data in various ways to support data scientists and product analysts
- Build and design a scalable and extensible data architecture
- Conduct large scale batch and real-time processing from varying sources
- Influence the client on how they approach data engineering issues
- Collaborate with tech leads on system integrations
- Engaging actively with our Consultancy Data Strategy and Insight practice, to help define and materialise clients’ data strategies
- Championing and upholding high technical quality standards
Requirements
- Experience of using modern and traditional data technologies including: MongoDB, PostgreSQL, mySQL/mariaDB, Kafka, Splunk/ELK or other logging and monitoring tools, BI and Data Warehousing solutions and ETL and migration technologies
- Good cloud-native data engineering skills e.g. AWS RDS, Redshift, Kinesis, Glue or Azure CosmosDB, DataFactory, SQL DB etc.
- Good experience in quality assuring data programmes, including non-functional testing and performance tuning
- At least 3 years experience writing Python, R, SQL or Scala
- Experience in Dimensional modelling and Data Warehouse patterns
- Good understanding and track record of delivering complex data solutions using Agile methods including Scrum, SAFe etc.
- Hands-on experience of modern software delivery, including CI/CD and DevOps practices
- Experience with Big data storage or Data Lakes
- A keen understanding of industry best-practice around standards, quality and continuous improvement in the field of Data Engineering
- Experience in the field of Data Engineering, Science or Analytics
- Consultancy or professional services experience across a number of sectors
- Javascript / Typescript / NodeJS experience
- Experience with Hadoop, Spark, Redshift or Parquet
- Coaching and providing career progression to junior and mid-level developers, supporting developers create exciting and inspiring career ambitions
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer implementing data pipelines on Snowflake platform with a focus on innovation and collaboration for Zurich's data projects.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.
Boomi Integration Architect designing and leading integration solutions for data warehouses. Collaborating with cross - functional teams to implement scalable integration patterns using Boomi technologies.
Seeking a Boomi Integration Architect specializing in Data Warehouse and Master Data Hub implementations. Responsible for designing high - performance integration solutions across enterprise platforms.
Principal Data Engineer at Serko enhancing global travel tech through data - driven solutions. Collaborating across teams in Bengaluru to drive innovative engineering and best practices.
Data Engineer at Keyrus responsible for building and optimizing data pipelines for major projects. Contributing to data solutions and ensuring data quality in a growing team.