Data Engineer collaborating with clients on data processing and storage solutions. Focus on developing data flows and using software engineering principles for optimal solutions.
Responsibilities
Understand client requirements to process, store and serve data.
Collaborate on building and supporting data flows with data architects and analysts.
Apply software engineering and DevOps principles.
Build and maintain data flows for ETL processes.
Develop high-quality components using DataOps best practices.
Communicate with various stakeholders to build trust.
Learn and adapt to evolving data toolsets.
Manage cloud services for data infrastructure setup.
Requirements
Work closely with clients to understand their requirements to process, store and serve data.
Work alongside data architect, scientists and analyst to build and support data flows.
Apply concepts from software engineering and DevOps.
Use data tools from a large and varied data landscape to present and host datasets for downstream consumption.
Build, improve and maintain data flows to extract, transform and load data.
Follow software engineering and DataOps best practices to rapidly develop and deploy high quality components.
Communicate with technical and non-technical people to build trust and rapport.
Work with stakeholder to understand business problems sufficiently to have a clear picture of requirements.
Collaborate effectively within and across teams.
Show ability to quickly learn and adapt to evolving data engineering toolsets and techniques.
Demonstrate core technical skills around SQL, Python or similar programming languages.
Demonstrate fundamental skills in data management, orchestration, security and data modelling.
Setup cloud services to host data infrastructure and store data.
Work under general direction within a clear framework of accountability.
Exercise substantial personal responsibility and autonomy.
Use substantial discretion in identifying and responding to complex issues and assignments.
Escalate when issues fall outside their framework of accountability.
Plan, schedule and monitor work to meet given objectives and processes to time and quality targets.
Influence customers, suppliers and partners at project level.
Make decisions which influence the success of projects and team objectives.
Engage with and contribute to the work of cross-functional teams.
Investigate, define and resolve complex issues.
Benefits
Work-life balance is important; you can work around core hours with flexible and part-time working.
You’ll get 25 days holiday a year and the option to buy/sell and carry over from the year before.
Our flexible benefits package includes private medical and dental insurance, a competitive pension scheme, cycle to work scheme, taste cards and more.
You’ll have a dedicated Career Manager to help you develop your career.
You’ll be part of our company bonus scheme.
You are welcome to join any/all of our Diversity and Support groups.
Data Engineer/Analyst maintaining and improving data infrastructure for Braiins. Collaborating with technical and business teams to ensure reliable data flows and insights.
Medior Data Engineer handling Azure migrations for a major urban mobility client. Focused on data pipeline development and ensuring platform reliability with cutting - edge technologies.
Developing ML and computer vision solutions for cutting - edge autonomous vehicle dataset pipeline at Mobileye. Collaborating across teams for data curation and advanced perception algorithms.
Data Migration Lead in a hybrid role managing data migration for a major transformation programme in the media sector. Collaborating with various teams to ensure data integrity and successful migration.
Consultant ML & DataOps at Smile integrating data science projects for major clients. Designing MLOps solutions and enhancing data governance in a collaborative environment.
Data Engineer developing and maintaining data pipelines for Coolbet’s analytical services. Working within an Agile framework to ensure data reliability and efficiency.
API Data Engineer developing innovative data - driven solutions and advancing data architecture for AI Control Tower. Building and integrating APIs and data pipelines to support organizational needs.
Journeyman Data Architect supporting Leidos' enterprise data and analytics program for the Department of War. Collaborating on solutions for data architecture, cloud environments, and governance.
AWS Streaming Data Engineer developing software and systems in a fast, agile environment. Utilizing experience with real - time data ingestion and processing systems across distributed environments.