Data Engineer collaborating with clients on data processing and storage solutions. Focus on developing data flows and using software engineering principles for optimal solutions.
Responsibilities
Understand client requirements to process, store and serve data.
Collaborate on building and supporting data flows with data architects and analysts.
Apply software engineering and DevOps principles.
Build and maintain data flows for ETL processes.
Develop high-quality components using DataOps best practices.
Communicate with various stakeholders to build trust.
Learn and adapt to evolving data toolsets.
Manage cloud services for data infrastructure setup.
Requirements
Work closely with clients to understand their requirements to process, store and serve data.
Work alongside data architect, scientists and analyst to build and support data flows.
Apply concepts from software engineering and DevOps.
Use data tools from a large and varied data landscape to present and host datasets for downstream consumption.
Build, improve and maintain data flows to extract, transform and load data.
Follow software engineering and DataOps best practices to rapidly develop and deploy high quality components.
Communicate with technical and non-technical people to build trust and rapport.
Work with stakeholder to understand business problems sufficiently to have a clear picture of requirements.
Collaborate effectively within and across teams.
Show ability to quickly learn and adapt to evolving data engineering toolsets and techniques.
Demonstrate core technical skills around SQL, Python or similar programming languages.
Demonstrate fundamental skills in data management, orchestration, security and data modelling.
Setup cloud services to host data infrastructure and store data.
Work under general direction within a clear framework of accountability.
Exercise substantial personal responsibility and autonomy.
Use substantial discretion in identifying and responding to complex issues and assignments.
Escalate when issues fall outside their framework of accountability.
Plan, schedule and monitor work to meet given objectives and processes to time and quality targets.
Influence customers, suppliers and partners at project level.
Make decisions which influence the success of projects and team objectives.
Engage with and contribute to the work of cross-functional teams.
Investigate, define and resolve complex issues.
Benefits
Work-life balance is important; you can work around core hours with flexible and part-time working.
You’ll get 25 days holiday a year and the option to buy/sell and carry over from the year before.
Our flexible benefits package includes private medical and dental insurance, a competitive pension scheme, cycle to work scheme, taste cards and more.
You’ll have a dedicated Career Manager to help you develop your career.
You’ll be part of our company bonus scheme.
You are welcome to join any/all of our Diversity and Support groups.
Risk Data Engineer and Architect at Lincoln Financial supporting risk analytics through AWS data solutions. Building scalable data pipelines and collaborating with cross - functional teams.
Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.
Data Engineer developing tools for maintaining data integrity in cargo tracking at Kpler. Collaborating with analysts and engineers to enhance data quality management.
Lead Azure Data Engineer designing and optimizing data ecosystems on Microsoft Cloud. Responsible for building scalable data platforms and pipelines for analytics and reporting.
Data Engineer providing support for IBM DataStage ETL jobs at Callibrity. Collaborating with stakeholders and working to modernize technology solutions in a hybrid work environment.