Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
About the role
- Senior Data Engineer joining a dynamic team to develop impactful data solutions for the finance sector. Focusing on data infrastructure and collaborating across engineering and product teams.
Responsibilities
- Design, develop and support robust data infrastructure solutions focused on scalability, security and efficiency.
- Lead the implementation and maintenance of ecosystems such as Trino, AWS Glue, Redshift, Airflow, Kafka and Spark on Kubernetes (K8s).
- Collaborate with engineering, data science and product teams to ensure smooth integration between systems.
- Diagnose and resolve performance, scalability and reliability incidents.
- Apply and promote best practices in architecture, data governance and monitoring.
Requirements
- Strong experience with data infrastructure ecosystems: Trino, AWS Glue, Terraform, CI/CD, Apache Airflow, Kafka and Spark on Kubernetes.
- Proven experience with cloud computing (AWS).
- Advanced proficiency in Python (including PySpark) and object-oriented programming.
- Demonstrated experience with distributed systems, data warehouses and large-scale ETL/ELT pipelines.
- Practical knowledge of data governance, security and storage (e.g., S3, Redshift).
- Strong analytical and problem-solving skills with a focus on operational efficiency.
- Good communication skills and experience working collaboratively.
- **Preferred:**
- Certifications such as AWS Certified Solutions Architect or equivalent.
- Familiarity with Trino for ad-hoc analysis.
- Experience with monitoring tools such as Datadog or New Relic.
- Knowledge of AI applied to data, especially RAG (Retrieval-Augmented Generation), for projects involving intelligent analysis and insight generation.
Benefits
- Competitive compensation based on experience;
- Opportunities for career growth and participation in strategic projects;
- Dynamic and challenging work environment;
- Opportunity to work at a rapidly growing company in the market.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.