Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
About the role
- Senior Data Engineer at Deep Sync leading data architecture and pipeline development. Designing scalable data solutions for AI-powered data solutions with a focus on data quality and governance.
Responsibilities
- Design and evolve scalable, secure, and high-performance data architectures supporting large-volume, high-velocity data.
- Establish data engineering standards, design patterns, and best practices.
- Evaluate and recommend tools, frameworks, and technologies for data processing and storage.
- Lead the design, implementation, and maintenance of robust, scalable data pipelines.
- Ensure data quality, validation, lineage, and observability throughout the pipeline lifecycle.
- Implement fault-tolerant and highly available data processing systems.
- Architect and oversee ETL/ELT frameworks transforming raw data into analytical and operational datasets.
- Integrate data from diverse sources including relational databases, APIs, third-party providers, and streaming platforms.
- Collaborate cross-functionally with product managers, analysts, ML engineers, and software teams.
Requirements
- 5–8+ years of experience in data engineering or related fields.
- 5+ years of advanced SQL query design, performance tuning, and optimization.
- 5+ years of experience in data warehouse architecture, implementation, and support.
- 5+ years of hands-on experience with ETL/ELT design, development, testing, and troubleshooting.
- Proven experience working with large-scale or “big data” environments.
- Knowledge & Skills Expert-level proficiency in SQL design and implementation.
- Strong experience with Relational Data Warehouse Systems and Data Warehouse Management Systems.
- Deep understanding of indexing, partitioning, denormalization, and query optimization techniques.
- Experience building and optimizing large-scale data pipelines and distributed architectures.
- Proficiency in one or more programming languages such as Python, Java, or C#.
- Experience with cloud data platforms and modern data tooling (e.g., AWS, Azure, GCP, Spark, Airflow, Snowflake, Databricks, etc.) is highly desirable.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and documentation abilities.
- Experience mentoring engineers and leading technical initiatives.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.