Senior Data Engineer shaping how data drives processes at Phoenix Group. Working with cross-functional teams on cloud platforms including Databricks and Azure.
Responsibilities
Design and implement end-to-end data engineering solutions across multiple platforms, including Azure, Databricks, SQL Server, and Salesforce, enabling seamless data integration and interoperability
Architect and optimize Delta Lake environments within Databricks to support scalable, reliable, and high-performance data pipelines for both batch and streaming workloads
Develop and manage robust data pipelines for operational, analytical, and digital use cases, leveraging best practices for data ingestion, transformation, and delivery
Integrate diverse data sources—cloud, on-premises, and third-party systems—using connectors, APIs, and ETL frameworks to ensure consistent and accurate data flow across the enterprise
Implement advanced data storage and retrieval strategies that support operational data stores (ODS), transactional systems, and analytical platforms
Collaborate with cross-functional teams (data scientists, analysts, product owners, and operational leaders) to embed data capabilities into business processes and digital services
Optimize workflows for performance and scalability, addressing bottlenecks and ensuring efficient processing of large-scale datasets
Apply security and compliance best practices, safeguarding sensitive data and ensuring adherence to governance and regulatory standards
Create and maintain comprehensive documentation for data architecture, pipelines, and integration processes to support transparency and knowledge sharing
Requirements
Proven experience in enterprise-scale data engineering, with a strong focus on cloud platforms (Azure preferred) and cross-platform integration (e.g., Azure ↔ Salesforce, SQL Server)
Deep expertise in Databricks and Delta Lake architecture, including designing and optimizing data pipelines for batch and streaming workloads
Strong proficiency in building and managing data pipelines using modern ETL/ELT frameworks and connectors for diverse data sources
Hands-on experience with operational and analytical data solutions, including ODS, data warehousing, and real-time processing
Solid programming skills in Python, Scala, and SQL, with experience in performance tuning and workflow optimization
Experience with cloud-native services (Azure Data Factory, Synapse, Event Hub, etc.) and integration patterns for hybrid environments
Junior Data Engineer role at Allegro, focusing on developing ETL/ELT pipelines and processing large datasets. Collaborate with cross - functional teams for data quality and reporting.
Data Engineer at Concept Reply developing innovative data - driven solutions in IoT. Collaborating with teams to unlock the potential of data and cloud computing.
Data Engineer creating and managing data pipelines for critical data solutions at S&P Global. Collaborating on enterprise - scale data processing in a supportive, innovative environment.
Data Engineer supporting and evolving data environment in cloud migration. Maintain and optimize existing databases while designing modern data solutions with cross - functional collaboration.
Senior Data Engineer responsible for data pipeline projects at Suprema Gaming. Focus on batch and streaming data solutions while collaborating with business teams.
Senior data leader managing the enterprise data architecture at Breakthru Beverage. Leading high - performing teams in data engineering and defining modern data strategies.
Data Engineer at Equinix implementing data architecture solutions for scalability and analytics. Collaborating with teams to design data pipelines and maintain data models for business objectives.
Data Warehouse Architect developing and optimizing robust data warehouse environments on SAP BW/4HANA. Critical for enabling advanced analytics and reporting across the organization.
Data Engineering Manager leading a new Data Engineering team in Bengaluru. Shaping the design and scaling of core data engineering practices across the organization.
Senior Google Data Architect designing and delivering scalable data solutions on Google Cloud Platform. Collaborating across teams to shape target - state data architectures and influence enterprise data strategy.