Senior Data Engineer responsible for data pipeline projects at Suprema Gaming. Focus on batch and streaming data solutions while collaborating with business teams.
About the role
- Data Solutions Architect designing enterprise-scale Azure and Databricks Lakehouse solutions for clinical trials and life sciences data enabling advanced analytics and compliance.
Responsibilities
- Architect Lakehouse solutions leveraging Azure Data Lake (ADLS Gen2), Databricks, and Delta Lake.
- Design data models (star, snowflake, data vault), ingestion pipelines, and CDC strategies with schema evolution and performance tuning.
- Implement data governance, security, and compliance aligned with GxP, HIPAA, and 21 CFR Part 11.
- Enable data science and ML workflows using MLflow, Feature Store, and curated datasets.
- Collaborate with clinical operations and biometrics teams to deliver business-aligned solutions.
Requirements
- 15+ years in data architecture/engineering; 5+ years with Azure; 3+ years with Databricks.
- Azure Expertise: ADLS Gen2, Data Factory/Fabric pipelines, Synapse/SQL, Event Hubs, Functions, Key Vault, Private Endpoints, VNets.
- Databricks Expertise: Spark (PySpark/SQL), Unity Catalog, Delta Live Tables (DLT), Workflows, MLflow, Feature Store.
- Data Modeling: Star/snowflake, data vault, CDC, schema evolution, performance tuning.
- Programming: PySpark, SQL; bonus: Python (pandas), Scala, dbt.
- Governance & Security: IAM/RBAC/ABAC, row/column-level security, encryption, masking/tokenization, secrets, audit.
- Observability & Reliability: Monitoring, lineage, alerting, CI/CD (GitHub Actions/Azure DevOps), automated testing/validation.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior data leader managing the enterprise data architecture at Breakthru Beverage. Leading high - performing teams in data engineering and defining modern data strategies.
Data Engineer at Equinix implementing data architecture solutions for scalability and analytics. Collaborating with teams to design data pipelines and maintain data models for business objectives.
Data Warehouse Architect developing and optimizing robust data warehouse environments on SAP BW/4HANA. Critical for enabling advanced analytics and reporting across the organization.
Data Engineering Manager leading a new Data Engineering team in Bengaluru. Shaping the design and scaling of core data engineering practices across the organization.
Sr. ETL/Data Warehouse Lead at Huntington designing, developing, and supporting ETL and Data Warehousing framework. Analyzing systems based on specifications and providing technical assistance.
Senior Google Data Architect designing and delivering scalable data solutions on Google Cloud Platform. Collaborating across teams to shape target - state data architectures and influence enterprise data strategy.
Data Engineer developing scalable data lake solutions and optimizing data pipelines at U.S. Bank. Collaborating with teams to manage data governance and cloud migration activities.
Lead AI, MLOps & Data Engineer at WedR, guiding complex data projects and AI innovation. Collaborate with diverse experts in a Product Studio for digital transformations.
Lead Azure Databricks Data Engineer at Ryan Specialty focused on implementing data solutions and collaborating with cross - functional teams to enhance data architecture.