IN
Data Engineer creating data pipelines for Santander's card transactions. Collaborating with an agile team in strategic projects involving Databricks and PySpark.
MA
Hybrid Data Engineer, Microsoft Azure
Posted 3 weeks ago
About the role
- Design and implement scalable data models using Azure Synapse Analytics, Delta Lake, and T‑SQL
- Build and maintain ETL/ELT pipelines with Azure Data Factory and Spark (PySpark/Scala/Spark SQL)
- Optimize data refresh cycles using incremental/delta processing strategies
- Integrate CI/CD workflows for data pipelines using GitHub Actions or Azure DevOps
- Define and enforce data quality rules and cleansing logic
- Implement data governance policies and leverage Azure Purview for metadata and lineage tracking
- Manage and optimize storage in Azure Data Lake Storage Gen2
- Monitor performance and set up alerting using App Insights and Log Analytics
Requirements
- Design and implement scalable data models using Azure Synapse Analytics, Delta Lake, and T‑SQL
- Build and maintain ETL/ELT pipelines with Azure Data Factory and Spark (PySpark/Scala/Spark SQL)
- Optimize data refresh cycles using incremental/delta processing strategies
- Integrate CI/CD workflows for data pipelines using GitHub Actions or Azure DevOps
- Define and enforce data quality rules and cleansing logic
- Implement data governance policies and leverage Azure Purview for metadata and lineage tracking
- Manage and optimize storage in Azure Data Lake Storage Gen2
- Monitor performance and set up alerting using App Insights and Log Analytics
- Work with semantic technologies such as RDF mapping, SHACL validation, and Apache Jena
Benefits
- health insurance from the first days, regardless of the probationary period
- Christmas holidays from 25 December to 31 December
- Сooperation with Superhumans center and Veteran HUB
- psychological rehabilitation department of Superhumans
- psychological counseling provided by the Veteran Hub
- internal policy making the company friendly to military and veterans with the assistance of the Hub
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
SA
Sabiá AdministraçãoSenior Data Engineer
Data Engineer designing, implementing, and maintaining data pipelines at Sabiá Gaming. Focused on high - quality data access and integration for enhanced decision - making.
MA
MassMutualQuantitative Data Engineer
Quantitative Data Engineer developing data solutions and automations for MassMutual's investment management. Working with data orchestration tools within a collaborative team environment.
Senior Data Engineer designing and scaling data infrastructure for analytics, machine learning, and business intelligence in a software supply chain security company.
NI
NinjaTraderSenior Data Engineer
Data Engineer developing architecture and pipelines for data analytics at NinjaTrader. Empowering analysts and improving business workflows through data - driven solutions.
SP
SpecsaversData Engineer
Data Engineer designing and developing data solutions at Specsavers. Collaborating on data pipelines and migrations with analysts and stakeholders.
AL
AlterricData Engineer
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
KY
KyndrylELK Data Engineer
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
TC
The Clorox CompanySenior Data Engineer
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
FT
FCamara Consulting & TrainingData Engineer – AWS Stack
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.