Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Responsibilities
**We are looking for a Senior Data Engineer who will also serve as a Databricks administrator.**
You will be responsible for the reliable operation, performance and security of our data platform. Your expertise will guide the teams using Databricks to ensure efficient and best-practice data operations.
You will mentor a junior Data Engineer already on the team.
**π Main responsibilities**
Administer and optimize our Data platform.
Implement and enforce best practices: CI/CD, Git integration, automation, and environment management.
Ensure data security, isolation and related governance.
Implement performance and cost monitoring systems, including associated alerts.
Serve as a technical reference for users: solution architecture, job and pipeline optimization.
Design, maintain and improve data pipelines using SQL and Python.
Requirements
Required skills
Strong expertise with Databricks.
Excellent SQL and Python skills.
Solid knowledge of DevOps/DataOps practices: CI/CD, automation, Git.
Awareness of data security and governance concerns.
Microsoft Data Architect designing and building business intelligence solutions on Azure. Collaborating with teams and engaging clients for strategic data solutions.
Senior Data Engineer developing data - pipelines and deploying AI tools for Mariner's ecosystem. Collaborating with cross - departmental teams to enhance enterprise data products and systems integrations.
Data Architect for Amazon leading data strategy and advanced analytics solutions. Collaborating with cross - functional teams to drive measurable value and enhance data literacy across the organization.
Data Platform Engineer at Taxfix managing data infrastructures and pipelines to support analytics and AI - driven product features. Collaborating with cross - functional teams to ensure data reliability.
Mid - level Data Engineer building secure, scalable data infrastructure on AWS for fintech startup TrueLayer. Collaborating with DevOps and Analytics teams to enhance data operations.
Data Architect responsible for enterprise data architecture and solutions at NMC. Collaborating with various teams while evolving Microsoft D365 data architecture.
Senior Data Engineer developing robust data pipelines and optimizing databases for Atecna clients. Contributing to the growth of Atecnaβs Data community with expertise.
Data Scientist role at CRH Talento de IT focused on data architecture and analytics. Involves collaboration with development, BI, and data governance teams while working hybrid.
Senior Cloud Data Engineer maintaining RealTruckβs data warehouse for analytics and reporting. Collaborating globally and mentoring junior engineers while ensuring data accessibility and quality.