Hybrid Databricks Data Engineer/Solution Architect

Posted last week

Apply now

About the role

  • Lead the end-to-end design, development, deployment and maintenance of data pipelines using Databricks
  • Architect solutions for ingestion, transformation, storage and serving layers
  • Collaborate with stakeholders (operations, finance, safety, etc.) to understand business needs
  • Define and enforce data governance, data quality, metadata management, security, access controls
  • Work with cloud infrastructure (Azure) to provision, monitor and optimize data compute, storage, and networking resources
  • Implement CI/CD, testing, monitoring, alerting for data pipelines
  • Mentor and coach more junior engineers, define best practices, code reviews, knowledge sharing
  • Troubleshoot performance issues, data discrepancies, failures; ensure high availability, disaster recovery

Requirements

  • Deep hands-on experience with Databricks (or similar platforms like Spark on cloud)
  • Strong proficiency in data engineering: building batch & streaming pipelines; ETL/ELT; data modeling
  • Solid programming skills in Python, Scala or SQL (at least two)
  • Experience with cloud platforms (ideally Azure), infrastructure as code (Terraform, ARM templates, or similar)
  • Familiarity with data storage technologies: relational databases, NoSQL, data lakes, Delta Lake / Parquet / parquet-like formats
  • Understanding of distributed computing, partitioning, scaling, performance tuning
  • Hands-on experience with data governance, data lineage, data quality frameworks
  • Experience with CI/CD tooling, version control, automated testing, monitoring and alerting

Benefits

  • Health insurance
  • Flexible work arrangements
  • Professional development

Job title

Databricks Data Engineer/Solution Architect

Job type

Experience level

JuniorMid level

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job