Hybrid Senior Databricks Engineer

Posted 10 hours ago

Apply now

About the role

  • Senior Data Engineer specializing in Databricks and PySpark for building scalable data solutions in cloud platforms. Responsible for data quality and optimizing data workflows.

Responsibilities

  • Design and implement data pipelines and ETL processes using **Databricks** and **PySpark**.
  • Develop and optimize SQL queries for data transformation and analytics.
  • Collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions.
  • Ensure data quality, governance, and compliance across all processes.
  • Integrate data from multiple sources and manage large-scale datasets efficiently.
  • Troubleshoot and optimize performance for data workflows and queries.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
  • Proven experience in building and managing data pipelines in cloud environments.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration abilities.
  • **Primary Skills (Must-Have): **
  • **Databricks** (including Delta Lake and ML capabilities)
  • **PySpark** for distributed data processing
  • **SQL** for data manipulation and analytics
  • **Good-to-Have Skills: **
  • **Azure Services:** ADF, Synapse, Purview, Fabric
  • **AWS Services:** Glue, Lambda, Step Functions
  • **Workflow Orchestration:** Airflow
  • **Data Transformation & Integration:** DBT, Fivetran, Informatica
  • **Streaming & Messaging:** Kafka
  • **BI & Visualization:** Power BI
  • **Data Governance Tools:** Collibra, Alation
  • **GCP:** BigQuery

Job title

Senior Databricks Engineer

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job