Hybrid Senior Data Engineer – Business Intelligence

Posted 20 hours ago

Apply now

About the role

  • We’re looking for a **Senior Data Engineer** to join our growing Data Platform team.
  • Design and scale the infrastructure and pipelines that power analytics, machine learning, and business intelligence across Sonatype.
  • Work closely with stakeholders across product, engineering, and business teams to ensure data is reliable, accessible, and actionable.
  • Architect, build, and maintain the data infrastructure that powers our analytics and data science efforts.
  • Partner closely with Data Analysts, Data Scientists, and product teams.
  • Design scalable, reliable data pipelines, manage our Databricks and AWS environments, and ensure best practices for security, governance, and deployment.

Requirements

  • 5+ years of hands-on experience in data engineering or a related role.
  • Expert proficiency in Apache Spark—both Scala and PySpark—for large-scale data processing.
  • Strong Python skills (including pandas) and practical experience with AWS’s boto3 SDK.
  • Deep familiarity with Databricks concepts: workspaces, clusters, jobs, Unity Catalog, and service principals.
  • Solid understanding of AWS data services: S3, Secrets Manager, SQS, IAM, and network/security configurations.
  • Nice to have experience with Terraform for defining and managing cloud infrastructure.
  • Proficient with GitHub for version control, code reviews, and CI/CD.
  • Excellent debugging and performance-tuning capabilities for distributed systems.
  • Strong communication and collaboration skills; able to translate technical solutions into business value.

Benefits

  • Parental leave
  • Diversity and inclusion working groups
  • Flexible working practices

Job title

Senior Data Engineer – Business Intelligence

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

No Education Requirement

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job