Hybrid Data Engineering Analyst, Mid-level

Posted 2 months ago

Apply now

About the role

  • Data Engineer creating data pipelines for Santander's card domain. Collaborating with an agile team on strategic projects and leveraging Databricks and PySpark expertise.

Responsibilities

  • The Data Engineer will work with the Card team’s Data Engineering group to create data pipelines for ingesting and exposing card-domain data in Santander Brazil’s Corporate Data Lake.
  • The person will work in an agile team on a strategic area project and should have experience with Databricks and PySpark.

Requirements

  • Databricks proficiency: Experience working with Apache Spark on Databricks, including building and optimizing data pipelines.
  • PySpark, Python and Kedro experience: Strong programming skills in PySpark and Python and experience with Kedro to develop, debug and maintain data transformation code.
  • Batch and streaming data processing: Knowledge of batch and streaming (messaging) data processing, with the ability to design, implement and maintain data processing pipelines.
  • DevOps knowledge: Familiarity with Jenkins for continuous integration and continuous delivery (CI/CD), as well as automation of deployment tasks and pipeline management.
  • Git: Proficiency with Git for source code version control and effective team collaboration.
  • Agile methods: Understanding of agile principles and practices such as Kanban and Scrum for effective collaboration and project management.
  • Orchestration (e.g., Control‑M or others): Knowledge of workflow orchestration tools, important for scheduling and controlling workflows.
  • Microsoft Azure knowledge: Experience with key Microsoft Azure data services, including Azure Databricks, Azure Data Factory and Azure Storage.
  • AWS knowledge: Experience with key AWS services such as Aurora PostgreSQL, CloudWatch, Lambda and S3.
  • On‑Premises environments (Cloudera) experience: Previous experience with the Cloudera platform or other on‑premises big data solutions, including Hadoop, HBase and Hive, is desirable.
  • Object‑oriented development knowledge: Familiarity with Java is helpful (not required to write code, but to interpret it).
  • Optional certifications: AZ‑900 (Microsoft Azure Fundamentals) and DP‑900 (Microsoft Azure Data Fundamentals) are preferred and demonstrate solid knowledge of the Azure platform and data fundamentals.

Benefits

  • Bradesco Health Plan (30% co-payment)
  • Bradesco Dental Plan (no employee contribution)
  • Life Insurance
  • Wellhub (Gympass)
  • Childcare allowance
  • Allowance for children with special needs
  • Payroll‑deductible loan
  • Private pension
  • Pet plan
  • SESC benefits
  • Conexa telemedicine
  • Cost allowance
  • Meal / Food voucher
  • Multi‑benefits card
  • Medical plan upgrade
  • DIFFERENTIALS:
  • We are a socially responsible employer: extended maternity and paternity leave
  • INMaterna Program: support program for pregnant employees
  • Newborn welcome kit and the book "It Happened When I Was Born"
  • Professional development: courses available through the internal university
  • 100% remote or hybrid, depending on project applicability.

Job title

Data Engineering Analyst, Mid-level

Job type

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job