Hybrid Senior Data Engineer, Cloudera

Posted 2 weeks ago

Apply now

About the role

  • Data Engineer creating scalable data pipelines using technologies like Databricks and Azure for intelligent data solutions. Focused on collaboration with multidisciplinary teams to tackle complex data challenges.

Responsibilities

  • Design, develop, and maintain scalable, reliable data pipelines.
  • Build data ingestion, transformation, and modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory (ADF).
  • Ensure data quality, integrity, and usability across the entire pipeline.
  • Design and maintain Data Lake and Data Warehouse solutions, applying data governance best practices.
  • Work with concepts and architectures such as Bronze, Silver, and Gold layers, star schema, Delta Tables, Delta Sharing, and analytical tables.
  • Collaborate with technical and business teams to orchestrate solutions aligned with company objectives.

Requirements

  • Solid experience as a Data Engineer or in a similar role.
  • Advanced knowledge of:
  • • Cloudera (Hive, Impala, HDFS, etc.)
  • • SQL
  • • Python / PySpark
  • • Azure Databricks (workflows, jobs, Delta Tables, queries, etc.)
  • • Azure Data Factory (ADF)
  • • ETL/ELT and data pipelines
  • • Dimensional data modeling
  • • Data Lake / Data Warehouse
  • • Data governance and data quality
  • Experience with CI/CD practices applied to data environments.
  • Strong communication and collaboration skills with multidisciplinary teams.
  • Ability to work in dynamic environments and handle loosely defined technical scopes.
  • Knowledge of code optimization in cloud environments.
  • Advantage: Experience with Teradata.
  • Experience with SAS.

Benefits

  • Health and dental insurance;
  • Meal and grocery vouchers;
  • Childcare assistance;
  • Extended parental leave;
  • Partnerships with gyms and health & wellness professionals via Wellhub (Gympass) and TotalPass;
  • Profit-sharing (PLR);
  • Life insurance;
  • Continuous learning platform (CI&T University);
  • Employee discount club;
  • Free online platform dedicated to promoting physical and mental health and well-being;
  • Prenatal and responsible parenthood course;
  • Partnerships with online course platforms;
  • Language learning platform;
  • And many more

Job title

Senior Data Engineer, Cloudera

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

HybridBrazil

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job