Hybrid Data Engineer III

Posted 1 hour ago

Apply now

About the role

  • Data Engineer at Vidalink developing and managing data pipelines and ensuring quality across various data sources. Building connections and processes for cloud-based data environments.

Responsibilities

  • Design, implement and maintain the connection between different environments and data sources, ensuring secure and efficient integration.
  • Develop and operate processes to ingest data from transactional (production) systems into the analytical layer, ensuring quality and consistency.
  • Apply and promote best practices in data modeling to ensure scalability, performance and analytical usability.
  • Build, orchestrate and monitor data pipelines across all architecture layers (ingestion, processing and consumption).
  • Ensure performance, reliability and SLA compliance for data and pipelines, proactively identifying and resolving issues.

Requirements

  • Strong experience with SQL and Python for data processing and transformation.
  • Hands-on experience with relational and analytical databases (e.g., PostgreSQL, SQL Server, BigQuery).
  • Experience with NoSQL databases, especially MongoDB.
  • Experience with messaging and data streaming platforms, with a focus on Apache Kafka.
  • Experience building ETL/ELT pipelines, with both batch and streaming ingestion.
  • Knowledge and experience with Databricks (Apache Spark) for distributed data processing.
  • Use of data orchestration and integration tools such as Airflow, Airbyte, dbt, Glue.
  • Experience in cloud computing environments (Azure is a plus).
  • Use of Git for code versioning and basic CI/CD practices.

Benefits

  • Medication plan
  • 50% coverage for general prescription medications and 100% coverage for medications related to women’s health.
  • 360° wellness:
  • Totalpass
  • Conexa Saúde: online therapy
  • Personalized meal plans
  • Wellness check-up: assess your physical and mental health
  • Physical and mental wellness content
  • Platform with more than 3,500 video classes across various fitness modalities
  • Commitment to diversity
  • No dress code (feel free to wear shorts whenever you want!)
  • Bridge days for all public holidays
  • Birthday day off
  • Lots of fun (we love a party!)
  • Hybrid model (2 days in the office in São Caetano do Sul).

Job title

Data Engineer III

Job type

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

No Education Requirement

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job