Data Engineer role in São Paulo developing data pipelines and maintaining data architecture. Collaborative role with a focus on data governance and analytics.
About the role
- Data Warehouse Engineer developing end-to-end solutions for projects at TD Bank. Leading technical design and delivery of effective tech solutions.
Responsibilities
- Leads the creation of comprehensive end-to-end detailed solutions for projects and platforms
- Provides technical expertise with a focus on efficiency, reliability, scalability, and security
- Consults on development of requirements and specifications
- Works with Technology partners to define metrics and performance goals for the application
- Ensures respective programs/policies/practices are well managed and meet business needs
Requirements
- Undergraduate degree, Post Graduate degree or Technical Certificate
- Strong academic background (e.g., computer science, engineering)
- 5-7 years relevant experience
- 5+ years of experience building scalable data engineering solutions, with deep expertise in Apache Spark and PySpark
- 5+ years of experience in Design and developed high-performance ETL/ELT pipelines using PySpark for batch and real-time workloads
- 5+ years of experience in Apache Spark (Batch & Structured Streaming)
- 5+ years of experience in PySpark (DataFrames, Spark SQL, UDFs)
- 5+ years of experience in Data Modeling & Dimensional Data Marts
- 5+ years of experience in Real-Time Data Ingestion Pipelines
Benefits
- Health insurance
- 401(k) matching
- Paid time off (including Vacation PTO, Flex PTO, and Holiday PTO)
- Career development
- Banking benefits and discounts
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer designing automated data pipelines for a leading recycling and sustainability company. Collaborating with IT and operations to streamline workflows and increase efficiency.
Building, optimizing and supporting Beghou’s AI data platform in cloud environments using Databricks and Python. Requires hands - on development and adherence to software engineering best practices.
People Manager leading data engineering teams for Kramp, fostering growth in a tech environment. Overseeing performance and collaboration within a dynamic digital landscape.
Senior Data Engineer for Semrush, developing scalable data pipelines and optimizing data systems. Collaborating with teams for analytics and mentoring junior engineers in best practices.
Intern working on data engineering tasks for machine learning in the automotive field. Collaborating with Data Engineers and learning about data management tools.
Data Engineer developing and maintaining ETL processes using Azure Data Factory and Snowflake. Collaborating with teams to ensure reliable data for analytical purposes.
Senior Data Engineer at a fast - growing MNC designing scalable data pipelines and infrastructure for AI. Collaborate with teams while building solutions for analytics and energy optimization.
Senior Principal Engineer managing data quality framework implementation at Mercer. Collaborating with international stakeholders and ensuring robust data governance practices.
Data Engineer designing and implementing architectures in cloud environments. Collaborating with teams to define technical standards and achieve business goals.