Senior Data Engineer responsible for data pipeline projects at Suprema Gaming. Focus on batch and streaming data solutions while collaborating with business teams.
Responsibilities
Design and implement batch and streaming data pipelines, ensuring reliability and performance;
Architect and evolve multi-cloud data lakes, ensuring governance, security and scalability;
Develop solutions in Databricks for distributed processing, machine learning and integration with multiple data sources;
Work end-to-end: ingestion, cleansing, storage, modeling and provisioning for visualization (BI/Analytics);
Follow architectural standards and best practices for data engineering in hybrid and distributed environments;
Collaborate with business, data science and product teams to turn data into strategic insights;
Implement automations using tools such as n8n and explore integrations with AI solutions to optimize processes;
Ensure data quality, observability and reliability through monitoring, testing and pipeline versioning;
Respond to critical data incidents, leading root cause analyses and proposing sustainable solutions.
Requirements
Bachelor's degree in Computer Engineering, Computer Science, Information Systems or related fields;
Minimum of 10 years of experience in data engineering, with proven experience in complex projects;
Strong experience in batch and streaming pipelines (Spark, Kafka, Flink, etc.);
Experience with multi-cloud data lakes (AWS, GCP and/or Azure);
Experience with Databricks (PySpark, Delta Lake, MLlib, etc.) and Snowflake;
Hands-on experience from ingestion to visualization (integration with BI tools such as Power BI, Tableau, Looker, Data Studio, Qlik, Einstein Insights);
Advanced knowledge of SQL and Python;
Experience with process automation (n8n, Airflow, Dagster or similar);
Familiarity with data security and governance practices (LGPD/GDPR, access control, auditing);
Advanced English for reading, writing and technical interaction.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.
Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.
Data Engineer focused on creating a data platform for automated cyber insurance. Collaborating with stakeholders to deliver data processing capabilities and governance.