Senior Data Engineer building Big Data pipelines and distributed processing at Reply, an Italian IT consultancy. Collaborate with data science teams and cloud platforms.
Responsibilities
Construir e gerenciar pipelines confiáveis de dados envolvendo ingestão/coleta, processamento, integração, armazenamento e disponibilização de dados
Atuar em arquitetura de sistemas distribuídos para processamento massivo em paralelo (MPP)
Combinar diversas fontes de dados heterogêneas e colaborar com equipes de análise e ciência de dados
Colaborar na construção de soluções e geração de valor baseadas em dados
Trabalhar com as frentes IA, Cloud, Machine Learning e Indústria 4.0
Requirements
Experiência prática com ingestão, integração, processamento e armazenamento de grandes volumes de dados
Atuação em projetos de Big Data
Behavior Driven Development (BDD)
Extração de dados em Python
Processamento de dados com PySpark
Experiências em ferramentas ETL's
Conhecimento em modelagem de dados relacionais e dimensionais (Data WareHouse)
Experiência com bancos de dados SQL
Experiência com ferramentas Big Data na AWS: EMR, Kinesis, RedShift, S3, Glue, ElasticSearch
Conhecimento em Kafka
Conhecimento com Data Lake e Data Ops
Desejável: Certificações AWS
Desejável: Conhecimento em Terraform ou CloudFormation
Benefits
Cartão flexível Swile pra você usar como quiser (VA e VR)
Snowflake Data Engineer optimizing data pipelines using Snowflake for a global life science company. Collaborate with cross - functional teams for data solutions and performance improvements in Madrid.
Data Engineer designing and implementing big data solutions at DATAIS. Collaborating with clients to deliver actionable business insights and innovative data products in a hybrid environment.
SAP Data Engineer supporting MERKUR GROUP in becoming a data - driven company. Responsible for data integration, ETL processes, and collaboration with various departments.
Big Data Engineer designing and managing data applications on Google Cloud. Join Vodafone’s global tech team to optimize data ingestion and processing for machine learning.
Data Engineer building and maintaining data pipelines for Farfetch’s data platform. Collaborating with the Data team to improve data reliability and architecture in Porto.
Senior Data Engineer at Razer leading initiatives in data engineering and AI infrastructure. Collaborating across teams to develop robust data solutions and enhancing AI/ML projects.
Data Engineering Intern working with data as Jua builds AI for climate and geospatial datasets. Contributing to the integration and validation of new datasets with experienced mentors.
Data Engineer supporting a fintech company in building and maintaining data pipelines. Collaborating with tech teams and enhancing data processing in a high - volume environment.
Senior Data Engineer developing and optimizing data pipelines for Scene+’s cloud - native platform in Toronto. Collaborating across teams to enhance data governance and analytics capabilities.
Staff Engineer developing innovative data solutions for dentsu's B2B marketing vision. Collaborating using cutting - edge cloud technologies and mentoring engineers in their careers.