Senior Data Engineer building Big Data pipelines and distributed processing at Reply, an Italian IT consultancy. Collaborate with data science teams and cloud platforms.
Responsibilities
Construir e gerenciar pipelines confiáveis de dados envolvendo ingestão/coleta, processamento, integração, armazenamento e disponibilização de dados
Atuar em arquitetura de sistemas distribuídos para processamento massivo em paralelo (MPP)
Combinar diversas fontes de dados heterogêneas e colaborar com equipes de análise e ciência de dados
Colaborar na construção de soluções e geração de valor baseadas em dados
Trabalhar com as frentes IA, Cloud, Machine Learning e Indústria 4.0
Requirements
Experiência prática com ingestão, integração, processamento e armazenamento de grandes volumes de dados
Atuação em projetos de Big Data
Behavior Driven Development (BDD)
Extração de dados em Python
Processamento de dados com PySpark
Experiências em ferramentas ETL's
Conhecimento em modelagem de dados relacionais e dimensionais (Data WareHouse)
Experiência com bancos de dados SQL
Experiência com ferramentas Big Data na AWS: EMR, Kinesis, RedShift, S3, Glue, ElasticSearch
Conhecimento em Kafka
Conhecimento com Data Lake e Data Ops
Desejável: Certificações AWS
Desejável: Conhecimento em Terraform ou CloudFormation
Benefits
Cartão flexível Swile pra você usar como quiser (VA e VR)
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.