Senior Data Engineer leading architectural definitions and evolution of data ecosystem in GCP. Ensuring data ingestion security and developing robust pipelines for data integration.
Responsibilities
Lead technical definitions and the architectural evolution of the data ecosystem on the GCP platform.
Ensure scalability, security, and governance in data ingestion and data provisioning processes.
Develop robust pipelines to integrate multiple sources, ensuring data quality and reliability.
Propose continuous improvements in performance, monitoring, and process automation.
Act as a technical reference, supporting strategic decisions and guiding teams on best practices.
Contribute to innovation initiatives, including the use of AI and the creation of new data products aligned with business needs.
Requirements
Strong experience as a Data Engineer with a proven track record in complex projects.
Extensive experience in large-scale data ingestion, transformation, and integration projects.
Advanced proficiency in Python for developing pipelines and automations.
Expertise in Google Cloud Platform (GCP), including BigQuery, Cloud Storage, Dataflow, and Pub/Sub.
Proficiency in SQL for optimized queries and data modeling.
Advanced experience with orchestration and distributed processing tools such as Airflow, Kafka, and Cloud Functions.
Knowledge of Vertex AI and applications of Artificial Intelligence in data pipelines.
Familiarity with NoSQL databases (e.g., Firestore, MongoDB).
Experience with SAP ECC or S/4HANA data models.
Experience with visualization tools (preferably Power BI) to support analyses.
Previous involvement in defining scalable architectures and performance-oriented solutions.
Experience with Agile methodologies (Scrum, Lean, Kanban).
Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, or related fields.
Lead Engineer in Process Automation driving technical projects at AtkinsRéalis. Collaborating with multidisciplinary teams and ensuring client satisfaction through innovative solutions.
Graphics Engineer designing and optimizing high - performance GPU software solutions for Samsung's next - generation products. Focused on Vulkan, Ray Tracing, and real - time graphics for emerging applications.
Algorithm Engineer contributing to R&D projects enhancing diabetes treatments and diagnostics with a focus on health insights. Collaborate with experts in a fast - paced, innovative environment aimed at improving human health.
Site Safety Engineer responsible for enforcing safety regulations and conducting training at various construction sites. Requires travel across the United States and adherence to safety standards.
Senior Engineer (Software Test) responsible for designing, building, and maintaining software test processes for medical technology. Collaborates on Ivenix Infusion System ensuring compliance in a regulated environment.
Engineer (Software Test) participates in software verification and validation testing at Fresenius Kabi. Responsibilities include setting up test fixtures and executing test protocols in a hybrid role.
Associate Software Engineer developing and maintaining cockpit display software at Collins Aerospace. Collaborating with teams and ensuring the integrity of software applications.
Mechanical Install Engineer assembling and qualifying lithography machines in clean rooms. Responsible for installation, calibration, and troubleshooting at customer sites across the US.
Data / AI Engineer designing and operating data and AI workloads on Microsoft Fabric. Delivering production - grade lakehouses and ensuring data pipeline efficiency in the Microsoft ecosystem.
SRE of Data at Porto Bank ensuring infrastructure stability and performance of Databricks and Azure. Applying SRE principles for operational efficiency.