Lead Engineer managing rail signalling and control systems at Transport for NSW. Overseeing teams, ensuring safety and compliance in rail transport infrastructure in a hybrid - friendly role.
About the role
- Senior Data Engineer leading architectural definitions and evolution of data ecosystem in GCP. Ensuring data ingestion security and developing robust pipelines for data integration.
Responsibilities
- Lead technical definitions and the architectural evolution of the data ecosystem on the GCP platform.
- Ensure scalability, security, and governance in data ingestion and data provisioning processes.
- Develop robust pipelines to integrate multiple sources, ensuring data quality and reliability.
- Propose continuous improvements in performance, monitoring, and process automation.
- Act as a technical reference, supporting strategic decisions and guiding teams on best practices.
- Contribute to innovation initiatives, including the use of AI and the creation of new data products aligned with business needs.
Requirements
- Strong experience as a Data Engineer with a proven track record in complex projects.
- Extensive experience in large-scale data ingestion, transformation, and integration projects.
- Advanced proficiency in Python for developing pipelines and automations.
- Expertise in Google Cloud Platform (GCP), including BigQuery, Cloud Storage, Dataflow, and Pub/Sub.
- Proficiency in SQL for optimized queries and data modeling.
- Advanced experience with orchestration and distributed processing tools such as Airflow, Kafka, and Cloud Functions.
- Knowledge of Vertex AI and applications of Artificial Intelligence in data pipelines.
- Familiarity with NoSQL databases (e.g., Firestore, MongoDB).
- Experience with SAP ECC or S/4HANA data models.
- Experience with visualization tools (preferably Power BI) to support analyses.
- Previous involvement in defining scalable architectures and performance-oriented solutions.
- Experience with Agile methodologies (Scrum, Lean, Kanban).
- Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, or related fields.
Benefits
- Hybrid work
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Project Engineer assisting in construction project management at Gowan/Garrett, Inc. Coordinating tasks and collaborating with vendors in various construction phases.
Managing Engineer overseeing civil/environmental engineering projects at Anchor QEA in Baltimore. Leading design efforts, mentoring staff, and coordinating with clients and engineers.
IAM Engineer (Identity & Access Management) at Luminor Group. Implementing IAM solutions and managing identity lifecycle in hybrid environments.
IAM Engineer managing Identity & Access Management capabilities at Luminor Group. Drive secure access, compliance, and automation across hybrid environments in the banking sector.
Post - Silicon Validation Engineer at Intel validating CPU/SOC architectures for laptops and desktops. Collaborating with cross - functional teams to ensure product reliability and performance.
Senior Systems Test and Evaluation Engineer supporting the integration of test and evaluation for orbital warfare systems. Working closely with government and contractor teams on space acquisition programs.
Associate Engineer involved in technical knowledge for designing natural gas transmission systems. Collaborating with teams for project management and compliance in natural gas projects.
Desktop Engineer providing first and second line IT support for Twinings Ovaltine's technology needs. Supporting users across laptops, mobile devices, and meeting technologies in a hybrid workplace.
SM
Meister*in / Techniker*in / Ingenieur*in im Bereich Trinkwassermanagement. Unterstützung bei der Einhaltung von Hygienevorgaben und Optimierung von Prozessen.