Data Engineer designing and implementing big data solutions at DATAIS. Collaborating with clients to deliver actionable business insights and innovative data products in a hybrid environment.
About the role
- Big Data Engineer designing and managing data applications on Google Cloud. Join Vodafone’s global tech team to optimize data ingestion and processing for machine learning.
Responsibilities
- Design, build, and manage Big Data ingestion and processing applications on Google Cloud using BigQuery, Dataflow, Composer, Cloud Storage, and Dataproc.
- Optimise performance and analyse distributed computing tools such as Spark and Apache Beam (Dataflow).
- Develop cloud-optimised solutions for machine learning applications.
- Build real-time data processing systems using Kafka, Pub/Sub, Spark Streaming, or similar technologies.
- Manage the development lifecycle for agile software projects.
- Convert proof-of-concept machine learning models into production-ready solutions (MLOps).
- Deliver customer-oriented solutions in a timely and collaborative manner.
- Proactively plan and manage dependencies across projects.
- Implement robust solutions in test and production environments.
Requirements
- Professional Google Cloud Data Engineer certification.
- Strong analytical and technical skills for impact analysis and root cause identification.
- Excellent communication skills for engaging with business, technical, and project stakeholders.
- Good understanding of Big Data and Data Science ecosystems.
- 3–5 years of relevant work experience.
- Experience in building and deploying containers using Swarm/Kubernetes.
- Knowledge of container concepts, including creating lean and secure images.
- Familiarity with modern DevOps pipelines.
- Experience with streaming data pipelines using Kafka or Pub/Sub (Kafka experience is mandatory).
- Desired: Telecommunications industry experience.
- Exposure to CI/CD tools such as Jenkins, Git, Jira, and Confluence.
- Certified Google Cloud Professional Data Engineer.
- Graduate or Postgraduate in a technical stream (Engineering preferred).
Benefits
- Opportunity to work on cutting-edge Big Data and cloud technologies.
- Exposure to real-time data processing and machine learning applications.
- Collaborative work environment with global teams.
- Career growth through continuous learning and certification opportunities.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
SAP Data Engineer supporting MERKUR GROUP in becoming a data - driven company. Responsible for data integration, ETL processes, and collaboration with various departments.
Data Engineer building and maintaining data pipelines for Farfetch’s data platform. Collaborating with the Data team to improve data reliability and architecture in Porto.
Senior Data Engineer at Razer leading initiatives in data engineering and AI infrastructure. Collaborating across teams to develop robust data solutions and enhancing AI/ML projects.
Data Engineering Intern working with data as Jua builds AI for climate and geospatial datasets. Contributing to the integration and validation of new datasets with experienced mentors.
Data Engineer supporting a fintech company in building and maintaining data pipelines. Collaborating with tech teams and enhancing data processing in a high - volume environment.
Staff Engineer developing innovative data solutions for dentsu's B2B marketing vision. Collaborating using cutting - edge cloud technologies and mentoring engineers in their careers.
Senior Data Engineer developing and optimizing data pipelines for Scene+’s cloud - native platform in Toronto. Collaborating across teams to enhance data governance and analytics capabilities.
Data Engineer developing and managing risk management databases for one of the largest banks in Czech Republic. Collaborating on data solutions and processes to enhance risk management.
Data Warehouse Developer II designing and maintaining ETL processes at NCCPA, a certifying organization for physician assistants in the U.S.