Senior Data Engineer at QiH responsible for designing real-time data pipelines and building scalable infrastructure. Collaborating with teams to tackle data challenges with innovative solutions.
Responsibilities
Design, develop, and maintain scalable real-time data pipelines and infrastructure.
Integrate various data sources and ensure seamless real-time data flow across the organisation.
Build efficient, fault-tolerant, and highly available data ingestion processes.
Monitor and improve data pipeline performance and scalability for low-latency and high-throughput.
Work closely with cross-functional teams, including software engineers, data scientists, and business stakeholders, to ensure data infrastructure aligns with business objectives.
Requirements
Hands-on experience in data engineering with a proven track record of building and managing real-time data pipelines across a track record of multiple initiatives.
Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.).
Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage.
Programming skills in Python, Java, Scala, or a similar language.
Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling.
Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes).
You thrive when working as part of a team
Comfortable in a fast-paced environment
Have excellent written and verbal English skills
Last but not least, you’ll have no ego!
Benefits
Competitive Basic Salary
Quarterly Bonuses
Hybrid working
Private Health Care
Market Leading Training Programme
Recognition & Reward Scheme
Annual Company Conference (previous destinations Bologna, Dubrovnik, Belgrade and Thessaloniki)
Snowflake Data Engineer optimizing data pipelines using Snowflake for a global life science company. Collaborate with cross - functional teams for data solutions and performance improvements in Madrid.
Data Engineer designing and implementing big data solutions at DATAIS. Collaborating with clients to deliver actionable business insights and innovative data products in a hybrid environment.
SAP Data Engineer supporting MERKUR GROUP in becoming a data - driven company. Responsible for data integration, ETL processes, and collaboration with various departments.
Big Data Engineer designing and managing data applications on Google Cloud. Join Vodafone’s global tech team to optimize data ingestion and processing for machine learning.
Data Engineer building and maintaining data pipelines for Farfetch’s data platform. Collaborating with the Data team to improve data reliability and architecture in Porto.
Senior Data Engineer at Razer leading initiatives in data engineering and AI infrastructure. Collaborating across teams to develop robust data solutions and enhancing AI/ML projects.
Data Engineering Intern working with data as Jua builds AI for climate and geospatial datasets. Contributing to the integration and validation of new datasets with experienced mentors.
Data Engineer supporting a fintech company in building and maintaining data pipelines. Collaborating with tech teams and enhancing data processing in a high - volume environment.
Senior Data Engineer developing and optimizing data pipelines for Scene+’s cloud - native platform in Toronto. Collaborating across teams to enhance data governance and analytics capabilities.
Staff Engineer developing innovative data solutions for dentsu's B2B marketing vision. Collaborating using cutting - edge cloud technologies and mentoring engineers in their careers.