Architect leading initiatives in data platform engineering at F5, solving challenges in unstructured data and enhancing governance frameworks.
About the role
- Senior Data Engineer at QiH responsible for designing real-time data pipelines and building scalable infrastructure. Collaborating with teams to tackle data challenges with innovative solutions.
Responsibilities
- Design, develop, and maintain scalable real-time data pipelines and infrastructure.
- Integrate various data sources and ensure seamless real-time data flow across the organisation.
- Build efficient, fault-tolerant, and highly available data ingestion processes.
- Monitor and improve data pipeline performance and scalability for low-latency and high-throughput.
- Work closely with cross-functional teams, including software engineers, data scientists, and business stakeholders, to ensure data infrastructure aligns with business objectives.
Requirements
- Hands-on experience in data engineering with a proven track record of building and managing real-time data pipelines across a track record of multiple initiatives.
- Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.).
- Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage.
- Programming skills in Python, Java, Scala, or a similar language.
- Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling.
- Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes).
- You thrive when working as part of a team
- Comfortable in a fast-paced environment
- Have excellent written and verbal English skills
- Last but not least, you’ll have no ego!
Benefits
- Competitive Basic Salary
- Quarterly Bonuses
- Hybrid working
- Private Health Care
- Market Leading Training Programme
- Recognition & Reward Scheme
- Annual Company Conference (previous destinations Bologna, Dubrovnik, Belgrade and Thessaloniki)
- Regular Happy Hour / Team Lunches
- Free Coffee, Drinks & Snacks
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect designing and implementing data architectures supporting analytics and ML for federal clients. Collaborating with teams to translate mission needs into robust data solutions.
IT Data Engineer developing data pipelines and integrations for Scanfil Group's global IT organization. Collaborating across teams to enhance data solutions and reporting capabilities.
Data Engineer developing Azure data solutions at PwC New Zealand. Responsibilities include data quality monitoring, pipeline development, and collaboration with stakeholders in a supportive environment.
Senior Data Engineer designing and implementing the Enterprise Data Platform at Stellix. Focusing on analytics and insights with a growth path to Principal Data Engineer or Data Architect.
R&D Data Engineer at DXC, transforming complex data into digital assets for global analytics and Smart Lab solutions. Collaborating on ELN and LIMS tools for enhanced data management.
Data Engineer role focusing on data pipelines and processing at 42dot, a mobility AI company. Responsibilities include data collection, schema management, and pipeline monitoring.
Senior Data Engineer at mobility AI company designing large - scale data processing pipelines. Leading technical decisions and mentoring junior engineers in data architecture.
Senior Data Engineer at Booz Allen building advanced tech solutions for mission - driven projects. Utilizing data engineering activities, pipelines, and platforms for impactful data insights.
Senior Software Engineer contributing to Workday's AI/MLOps cloud ops platform. Involves data ingestion, computation, and generation of curated data sets with modern technologies.