Design, develop, and maintain scalable real-time data pipelines and infrastructure.
Integrate various data sources and ensure seamless real-time data flow across the organisation.
Build efficient, fault-tolerant, and highly available data ingestion processes.
Monitor and improve data pipeline performance and scalability for low-latency and high-throughput.
Work closely with cross-functional teams, including software engineers, data scientists, and business stakeholders, to ensure data infrastructure aligns with business objectives.
Requirements
Hands-on experience in data engineering with a proven track record of building and managing real-time data pipelines across a track record of multiple initiatives.
Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.).
Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage.
Programming skills in Python, Java, Scala, or a similar language.
Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling.
Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes).
You thrive when working as part of a team
Comfortable in a fast-paced environment
Have excellent written and verbal English skills
Last but not least, you’ll have no ego!
Benefits
Competitive Basic Salary
Quarterly Bonuses
Hybrid working
Private Health Care
Market Leading Training Programme
Recognition & Reward Scheme
Annual Company Conference (previous destinations Bologna, Dubrovnik, Belgrade and Thessaloniki)
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Data Engineer focusing on development and optimization of data pipelines in an insurance context. Ensuring data integrity and supporting data - driven decision - making processes.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.
Full Stack Data Engineer on a Central Engineering Portfolio Team in Chennai delivering curated data products and collaborating with data engineers and product owners.