Kafka Engineer managing real-time streaming pipelines with a focus on scaling and fault tolerance. Collaborating with DevOps teams to automate deployments and monitoring for enterprise systems.
Responsibilities
Design and maintain Kafka-based streaming pipelines for high-throughput, low-latency real-time data processing
Ensure scalability, fault tolerance, and schema governance using tools like Schema Registry (Avro/Protobuf)
Develop robust Kafka producers and consumers using Java, adhering to performance and reliability standards
Collaborate with DevOps teams to automate CI/CD pipelines, deployment, and infrastructure provisioning for Kafka components
Monitor and troubleshoot Kafka cluster health, latency, throughput, and message delivery guarantees
Document architecture, deployment strategies, and operational runbooks for Kafka-based systems
Participate in code reviews, knowledge-sharing sessions, and architectural discussions.
Requirements
5–7 years of experience in backend or data engineering, with strong focus on Apache Kafka
Proficiency in Java for building Kafka producers/consumers and integration with backend services
Deep understanding of Kafka internals (brokers, partitions, consumer groups, offsets, replication, etc.)
Experience with schema management using Confluent Schema Registry, Avro, or Protobuf
Experience with CI/CD pipelines for Kafka component deployment and integration
Strong collaboration skills with DevOps teams to manage Kafka infrastructure, security, and automation
Solid understanding of real-time data processing concepts, fault tolerance, and data consistency.
Benefits
Hybrid work environment
Security best practices including encryption, authentication, and access control for Kafka clusters
Collaboration with DevOps teams
Job title
Application Engineer – Application Development, Backend Development
Associate Application Support Engineer providing top tier application support at Lighthouse. Collaborating with IT for system improvements and handling client relationships in India.
Senior Application Engineer at Baker Hughes leading tendering efforts for subsea production systems. Engaging in design, compliance, and execution phases while collaborating with project teams.
Lead Application Engineer for Gas Power Services Complex focused on global energy technologies. Develop technical solutions and collaborate with commercial and sales teams for ITO process.
Applications Engineer preparing DCS proposals for power industry projects at Emerson. Leading power project offers for new generation, retrofits, and renewable power applications.
System & Application Engineer at Anglian Water applying Systems Thinking to manage hydraulic systems performance metrics. Collaborating with teams and ensuring quality in OT data and telemetry management.
Application Security Engineer in Accurate Background's Global Information Security team supporting SAST and DAST operations. Collaborating with teams to ensure proper application vulnerability assessments and remediation.
Junior Legal Applications Engineer at A&L Goodbody using technology and AI to enhance legal services. Work collaboratively with teams to develop and maintain internal legal applications.
Application Engineer developing systems for FWD Group's IT services in Japan. Working on system development and maintenance, focusing on DevOps and agile methodologies.
Senior Application Support Engineer at Intel Foundry focusing on customer support for memory and eFUSE technologies, collaborating across teams to drive improvements and documentation.
AI Engineer responsible for designing and developing agentic AI applications at KION. Integrating AI and ML solutions into KION's software data ecosystem for operational efficiency.