Senior Data Architect working on data architecture and integration at CenterWell. Ensuring solutions meet technical robustness and business needs while collaborating with various stakeholders.
About the role
- Senior Data Engineer responsible for designing and building real-time data pipelines using Apache Kafka. Collaborating with cross-functional teams to support data-driven applications.
Responsibilities
- Design, develop, and maintain real-time data pipelines using Apache Kafka.
- Build scalable stream processing solutions using Kafka Streams, Spark Streaming, or Flink.
- Develop and optimize ETL/ELT pipelines for large-scale data processing.
- Integrate streaming pipelines with data lakes, data warehouses, and analytics platforms.
- Work with cross-functional teams including Data Scientists, Product Managers, and Analysts.
- Ensure data reliability, scalability, and performance optimization.
- Implement data governance, monitoring, and alerting for streaming systems.
- Troubleshoot production issues and optimize streaming architecture.
Requirements
- 8+ years of experience in Data Engineering.
- Strong hands-on experience with Apache Kafka / Kafka Streaming.
- Experience with Python, Java, or Scala.
- Strong knowledge of real-time streaming architectures.
- Experience with Spark, Flink, or Kafka Streams.
- Strong SQL and data modeling skills.
- Experience working with cloud platforms (AWS, GCP, or Azure).
- Familiarity with data lake technologies (S3, Delta Lake, Snowflake, etc.).
- Experience with Databricks or Snowflake.
- Experience with containerization (Docker, Kubernetes).
- Knowledge of CI/CD pipelines and DevOps practices.
- Experience with monitoring tools like Prometheus, Grafana, or Splunk.
- Experience with event-driven architecture.
- Experience building high-throughput, low-latency data systems.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Senior Data Architect modernizing enterprise analytics visualization systems at McKesson. Defining cloud architecture and leading migration from on - premises solutions.
Data Engineer optimizing data pipelines for ecommerce intelligence platform. Collaborate with teams to deliver reliable, fast, and scalable data solutions.
Data Architect developing enterprise data architecture and oversight for Heaven Hill. Collaborating with IT and business teams to optimize data models, governance, and analytics.
Digital Analytics Capability - Adobe Data Engineer at Bankwest. Supports Adobe Experience Cloud applications and contributes to digital analytics capabilities.
Data Engineer designing and maintaining data pipelines at Agile Defense. Focused on integrating technologies for vital national security and civilian missions.
Senior Data Engineer responsible for Cloud Data Lake design and development in financial services. Collaborate with management and technical teams to execute technology product roadmap.
Senior Data Architect for the Chief Data Office at State Street driving Global Data Architecture and Management. Collaborating with stakeholders to streamline data processes and enhance data quality.
Senior Data Engineer responsible for reliable data integration and transformation at Evertec. Collaborating with stakeholders and engineering teams using SQL and cloud platforms.
Data Engineer needed to build and maintain cloud data pipelines for a digital transformation consultancy. Collaborate on analytics initiatives and ensure data quality in São Paulo.