Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
About the role
- Senior Data Engineer focusing on diagnosing and resolving performance challenges in large-scale data platforms. Collaborating with engineering team on architectural improvements and MongoDB optimization.
Responsibilities
- Assess current ingestion pipelines, database design, and overall platform architecture
- Identify root causes of performance bottlenecks and scaling limitations
- Recommend and implement architectural improvements (data modeling, ingestion patterns, queueing, compute/storage separation, etc.)
- Optimize MongoDB usage for large-scale ingestion and query workloads
- Review and improve Kubernetes, Helm, and worker orchestration patterns
- Work closely with the engineering team to implement fixes and best practices
Requirements
- 5+ years of experience
- Strong background in distributed systems and data platform architecture
- Deep experience with MongoDB at a very large scale
- Hands-on expertise with Kubernetes, Helm, and containerized workloads
- Experience designing and optimizing high-throughput ingestion pipelines
- Familiarity with task queues and worker-based ingestion models (e.g., Celery or similar)
- Ability to troubleshoot complex, custom, on-prem environments
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.
Senior Azure Data Engineer maintaining business intelligence solutions for Grupo Gloria, implementing and stabilizing projects in Azure and Databricks with Power BI reporting.
Staff Data Engineer at URBN developing AI - powered digital experiences by integrating algorithmic solutions with creative tools. Collaborating with cross - functional teams for impactful product evolution.
Senior Data Engineer at Anglian Water responsible for scalable data solutions and team collaboration. Leading design, build, and operation of secure data pipelines for critical services.
Data Engineer developing complex data pipelines for Symphony, a global software company. Collaborating with teams and driving data solutions in a hybrid work environment.
Data Engineer focused on building and maintaining data pipelines using SQL Server and T - SQL. Designing data solutions for reporting and analytics from various internal and third - party systems.
Data Engineer responsible for building scalable data solutions and collaborating with various teams. Focused on data extraction, transformation, and maintaining optimal architecture.
Data Engineer developing innovative data driven solutions to simplify organization and enhance customer value. Leading design and delivery of scalable data architectures and pipelines for business success.