Data Engineer building and maintaining scalable data pipelines for Flowcode using modern technologies. Collaborating with cross - functional teams to ensure efficient data flow and infrastructure optimization.
About the role
- Senior Lead Data Engineer managing ETL pipelines and architecture design for Novacore data platforms. Collaborating with cross-functional teams to ensure quality standards and business alignment.
Responsibilities
- Monitor and manage multiple ETL pipelines supporting Novacore data platforms.
- Provide end-to-end troubleshooting, debugging, and resolution of pipeline failures.
- Perform root cause analysis for issues and implement permanent fixes.
- Proactively communicate pipeline failures, resolutions, and status updates to internal stakeholders and clients.
- Design and develop new ETL pipelines and data processing workflows as per business requirements.
- Assist clients in defining data architecture and proposing optimal technical solutions.
- Recommend and implement scalable, efficient, and cost-effective ETL and data architecture approaches.
- Support enhancements and optimizations to existing pipelines and data models.
- Manage code deployments to Production environments following established release processes.
- Utilize Azure DevOps for source control, CI/CD pipelines, release management, and work item tracking.
- Ensure deployment best practices, version control, and rollback strategies are followed.
- Provide ongoing operational support and maintenance for data pipelines and related systems.
- Create and maintain technical documentation, including pipeline workflows, architecture diagrams, and runbooks.
- Collaborate with cross-functional teams (engineering, analytics, and business stakeholders) to ensure smooth delivery and alignment with business goals.
- Adhere to agreed SLAs, timelines, and quality standards.
Requirements
- Key Responsibilities:- ETL Pipeline Monitoring & Support o\tMonitor and manage multiple ETL pipelines supporting Novacore data platforms. o\tProvide end-to-end troubleshooting, debugging, and resolution of pipeline failures. o\tPerform root cause analysis for issues and implement permanent fixes. o\tProactively communicate pipeline failures, resolutions, and status updates to internal stakeholders and clients. 1.\tETL Development & Architecture Design o\tDesign and develop new ETL pipelines and data processing workflows as per business requirements. o\tAssist clients in defining data architecture and proposing optimal technical solutions. o\tRecommend and implement scalable, efficient, and cost-effective ETL and data architecture approaches. o\tSupport enhancements and optimizations to existing pipelines and data models. 2.\tProduction Deployment & DevOps Support o\tManage code deployments to Production environments following established release processes. o\tUtilize Azure DevOps for source control, CI/CD pipelines, release management, and work item tracking. o\tEnsure deployment best practices, version control, and rollback strategies are followed. 3.\tOperational Support, Documentation & Collaboration o\tProvide ongoing operational support and maintenance for data pipelines and related systems. o\tCreate and maintain technical documentation, including pipeline workflows, architecture diagrams, and runbooks. o\tCollaborate with cross-functional teams (engineering, analytics, and business stakeholders) to ensure smooth delivery and alignment with business goals. o\tAdhere to agreed SLAs, timelines, and quality standards.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Software Engineer developing and operating data systems at Todyl, enhancing data ingestion, storage, and processing. Collaborating across teams to integrate data platforms with services.
Data Engineer developing and transforming data pipelines on GCP for a global dairy brand. Ensuring data quality and integrity with CI/CD practices and documentation.
Data Engineer role at SFEIR in Luxembourg focusing on building scalable data pipelines and AI architectures. Transforming data into valuable insights using modern technologies and frameworks.
Data Engineer designing and implementing data ingestion systems for IT consulting firm. Involves managing data architectures and developing ETL/ELT pipelines using modern tools and frameworks.
Data Engineer managing complex financial modeling and reporting data for Financial Services organization. Collaborating with Data Analysts on cutting - edge financial reports.
Own the insights data platform at BR - DGE, a fintech focused on scalable payment infrastructures. Collaborate with Analytics and Engineering to deliver trusted datasets and timely signals.
Data Engineering Lead designing and optimizing scalable data pipelines for a property insurance company. Collaborating across teams, mentoring engineers, and driving data architecture initiatives.
Senior Advisor managing data architecture and modeling frameworks for iA Financial Group. Supporting transformation and innovation of data management practices within the organization.
Senior Data Engineer leading the design and implementation of enterprise data strategies for Kemper Insurance's analytics and business intelligence initiatives.