Staff Data Engineer designing next - gen data platforms and pipelines at CommBank. Integrating data sources and ensuring high - quality, scalable data products while collaborating with Business Banking technology teams.
About the role
- Senior Data Engineer at People Inc. enhancing data integration pipelines and optimizing data lakes for analytics. Collaborating with stakeholders and ensuring data quality in a hybrid work environment.
Responsibilities
- Enhance systems by building new data integration pipelines and adding new data to our data lakes and warehouses while continuously optimizing them.
- Work with internal team members and stakeholders to scope out business requirements and ensure data deliverables are met.
- Champion coding standards and best practices by participating in code reviews and improving internal tools and build processes.
- Ensure the security and stability of infrastructure in a multi-cloud environment.
- Collaborate with Analytics engineers to ensure data integrity and quality of data deliverables.
Requirements
- Degree in a quantitative field, such as computer science, statistics, mathematics, engineering, data science, or equivalent experience.
- A minimum of 5+ years of experience in building and optimizing data pipelines with Python.
- Experience writing complex SQL queries to analyze data.
- Familiarity with window functions and nested subqueries.
- Commendable experience with at least one cloud service platform (GCP and AWS preferred).
- Experience with data at scale using Apache Spark, Beam or a similar framework.
- Familiar with data streaming architectures using technologies like Pub/Sub and Apache Kafka.
- Willingness to learn about new tech stacks, big data technologies, and data pipelining architectures.
Benefits
- medical, dental, vision, prescription drug coverage
- unlimited paid time off (PTO)
- adoption or surrogate assistance
- donation matching
- tuition reimbursement
- basic life insurance
- basic accidental death & dismemberment
- supplemental life insurance
- supplemental accident insurance
- commuter benefits
- short term and long term disability
- health savings and flexible spending accounts
- family care benefits
- a generous 401K savings plan with a company match program
- 10-12 paid holidays annually
- generous paid parental leave (birthing and non-birthing parents)
- voluntary benefits such as pet insurance, accident, critical and hospital indemnity health insurance coverage, life and disability insurance
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Senior Data Engineer optimizing and industrializing data pipelines for AI products, ensuring data quality and performance across the lifecycle. Collaboration with cross - functional teams is crucial for this role.
Senior Data Engineer supporting critical banking insights at Smile. Driving data solutions and reporting in a collaborative environment across Brussels' financial sector.
Data Engineer I responsible for supporting AI solutions in Consumer applications at Bank of America. Involved in Hadoop ecosystem, big data technologies, and ensuring system stability.
Senior Data Architect defining comprehensive data strategy and architecture for AI. Delivering organization’s data vision and ensuring governance and technical oversight of enterprise data architecture.
Data Engineer at Booz Allen utilizing data to impact critical missions like fraud detection and cancer research. Collaborating with analysts and developers on advanced technology solutions.
Technical Product Manager for Data Engineering at Betclic. Owning product roadmaps, driving data infrastructure evolution, and ensuring alignment across engineering teams.
Senior Data Engineer maturing strategic data assets and delivering business analytics in a regulated financial environment. Collaborating with stakeholders to advance business data strategy on cloud platforms.
Staff Data Engineer leading scalable data solutions for analytics and reporting at Asurion. Designing data pipelines and ensuring data quality across cloud platforms.
Lead Architect at Travelers shaping enterprise database and data platform solutions. Collaborating across technology and business units to drive digital transformation and modernization efforts.