Data Engineer Associate developing and implementing data solutions within PNC's Asset Management Group. Collaborating on technical solutions using PySpark, Hadoop, and SQL for scalable data systems.
About the role
- Senior Data Engineer building robust data systems at knok, enhancing healthcare access through digital technology. Collaborating across teams to provide valuable insights and solutions.
Responsibilities
- Combine raw data from multiple sources into consistent and machine-readable formats,
- Design, build and maintain data systems and ETL pipelines;
- Monitor, test and optimise data flows;
- Analyse large datasets and uncover meaningful trends and insights;
- Evaluate business needs and translate them into data solutions;
- Explore ways to improve data quality, accessibility and reliability;
- Develop and maintain analytical tools and reporting frameworks;
- Collaborate with analysts, product managers and other stakeholders on cross-functional projects;
- Monitor the cost and efficiency of data infrastructure.
Requirements
- Degree in Computer Science, IT or similar (Master’s is a plus);
- Proven experience as a Data Engineer or in a similar role;
- Proficiency in Python (OOP, unit testing, APIs, etc.);
- Solid understanding of ETL processes and data modelling;
- Experience with SQL and orchestration tools (e.g. Airflow);
- Experience with columnar databases (Redshift, BigQuery, Snowflake);
- Experience with version control (e.g. GitHub);
- Experience with dbt and cloud services (AWS, Heroku) is a plus;
- Strong analytical and problem-solving mindset;
- Ability to communicate technical concepts to non-technical stakeholders;
- Excellent time management and task prioritisation;
- Team-oriented, curious and eager to learn.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer at Assembly working on data integration, transformation, and analytics collaboration. Handling cloud services and data quality across data projects with cross - functional teams.
Senior Data Engineer developing scalable data pipelines and collaborating with cross - functional teams at Technis. Technical guidance in a hybrid work environment based in Lausanne, Switzerland.
Data Engineer designing and maintaining data pipelines for CIEE, a philanthropic institution supporting youth development. Collaborating with Data Analysts for data quality and reliability.
Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.
Senior Consultant Data Engineer in a consultancy firm focusing on data engineering and platform development. Collaborating with diverse teams to deliver high - quality data solutions.
Data Engineer at Mobileye building robust data pipelines for data infrastructure. Collaborating with teams to deliver high - quality data solutions for dynamic environments.
Cloud Data Engineer at Shift, focusing on building and operating data pipelines on Azure for Australian SMEs. Collaborating across teams to enhance data integration and quality.
AI Systems & Data Engineer at HyperFi designing Databricks pipelines and managing AI systems. Collaborating on data engineering tasks and optimizing workflows in a flexible tech environment.