Data Engineer Associate developing and implementing data solutions within PNC's Asset Management Group. Collaborating on technical solutions using PySpark, Hadoop, and SQL for scalable data systems.
About the role
- Data Engineer designing and building scalable and reliable data pipelines for Novibet. Collaborating across teams to understand data needs and implement robust solutions in a dynamic environment.
Responsibilities
- Design, and build scalable and reliable batch and streaming data pipelines using Python and Spark
- Advocate for software architecture patterns, efficient data processing, modern data integration and solid data modeling
- Create and optimize data models and schemas to facilitate efficient querying and reporting
- Collaborate closely with various teams to understand data needs and implement robust solutions
- Establish data governance policies to maintain data quality and consistency across the organization
- Ensure data integrity and optimized storing of data
- Set up monitoring and alerting systems to proactively identify and address data pipeline issues, ensuring high availability and reliability
Requirements
- University and/or Postgraduate Degree in a relevant field
- Minimum 2 years of work experience in a relevant role
- Strong knowledge of Python and SQL
- Strong knowledge of data modeling and database design principles
- Knowledge of the best practices in data quality and quality engineering
- Knowledge of one cloud platform Azure, AWS or GCP
- Experience with deployment tools (Github Actions, Azure DevOps etc)
- Ability to collaborate on projects and work independently when necessary
- Strong interpersonal skills and a passion for mentoring and coaching
- Working proficiency and communication skills in verbal and written English
Benefits
- 💰Competitive Compensation: Attractive salary and bonus scheme
- 🧑⚕️Health insurance: Group health & medical insurance package
- 💻Top-Notch Equipment: All the tools you need for your role
- 🚀Career Growth: Focused career development, performance management, and training opportunities
- 🚗Alternative Transportation: Shuttle buses & Carpooling options
- 🌍Inclusive Environment: A welcoming, international, and multicultural team
- 🎉Engaging Activities: Exciting events, sports, and team-building activities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer at Assembly working on data integration, transformation, and analytics collaboration. Handling cloud services and data quality across data projects with cross - functional teams.
Senior Data Engineer developing scalable data pipelines and collaborating with cross - functional teams at Technis. Technical guidance in a hybrid work environment based in Lausanne, Switzerland.
Data Engineer designing and maintaining data pipelines for CIEE, a philanthropic institution supporting youth development. Collaborating with Data Analysts for data quality and reliability.
Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.
Senior Consultant Data Engineer in a consultancy firm focusing on data engineering and platform development. Collaborating with diverse teams to deliver high - quality data solutions.
Data Engineer at Mobileye building robust data pipelines for data infrastructure. Collaborating with teams to deliver high - quality data solutions for dynamic environments.
Cloud Data Engineer at Shift, focusing on building and operating data pipelines on Azure for Australian SMEs. Collaborating across teams to enhance data integration and quality.
AI Systems & Data Engineer at HyperFi designing Databricks pipelines and managing AI systems. Collaborating on data engineering tasks and optimizing workflows in a flexible tech environment.