Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.
SH
Hybrid Principal Data Engineer – Azure Cloud, PySpark, Databricks, Data Factory
Posted 3 months ago
About the role
- Principal Engineer providing leadership and clean solutions based on Big Data applications at Syneos Health. Engaging with clients and ensuring adherence to best practices in cloud solutions.
Responsibilities
- Provide technical leadership and guidance to teams and clients throughout the solution lifecycle
- Troubleshoot and resolve complex issues related to Cloud based Data Lake and Data Mesh environments
- Stay current with emerging technologies and trends and recommend best practices
- Design, develop, and implement scalable and secure cloud solutions for Big Data Platforms interfacing with API, file, SQL databases
- Architect and optimize data pipelines using distributed cloud computing to ensure that they support high volume / high velocity data streams and are scalable to meet growth expectations
- Develop guidelines and plans for performance tuning of a Big Data /NoSQL environment with underlying impact analysis of distributed jobs to enhance data processing, analytics, and machine learning capabilities
- Implement a mixed batch/near-real time architecture to analyze, index, and publish data for applications
- Develop and implement strategies for data governance, security, and compliance
- Create and maintain comprehensive documentation for solution designs, configurations, and best practices
- Provide training and support to clients and internal teams on solution architecture
- Engage with clients to understand their business needs and deliver tailored cloud solutions
- Conduct presentations, demos, and workshops to showcase Data Lake Capabilities
Requirements
- Bachelor’s degree in computer science, Engineering, or a related field; advanced degree preferred
- Strong experience with Azure Cloud, PySpark, Databricks and Data Factory
- SME in cloud engineering or solution architecture with a focus on Azure and related capabilities
- Demonstrated ability to engage both developers and business partners to achieve target outcomes
- Experience with DevOps and best practices for Coding in a distributed Cloud environment
- Command of Data Movement, Analysis, Modeling best practices
- Excellent written and verbal communications;
- Solid written and oral presentation skills
- Excellent problem-solving skills, strong communication abilities, and the ability to work collaboratively in a team environment
- Demonstrated ability to define business use cases and measure / communicate proposed project benefits
Benefits
- Career development and progression
- Supportive and engaged line management
- Technical and therapeutic area training
- Peer recognition
- Total rewards program
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer focused on creating a data platform for automated cyber insurance. Collaborating with stakeholders to deliver data processing capabilities and governance.
Data Engineer building and maintaining data platform solutions for clients at Dignify. Designing, developing, and optimising data models and pipelines with a focus on Google BigQuery.
Data Engineer designing and developing data solutions using AI and machine learning for marketing applications. Collaborating in teams to create impactful data - driven solutions for clients across various industries.
Senior Data Engineer developing scalable data solutions for electric vehicle market at Kempower. Collaborating with cross - functional teams to enhance data engineering processes.
Data Engineer responsible for developing research analytic data infrastructure at Sutter Health. Involves managing data quality, pipelines, and compliance with healthcare regulations.
Senior Data Engineer designing impactful data solutions for clients at Simple Machines. Collaborating with engineers to build data platforms and pipelines in a hybrid workplace.
Journeyman Data Engineer at Leidos supporting DoD enterprise data and analytics. Develop and maintain data pipelines and data models with a focus on national security outcomes.
Data Engineer responsible for designing and implementing data pipelines at United Community. Collaborating across teams to support data warehouse and maintenance of data products.
Senior Data Engineer at Corient designing and maintaining data pipelines for wealth management. Overseeing sprint planning and supporting cross - functional data initiatives to ensure data integrity.