Senior Data Engineer designing and building automated data platforms and pipelines for Coody clients. Delivering efficient solutions in a consultant role across exciting industries and companies.
SH
Hybrid Principal Data Engineer – Azure Cloud, PySpark, Databricks, Data Factory
Posted 2 months ago
About the role
- Principal Engineer providing leadership and clean solutions based on Big Data applications at Syneos Health. Engaging with clients and ensuring adherence to best practices in cloud solutions.
Responsibilities
- Provide technical leadership and guidance to teams and clients throughout the solution lifecycle
- Troubleshoot and resolve complex issues related to Cloud based Data Lake and Data Mesh environments
- Stay current with emerging technologies and trends and recommend best practices
- Design, develop, and implement scalable and secure cloud solutions for Big Data Platforms interfacing with API, file, SQL databases
- Architect and optimize data pipelines using distributed cloud computing to ensure that they support high volume / high velocity data streams and are scalable to meet growth expectations
- Develop guidelines and plans for performance tuning of a Big Data /NoSQL environment with underlying impact analysis of distributed jobs to enhance data processing, analytics, and machine learning capabilities
- Implement a mixed batch/near-real time architecture to analyze, index, and publish data for applications
- Develop and implement strategies for data governance, security, and compliance
- Create and maintain comprehensive documentation for solution designs, configurations, and best practices
- Provide training and support to clients and internal teams on solution architecture
- Engage with clients to understand their business needs and deliver tailored cloud solutions
- Conduct presentations, demos, and workshops to showcase Data Lake Capabilities
Requirements
- Bachelor’s degree in computer science, Engineering, or a related field; advanced degree preferred
- Strong experience with Azure Cloud, PySpark, Databricks and Data Factory
- SME in cloud engineering or solution architecture with a focus on Azure and related capabilities
- Demonstrated ability to engage both developers and business partners to achieve target outcomes
- Experience with DevOps and best practices for Coding in a distributed Cloud environment
- Command of Data Movement, Analysis, Modeling best practices
- Excellent written and verbal communications;
- Solid written and oral presentation skills
- Excellent problem-solving skills, strong communication abilities, and the ability to work collaboratively in a team environment
- Demonstrated ability to define business use cases and measure / communicate proposed project benefits
Benefits
- Career development and progression
- Supportive and engaged line management
- Technical and therapeutic area training
- Peer recognition
- Total rewards program
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Platform Consultant driving analytics solutions on Databricks for Snap's clients. Leading architecture and delivery while shaping Databricks capability growth within the team.
Data Engineer Associate developing and implementing data solutions within PNC's Asset Management Group. Collaborating on technical solutions using PySpark, Hadoop, and SQL for scalable data systems.
Senior Data Engineer at Assembly working on data integration, transformation, and analytics collaboration. Handling cloud services and data quality across data projects with cross - functional teams.
Senior Data Engineer developing scalable data pipelines and collaborating with cross - functional teams at Technis. Technical guidance in a hybrid work environment based in Lausanne, Switzerland.
Data Engineer designing and maintaining data pipelines for CIEE, a philanthropic institution supporting youth development. Collaborating with Data Analysts for data quality and reliability.
Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
Senior Consultant Data Engineer in a consultancy firm focusing on data engineering and platform development. Collaborating with diverse teams to deliver high - quality data solutions.
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.
Data Engineer at Mobileye building robust data pipelines for data infrastructure. Collaborating with teams to deliver high - quality data solutions for dynamic environments.