Senior Data Engineer (AWS) with expertise in Python and data services. Working on enterprise - scale data processing and analytics initiatives in a hybrid model.
SH
Hybrid Principal Data Engineer – Azure Cloud, PySpark, Databricks, Data Factory
Posted 37 minutes ago
About the role
- Principal Engineer providing leadership and clean solutions based on Big Data applications at Syneos Health. Engaging with clients and ensuring adherence to best practices in cloud solutions.
Responsibilities
- Provide technical leadership and guidance to teams and clients throughout the solution lifecycle
- Troubleshoot and resolve complex issues related to Cloud based Data Lake and Data Mesh environments
- Stay current with emerging technologies and trends and recommend best practices
- Design, develop, and implement scalable and secure cloud solutions for Big Data Platforms interfacing with API, file, SQL databases
- Architect and optimize data pipelines using distributed cloud computing to ensure that they support high volume / high velocity data streams and are scalable to meet growth expectations
- Develop guidelines and plans for performance tuning of a Big Data /NoSQL environment with underlying impact analysis of distributed jobs to enhance data processing, analytics, and machine learning capabilities
- Implement a mixed batch/near-real time architecture to analyze, index, and publish data for applications
- Develop and implement strategies for data governance, security, and compliance
- Create and maintain comprehensive documentation for solution designs, configurations, and best practices
- Provide training and support to clients and internal teams on solution architecture
- Engage with clients to understand their business needs and deliver tailored cloud solutions
- Conduct presentations, demos, and workshops to showcase Data Lake Capabilities
Requirements
- Bachelor’s degree in computer science, Engineering, or a related field; advanced degree preferred
- Strong experience with Azure Cloud, PySpark, Databricks and Data Factory
- SME in cloud engineering or solution architecture with a focus on Azure and related capabilities
- Demonstrated ability to engage both developers and business partners to achieve target outcomes
- Experience with DevOps and best practices for Coding in a distributed Cloud environment
- Command of Data Movement, Analysis, Modeling best practices
- Excellent written and verbal communications;
- Solid written and oral presentation skills
- Excellent problem-solving skills, strong communication abilities, and the ability to work collaboratively in a team environment
- Demonstrated ability to define business use cases and measure / communicate proposed project benefits
Benefits
- Career development and progression
- Supportive and engaged line management
- Technical and therapeutic area training
- Peer recognition
- Total rewards program
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer overseeing Data Warehouse and Data Architecture at a leading fintech client. Driving scalability and supporting data needs across multiple markets.
Senior Data Engineer / Data Architect at Node.Digital focusing on designing data architectures and managing pipelines. Collaborating across teams to support enterprise application delivery.
Data Engineering Lead responsible for data pipeline design and optimization at Mars. Leading a talented team to drive impactful data solutions across North America.
Data Engineering Developer intern participating in secure data flow creation at Intact. Collaborating on data engineering using Python and cloud technologies for an enterprise data platform.
Data Engineer responsible for building and maintaining data transformation pipelines at OnePay. Collaborating across teams in a mission - driven fintech environment.
Senior Developer within Enterprise Data Management at LPL Financial. Responsible for supporting data management projects and collaborating with business partners and developers.
Lead Data Engineer at Capital One solving complex business problems with data and emerging technologies. Collaborating across Agile teams to deliver cloud - based technical solutions.
Join Luminor as a Mid/Senior Data Engineer focusing on data engineering within risk and finance reporting. Design and optimize data systems supporting evolving regulatory requirements in a dynamic banking environment.
Join Luminor as a Mid/Senior Data Engineer focusing on data engineering within risk and finance reporting. Collaborate to design scalable data architectures and support regulatory requirements while enhancing data integration processes.