Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
About the role
- Senior Data Engineer building data pipelines using emerging technologies for Wavicle Data Solutions. Joining a flexible, digitally connected team focused on cloud, data, and AI solutions.
Responsibilities
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources like Hadoop, Spark, AWS Lambda, etc.
- Experience with AWS Cloud on Data Integration with Apache Spark, EMR, Glue, Kafka, Kinesis and Lambda in S3, Redshift, RDS, and MongoDB/DynamoDB ecosystems.
- Strong real-life experience in Python development, especially in PySpark in AWS Cloud environment.
- Design, develop, test, deploy, maintain and improve data integration pipeline.
- Develop pipeline objects using Apache Spark / Pyspark / Python or Scala.
- Design and develop data pipeline architectures using Hadoop, Spark and related AWS Services.
- Load and performance test data pipelines built using the above-mentioned technologies.
Requirements
- Bachelor or Master's degree in Computer Science, or related field is required.
- 8+ years of hands-on professional work experience with AWS and Python programming, experience with Python frameworks is required
- Hands-on expertise with cloud platforms including AWS and GCP
- Expert level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data.
- Working experience on ETL pipeline implementation using AWS services such as Glue, Lambda, EMR, Shell, S3, SNS, Pyspark, etc. is required.
- Strong knowledge of data warehousing solutions, particularly Amazon Redshift
- Hands-on professional work experience using emerging technologies (Snowflake, Talend, and/or Databricks) is highly desirable.
- Proficiency in DBT for data transformation and modeling
- Experience with automation of data workflows and processes
- Strong problem solving and troubleshooting skills with the ability to exercise mature judgement.
Benefits
- Competitive compensation and bonuses
- Unlimited paid time off
- Health, retirement, and life insurance plans
- Long-term incentive programs
- Meaningful work that blends innovation and purpose
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.