Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
About the role
- Senior Data Engineer building data pipelines using emerging technologies for Wavicle Data Solutions. Joining a flexible, digitally connected team focused on cloud, data, and AI solutions.
Responsibilities
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources like Hadoop, Spark, AWS Lambda, etc.
- Experience with AWS Cloud on Data Integration with Apache Spark, EMR, Glue, Kafka, Kinesis and Lambda in S3, Redshift, RDS, and MongoDB/DynamoDB ecosystems.
- Strong real-life experience in Python development, especially in PySpark in AWS Cloud environment.
- Design, develop, test, deploy, maintain and improve data integration pipeline.
- Develop pipeline objects using Apache Spark / Pyspark / Python or Scala.
- Design and develop data pipeline architectures using Hadoop, Spark and related AWS Services.
- Load and performance test data pipelines built using the above-mentioned technologies.
Requirements
- Bachelor or Master's degree in Computer Science, or related field is required.
- 8+ years of hands-on professional work experience with AWS and Python programming, experience with Python frameworks is required
- Hands-on expertise with cloud platforms including AWS and GCP
- Expert level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data.
- Working experience on ETL pipeline implementation using AWS services such as Glue, Lambda, EMR, Shell, S3, SNS, Pyspark, etc. is required.
- Strong knowledge of data warehousing solutions, particularly Amazon Redshift
- Hands-on professional work experience using emerging technologies (Snowflake, Talend, and/or Databricks) is highly desirable.
- Proficiency in DBT for data transformation and modeling
- Experience with automation of data workflows and processes
- Strong problem solving and troubleshooting skills with the ability to exercise mature judgement.
Benefits
- Competitive compensation and bonuses
- Unlimited paid time off
- Health, retirement, and life insurance plans
- Long-term incentive programs
- Meaningful work that blends innovation and purpose
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.