Program Manager leading enterprise - wide data migration efforts for Boeing's transition to modern data platforms. Overseeing complex processes to ensure secure and effective migrations across multiple systems.
About the role
- Data Engineer specializing in PySpark and Snowflake at 3Core Systems, Inc. Focused on building and optimizing data pipelines on AWS and Snowflake.
Responsibilities
- Design, build, and maintain high-performance ETL/ELT pipelines using PySpark on AWS.
- Develop automated ingestion, transformation, and validation workflows for large structured and semi-structured datasets.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Build and manage data pipelines that load into Snowflake using PySpark, Snowpipe, and external stages.
- Create and maintain Snowflake objects including: Databases, schemas, tables, Virtual warehouses, Internal/external stages, file formats, Streams, Tasks, Dynamic Tables.
- Implement Snowpipe for continuous or incremental ingestion.
- Apply Snowflake optimization techniques (clustering, micro-partitioning, query profiling, etc.).
- Work with AWS services such as S3, IAM, Lambda, CloudWatch, and EventBridge for data ingestion and automation.
- Implement event-driven ingestion using SNS/SQS or other AWS-native triggers.
Requirements
- 5+ years of experience with PySpark, including performance tuning, DataFrames, Spark SQL, and distributed data processing.
- 3+ years of hands-on experience with Snowflake, including Snowpipe, stages, tasks, streams, and performance optimization.
- Strong experience building data pipelines on AWS.
- Strong SQL skills with the ability to write optimized, complex queries.
- Solid understanding of ETL/ELT concepts, data warehousing, and modern data architecture.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer responsible for developing data products for Disney's immersive digital experiences. Collaborating with teams to ensure data quality and operational efficiency in a fast - paced environment.
Senior Data Engineer crafting and developing data products for analytical insights at Zendesk. Collaborating in an Agile environment with a focus on data warehousing and process optimization.
Senior Data Engineer designing and building data warehouse solutions with Snowflake for a fintech company. Collaborating with cross - functional teams to facilitate data insights and analytics.
Data Engineer developing and maintaining data pipelines and applications at EvidenceCare. Collaborating across teams to generate actionable insights from healthcare data for better decision - making.
Data Engineer managing and expanding enterprise business intelligence and data platform. Focusing on Tableau development and administration with a strong engineering background.
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.