Senior Data Engineer developing data pipelines and infrastructure on Google Cloud Platform for WorkWhile's staffing marketplace. Collaborating with Data Science and Engineering teams to enhance data quality and availability.
Responsibilities
Build and optimize data pipelines that ingest, transform, and model data from PostgreSQL, Amplitude, and external sources into BigQuery
Own BigQuery data warehouse architecture: dataset organization, table design, partitioning, clustering, and query performance optimization
Work to improve Ops ML platform capabilities and processes, partnering with the Data Science team to support efficient and reliable ML training and pipelines
Work on reverse ETL workflows and API integrations that push model predictions back into production systems
Support analytics by ensuring clean, performant datasets are available for self-serve reporting
Collaborate with Engineering on Terraform-managed GCP infrastructure
Optimize Cloud Tasks and Cloud Scheduler configurations for data refresh jobs and materialized view maintenance
Requirements
Bachelor’s degree in Computer Science, Data Engineering, Mathematics, or equivalent experience
5+ years in data engineering or data platform engineering
Experience with Dagster or similar orchestration tools (Airflow, Prefect)
Expertise in SQL, with the ability to write and optimize complex analytical queries across BigQuery and PostgreSQL
Proficiency building data pipelines in Python
Experience maintaining data warehouses on BigQuery, Snowflake, or Redshift
Hands-on experience with Google Cloud Platform services
Familiarity with ML workflows and the ability to collaborate with Data Scientists on feature engineering, training pipelines, and model serving
Experience with infrastructure-as-code (Terraform) and containerized deployments (Docker, ECS, Cloud Run, Kubernetes, etc.)
Proficiency with data quality frameworks, monitoring, and observability tooling
Strong collaboration skills and a track record of partnering effectively with Data Science and Product Engineering teams
Passion for building reliable, well-tested data systems - you care about code quality (linting, type checking, CI) as much as pipeline uptime.
Benefits
Remote-friendly work culture with office hubs in SF, NY, Seattle & Toronto
Senior Data Engineer developing high - impact data solutions in a collaborative financial team. Integrating data systems and ensuring performance with innovative technologies.
Data Engineer developing data platforms for a consulting firm focused on quality solutions. Collaborating within a small team to deliver robust infrastructure and systems.
Senior Data Engineer designing and maintaining data pipelines within a fast - growing social impact startup. Collaborate cross - functionally to enhance products and analytics capabilities.
Senior Associate in data engineering at PwC focusing on designing robust data solutions. Leading complex data pipeline projects and collaborating with cross - functional teams to support automation and analytics.
Data Engineering & Warehousing Manager overseeing data engineering and warehousing operations at Hastings Insurance. Leading pipelines, platforms, and technical teams for enterprise data insights.
Senior Data Engineer delivering scalable data solutions in data engineering team at fintech startup. Building and maintaining data pipelines, collaborating with cross - functional teams for accurate data delivery.
Software Engineer contributing to Machine Learning initiatives and data infrastructure at AKASA. Working in a hybrid setup between South San Francisco and NYC.
Senior Enterprise Data Architect at Fresenius Kabi shaping data governance and architecture strategies across the enterprise for data - driven decision - making.
Database Engineer I focused on acquisition and integration of data into Data Lake. Responsible for management of databases and leading company’s data strategy.
Data Engineer at Logcomex, developing robust data pipelines and ensuring data quality for trade solutions. Collaborating with various teams to optimize data governance and performance.