Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Responsibilities
Build and maintain scalable data pipelines (batch and streaming) using tools like Databricks, Spark, Kafka, and AWS services
Design, develop, and optimize ETL/ELT workflows using DBT, PySpark, SQL, and tools like Fivetran
Partner closely with marketing and growth teams to enable data use cases such as segmentation, campaign targeting, and lifecycle analytics
Develop and maintain reverse ETL pipelines to sync data from the warehouse to tools like Salesforce, HubSpot, Braze, and other downstream systems
Create and manage curated datasets to support analytics, reporting, and go-to-market initiatives
Build and maintain dashboards and reporting layers to support marketing and business performance tracking
Support AI/ML and agent-based applications by preparing and serving high-quality datasets for RAG pipelines and MCP (Model Context Protocol) integrations
Monitor pipeline performance, troubleshoot issues, and ensure high data reliability and quality
Implement data quality checks, validations, and alerting mechanisms across both ingestion and activation layers
Collaborate with cross-functional teams to define data contracts and ensure consistency across systems
Requirements
6+ years of experience in data engineering or a related field
Strong hands-on experience with Databricks, AWS (S3, Glue, Athena, EMR, etc.), and Kafka
Proficiency in Python (PySpark) and SQL for large-scale data processing
Experience building and maintaining ETL/ELT pipelines (DBT/Airflow or similar experience preferred)
Experience with data ingestion tools such as Fivetran (or similar)
Familiarity with reverse ETL / data activation workflows and syncing data to tools like Salesforce, HubSpot, Braze
Exposure to or experience with AI/ML data pipelines, including RAG architectures, vector databases, or embeddings workflows
Familiarity with agent-based systems, MCP integrations, or LLM-powered applications is a strong plus
Experience working with marketing, Product or growth teams on data use cases (segmentation, attribution, campaign analytics, etc.)
Understanding of data modeling and working with large-scale datasets (batch and streaming)
Experience creating dashboards and supporting reporting workflows (BI tools) for both internal and external audiences
Strong problem-solving skills and ability to debug production data issues
Strong communication skills and ability to work collaboratively across teams
Benefits
Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions
Flexible PTO with U.S. holidays observed and a week shutdown in December to rest and recharge*
A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*
12 weeks of paid parental leave in the US*
401k program, 3% match - vested immediately!*
$500 work-from-home stipend to be used up to a year of your start date*
$600 technology stipend to support a portion of our hybrid/remote team's cell phone and internet expenses*
$1,200 per year Health & Wellness Allowance to support your personal goals*
The chance to collaborate with a team at the forefront of AI research
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.
Data Architect leading design and governance of high - quality data architectures for clients. Collaborating with engineering teams and stakeholders to transform business challenges into scalable data solutions.
Data Engineer supporting vehicle buying and selling solutions through integration pipelines. Collaborating with teams to build digital vehicle platforms and optimize data processes in São Paulo.
Senior Advanced Data Engineer designing and optimizing data architecture for Honeywell. Collaborating with cross - functional teams to drive data - driven decision - making and operational efficiency.
Senior Data Engineer building and operating data platforms at bsport for analytics and AI/ML. Collaborating with Data team to enrich data layers and maintain platform observability.
Principal HR Data Engineer specializing in Microsoft Azure and Databricks Lakehouse platforms. Responsible for designing, implementing, and maintaining scalable data pipelines and architectures for analytics.