Senior Data Engineer curating and scaling data pipelines for healthcare tech company Arbital Health. Building AI/ML data solutions and collaborating with cross-functional teams.
Responsibilities
Leverage your advanced skills in Python and SQL and with platforms like Databricks and AWS to build highly scalable data pipelines and warehouses
Design and maintain context engineering pipelines (embedding generation, indexing, vector storage) for conversational AI, collaborating with the Senior AI Engineers and Data Scientists.
Develop and deploy scalable AI/ML data pipelines, specializing in data prep/serving for LLMs and RAG systems.
Stay ahead of emerging tech and integrate it into business solutions
Automate data workflows for ingestion, cleansing, quality assurance, enrichment, and aggregation
Ensure data accuracy, integrity, privacy, security, and compliance through automated quality control procedures
Collaborate with an actuarial science team
Contribute to the design, implementation, and overall development of our products
Drive innovation and deliver valuable features for our customers
Requirements
Experienced in data-intensive, full-stack development projects
Experience with data/AI architecture and MLOps
Proven, hands-on experience designing and implementing data-intensive solutions using LLMs, vector databases, embeddings, and context engineering techniques (RAG, summarization).
Able to work entrepreneurially – self-motivated, ambitious, and fast-paced
Able to ship extremely high caliber code and build exceptional products
High level of attention to detail
Ability to perform under minimal supervision with accountability for specific objectives and work in a rapidly changing, ambiguous start-up environment
Passionate about improving and innovating
Startup experience is highly preferred
Our team works hybrid from the San Francisco Bay Area. We will prioritize candidates who are able to work 1-2x per week from our office and we will consider highly qualified remote candidates who are able to travel for in-person collaboration in San Francisco at least one full week per month.
Benefits
Generous equity grants of ISO stock options
We offer an exceptional benefits package with high employer-paid contributions for health, dental, and vision insurance
4% 401(k) match
Flexible PTO, a weeklong winter shutdown, and 10 holidays each year
Occasional travel required - Quarterly team offsites
Lead Data Engineer overseeing engineers and advancing the data platform at American Family Insurance. Creating tools and infrastructure to empower teams across the company.
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.