Hybrid Senior Backend GenAI Software Engineer

at Protegrity

• Job title: Senior Backend GenAI Software Engineer
• Job type: Full Time
• Experience level: Senior
• Salary: $209,100 - $234,100 per year
• Degree requirement: Bachelor's Degree
• Tech skills: AWS, Azure, Cloud, Docker, Kubernetes, Python
• Location requirements: Hybrid, Palo Alto, United States

About the role

• Senior Backend Software Engineer focusing on designing and maintaining GenAI software solutions at Protegrity. Collaborating with teams to ensure secure and scalable data protection innovations.

Responsibilities

• As a key technical leader, you will collaborate closely with other software engineers, product teams, AI researchers, and security specialists to deliver enterprise-grade software products and features for safe, secure, and private consumption of GenAI.
• Design and develop high-quality, scalable software products supporting our customer’s security, safety, and privacy of GenAI and LLM-based systems with advanced guardrail capabilities.
• Integrate GenAI systems including LLM, VectorDB, RAG pipelines, agents, and guardrails into the delivery of our product features on Kubernetes based architectures.
• Develop state of the art guardrails and systems leveraging agent workflows and tooling to support safety and security of GenAI.
• Develop, test, and maintain robust container based and microservice API architectures.
• Monitor, debug, and troubleshoot production issues.
• Participate in code reviews and contribute to team best practices.
• Stay at the forefront of industry trends in GenAI tooling, cloud-native solutions, and software development practices, applying insights to improve product capabilities.
• Collaborate with AI researchers and product teams to integrate advanced GenAI and LLM capabilities into production-grade software systems.
• Evaluate and integrate open-source tools and third-party platforms to accelerate product development.

Requirements

• 12+ years of experience in backend software engineering with expertise in GenAI and LLM, and a focus on scaling GenAI solutions.
• Expertise developing and maintaining GenAI workflows including fine-tuning LLMs, embedding and vector databases, RAG workflows, and prompt engineering techniques.
• Experience developing and scaling cloud solutions using APIs, containers and microservice architectures with Kubernetes, Docker, Helm, etc.
• Experience with integrating software products using authentication and authorization including cloud IAM, SSO, JWT, oAuth, etc.
• Strong programming skills in Python with experience in cloud environments (e.g., AWS, Google Cloud, Azure).
• Experience with large-scale unstructured data processing, including NLP, computer vision, or multimodal AI applications.
• Familiarity with version control tools, CI/CD pipelines and DevOps practices.
• Solid understanding of software development best practices, including Agile methodologies.

Benefits

• Health Benefits (Health/Dental/Vision)
• Paid Time Off (PTO)
• 401K
• Annual Bonus Incentives
• Short and Long Term Disability