AI Governance Engineer managing technical governance of generative AI tools across the enterprise. Bridging software engineering, security, and compliance for effective AI integration.
Responsibilities
Design, implement, and maintain the technical governance framework for all GenAI/LLM tools and integrations.
Evaluate, approve, onboard, monitor, and retire third-party and open-source AI tools (LLMs, vector databases, agents, orchestration platforms, etc.).
Build and operate usage monitoring, cost tracking, compliance dashboards, and automated audit trails.
Create lightweight, developer-friendly processes for tool requests, risk assessments, exceptions, and approvals.
Partner with Legal, Security, Compliance, Procurement, and Engineering to translate policies into enforceable technical controls.
Identify and mitigate AI-specific risks: prompt injection, data leakage, model misuse, training-data exposure, etc.
Develop and deliver training, playbooks, workshops, and documentation that get used.
Stay ahead of evolving regulations, new attack vectors, and model capabilities.
Continuously optimize the balance between innovation velocity, risk, cost, and compliance.
Requirements
Strong software engineering background with deep understanding of development lifecycles, CI/CD, APIs, integrations, and versioning.
Hands-on knowledge of modern GenAI/ML stack: LLMs, embeddings, vector stores, RAG, model endpoints, agents, and orchestration tools.
Solid experience with at least one major cloud provider (Azure or AWS) – especially AI/ML services, networking, IAM, and governance features.
Proven ability to interpret security, privacy, data-classification, and responsible AI policies and turn them into practical technical controls.
Strong grasp of AI-specific security risks (prompt injection, jailbreaks, data exfiltration, inversion attacks, etc.) and mitigation patterns.
Experience implementing identity & access governance (RBAC/ABAC, least privilege, audit logging) for AI systems.
Demonstrated skill in cross-functional collaboration and communicating complex technical and risk concepts to non-technical stakeholders.
Comfort in building processes, dashboards, and lightweight automation from scratch.
Full - stack software engineer developing features for Hercules’ AI applications. Collaborating on software design, coding, and release management for innovative technologies.
Senior Engineer joining Product Engineering team at Iress, focusing on building and evolving critical financial systems. Collaborating with a high - performing backend engineering team to enhance software performance and reliability.
Engineer enhancing productivity and reliability for DevOps at AI startup in Japan. Focused on automation, observability, and integrating AI into development workflows.
Software Engineer specializing in React Native for Front’s B2B customer operations platform. Enhancing mobile app performance and collaborating with cross - functional teams.
Intermediate Full Stack Engineer collaborating with cross - functional teams at Solink. Engaging in building high - impact technology and driving software best practices.
Software Engineer developing and enhancing Salesforce Sales/Health Cloud functionality with a focus on health services. Collaborating with cross - functional teams to support and integrate Salesforce solutions within primary care.
Software Engineer developing scalable software applications for variable data printing platform. Collaborating with agile teams in all aspects of the software build process.
Software Engineer developing space simulation software for HII's Mission Technologies. Collaborating on space combat power and multi - domain simulation software development.
Senior Software Engineer developing and evolving data - driven products and AI applications for Red Hat. Collaborating with teams to deliver high - quality data solutions and implement software best practices.
Principal Software Engineer working on OpenShift Virtualization projects for a globally distributed team at Red Hat. Collaborating with engineering teams and open - source communities to deliver high - quality software.