Hybrid Prompt Engineer – LLM Specialist, AVP

Posted last week

Apply now

About the role

  • design, optimize, and implement prompts, tools, and guardrails to support robust, compliant, and efficient AI solutions
  • contribute to the development of retrieval-augmented generation (RAG) systems and fine-tune large language models (LLMs)
  • develop and refine prompt architectures tailored to financial use cases, ensuring regulatory compliance and minimizing operational risk
  • conduct A/B testing and automated evaluations using golden datasets representative of banking and financial scenarios
  • collaborate with compliance and risk teams to validate prompt effectiveness and safety
  • design advanced retrieval systems (chunking, embeddings, rerankers) for secure and accurate information access in regulated environments
  • implement policy-aware filters and automated redaction mechanisms for PII/PCI, adhering to FINRA, SEC, and GDPR standards
  • work closely with cybersecurity and legal teams to ensure data protection and auditability
  • fine-tune LLMs for financial applications, optimizing for performance, compliance, and cost-effectiveness
  • implement robust guardrails to mitigate hallucinations and ensure outputs are defensible and grounded in verified sources
  • monitor and report on model performance, integrating feedback from end-users and compliance teams

Requirements

  • 3+ years of hands-on experience with LLMs/NLP, including Python and modern machine learning tooling
  • Proven track record in deploying AI solutions within highly regulated environments
  • Strong understanding of data privacy, security, and ethical AI practices
  • In-depth familiarity with banking terminology, document types, and regulatory requirements (e.g., BSA/AML, PCI DSS).
  • Experience building defensible AI systems with grounding, citations, and dynamic guardrails
  • Demonstrated ability to develop policy-aware retrieval and automated PII/PCI redaction patterns
  • Experience collaborating with compliance, risk, and audit teams in financial institutions

Benefits

  • comprehensive health and wellness benefits
  • retirement plans
  • educational assistance and training programs
  • income replacement for qualified employees with disabilities
  • paid maternity and parental bonding leave
  • paid vacation
  • sick days
  • holidays

Job title

Prompt Engineer – LLM Specialist, AVP

Job type

Experience level

Lead

Salary

$108,000 - $146,000 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job