Prompt Engineer refining AI tools for performance and reliability in a mortgage services company. Analyzing large datasets and collaborating on AI behavior improvements.
Responsibilities
Test and refine prompts to improve the accuracy, clarity, and consistency of AI generated responses.
Run AI model evaluations to identify errors, hallucinations, and output inconsistencies.
Apply analytical reasoning to understand business requirements and translate them into effective prompt structures.
Work with large datasets to analyze AI behavior trends, evaluation results, and performance metrics.
Troubleshoot and fix minor code issues (typically in Python) when workflows or automation break.
Use Git for version control, prompt management, and maintaining clean change history.
Review task instructions and ensure prompts align with expected business rules.
Monitor AI agent behavior to ensure performance targets and quality standards are met.
Document prompt variations, test results, data findings, and recommended improvements.
Requirements
Associate or bachelor’s degree in Business, Data Science, AI, Computer Science, or a related field
Basic experience with Python, data manipulation, and scripting to write or debug code as necessary
Experience with Git or similar version control tools
Ability to work with large structured and unstructured datasets
Familiarity with generative AI tools (ChatGPT, Claude, Gemini, etc.) is required.
Excellent written communication skills, especially when documenting findings or prompt adjustments.
Ingénieur Automatisme responsable de la conformité des systèmes automatisés chez Knauf. Mission de conception, développement et maintenance de solutions industrielles.
Project Engineer overseeing the efficient delivery of capital programmes across Anglian Water's assets. Collaborating with various teams to ensure project compliance and stakeholder engagement.
Senior Water Resources Engineer joining Calgary team to support hydrologic analysis and hydraulic design. Leading project teams and ensuring project milestones are met with technical expertise.
Building Automation Facilities Engineer II overseeing the Enterprise BAS systems at Medtronic. Providing technical oversight, managing projects, and facilitating system improvements in healthcare technology.
SaaS Engineer maintaining the SynaptiQ platform, providing first - level technical support and contributing to product enhancements. Collaborating with clients and development teams to improve service delivery.
System/Requirements Engineer converting internal and customer requirements into specifications and design architecture for automotive safety products at Veoneer.
Requirements Engineer at Deutsche Bank translating complex regulatory and business requirements into clear reporting specifications. Collaborating with various stakeholders to enhance regulatory reporting solutions.
Process Safety Engineer at ERM developing implementing and maintaining Process Safety Management programs. Ensuring compliance and reducing operational risk while collaborating with operations, engineering, and leadership.
PMO Manufacturing Network Project Engineer at 3M leading and supporting network projects across multi - disciplinary teams. Collaborating on project costs, schedules, and compliance responsibilities, contributing to innovative solutions.
Electrical Project Engineer providing project management and engineering support for refinery operations at Marathon Petroleum in North Dakota. Overseeing multiple projects focused on optimizing operating units.