Associate Data Scientist designing and evaluating LLM-based applications for Manulife. Collaborating on AI initiatives and gaining experience in a supportive environment.
Responsibilities
Design and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfaces.
Conduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniques.
Build and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methods.
Develop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholders.
Integrate and test LLMs using OpenAI APIs, Databricks, and Azure AI Services.
Collaborate on the development of fine-tuning and pre-training pipelines for domain-specific use cases.
Work with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilities.
Participate in code reviews, documentation, and agile development cycles with the engineering team.
Requirements
Minimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related roles.
Strong programming skills in Python and SQL; experience with JavaScript is a plus.
Bachelor’s or master’s degree in computer science, Data Science, AI, or a related field.
Hands-on experience with LLM evaluation, bias detection, or alignment research (preferred).
Proficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus).
Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysis.
Experience with cloud platforms such as Microsoft Azure and Databricks.
Knowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISS.
Strong analytical thinking, attention to detail, and a passion for building responsible AI systems.
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension)
global share ownership plan with employer matching contributions
financial education and counseling resources
generous paid time off program including holidays, vacation, personal, and sick days
Director of Data Science leading personalization, recommendation systems, and GenAI chatbot development at Gartner. Managing teams and strategic AI initiatives for enhanced client experiences.
Data Scientist III performing analytics for fraud client experience at Truist. Leveraging data science to improve business outcomes and minimize risk in financial services.
Data Scientist developing analytics and technology platforms to improve health care at CVS Health. Collaborating with cross - functional teams to deliver powerful solutions focusing on automation and efficiency.
Data Scientist supporting national security initiatives through data analysis and quality assurance. Working with complex datasets to ensure accuracy and drive meaningful insights.
Senior Data Scientist designing and leading projects to enhance machine learning classifiers for cancer detection. Collaborating with cross - functional teams in a healthcare company focused on early cancer detection.
Placement Data Science Engineer at Medialab building data software and infrastructure for media advertising. Working on Python tools, automated pipelines, and AI solutions in a hybrid role based in London.
Data Scientist specializing in structured and unstructured data analysis and ML solutions for predictive analytics and NLP. Join a fast - paced team in Hyderabad, India.
Data Scientist at Capital One leading machine learning initiatives to unlock customer behavior insights. Collaborating with product teams to enhance digital experiences across a vast dataset.
As a Data Scientist at Capital One, collaborate with cross - functional teams on AI/ML technologies. Drive innovation using big data, impacting customer financial experiences.
Lead Data Scientist focused on Reinforcement Learning algorithms at Fractal Analytics. Leading teams delivering scalable machine learning models in a fast - paced environment.