Hybrid Senior Data Scientist – LLM Expert

at Kyndryl

• Job title: Senior Data Scientist – LLM Expert
• Job type: Full Time
• Experience level: Senior
• Salary: Not specified
• Degree requirement: Bachelor's Degree
• Tech skills: Azure, OpenShift, Python, PyTorch
• Location requirements: Hybrid, Madrid, Spain

About the role

• Senior Data Scientist specializing in Large Language Models at Kyndryl's AI Innovation Hub. Leading the design and deployment of transformative AI solutions for forward-thinking enterprises.

Responsibilities

• Design, train, fine-tune, and evaluate large language models and their distilled or specialized variants (SLMs).
• Develop and integrate Generative AI and Agentic AI solutions that combine reasoning, retrieval, and language understanding.
• Implement and optimize RAG (Retrieval-Augmented Generation) pipelines, ensuring precision, traceability, and scalability.
• Collaborate with architects and ML engineers to bring LLM-based solutions into production environments.
• Define and apply robust evaluation frameworks and metrics for alignment, safety, hallucination control, and factual consistency.
• Contribute to the Hub’s innovation roadmap by exploring new models, architectures, and methods for fine-tuning and instruction learning.
• Advise on model optimization, including quantization, distillation, and memory-efficient inference.
• Promote best practices in documentation, traceability, and Responsible AI across all LLM-based initiatives.

Requirements

• 4 + years of experience in AI model development, with at least 2 years focused on LLMs or advanced NLP systems.
• Proven expertise in fine-tuning, instruction tuning, and evaluation of foundation models (GPT, Llama, Claude, Mistral, Gemma, etc.).
• Hands-on experience developing RAG pipelines and LLM-based reasoning architectures.
• Solid understanding of Python and major libraries for LLM and AI development (Transformers, LangChain , LlamaIndex , PEFT, BitsAndBytes , LoRA , Accelerate).
• Experience training or serving models on GPU/TPU environments ( PyTorch , DeepSpeed , vLLM , Ollama ).
• Strong background in vector databases and embedding models.
• Familiarity with multi-agent frameworks and orchestration systems ( CrewAI , AutoGen , LangGraph , Google ADK).
• Knowledge of Responsible AI and evaluation principles — safety, bias mitigation, factual alignment, and model interpretability.
• Experience deploying models in MLOps environments ( MLflow , Vertex AI, Azure ML, OpenShift AI).

Benefits

• Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey.
• Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more.
• Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations.
• Kyndryl invests heavily in you, we want you to succeed so that together, we will all succeed.