Principal Software Engineer leading infrastructure initiatives for Workday AI Platform. Collaborating with teams to optimize and enhance an AI - focused technology stack.
About the role
- AI Engineer focusing on building production-ready applications and deploying on Azure Databricks. Designing data and AI pipelines while collaborating with teams for scalability and maintainability.
Responsibilities
- Design and build **end-to-end data and AI pipelines** using Azure Databricks.
- Develop robust ETL/ELT workflows using Python (PySpark) and SQL.
- Implement **CI/CD pipelines for Databricks deployments** (jobs, notebooks, workflows).
- Integrate Databricks with Azure services (Data Lake, Blob Storage, Key Vault, Azure OpenAI, Azure Functions, etc.).
- Optimize jobs for performance, cost, and reliability.
- Build reusable, modular code.
- Collaborate with data scientists and platform teams to move models from experimentation to production.
- Implement logging, monitoring, and error handling for production pipelines.
- **Develop and deploy ML and Generative AI models** (LLMs, embeddings, RAG pipelines) for NLP, computer vision, and predictive analytics.
- **Fine-tune LLMs using LoRA/QLoRA and integrate with Azure OpenAI or Hugging Face models.**
- **Implement vector search and retrieval pipelines using FAISS or Azure Cognitive Search.**
- **Ensure responsible AI practices, including bias detection and model governance.**
Requirements
- Azure Databricks (jobs, workflows, clusters, Unity Catalog preferred).
- Python (PySpark-heavy, not just pandas).
- SQL (complex joins, window functions, analytical queries).
- Azure Cloud (ADLS Gen2, ADF, Key Vault, IAM concepts).
- Pipeline orchestration & deployment (CI/CD, environment promotion).
- Azure DevOps.
- **Strong understanding of ML lifecycle and MLOps best practices.**
- **Experience with model deployment using MLflow or similar frameworks.**
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Product Manager with Dell Technologies delivering new AI applications and building product - quality proof - of - concepts. Collaborating with cross - functional teams in a fast - paced, innovative environment.
Lead AI Engineer creating AI - powered solutions with Python and machine learning frameworks. Collaborate with data scientists and engineers to optimize innovative application development.
Lead Engineer designing, building, and deploying AI - enabled solutions at Bauer Media Outdoor. Collaborating with Product Leads to integrate innovative AI technologies and enhance business operations.
AI Engineer Lead at Orica managing and optimizing AI models and datasets while mentoring engineers. Bridging R&D, Engineering, and Data Platforms in a collaborative environment.
AVP - Cloud & GenAI Lead & Architect driving enterprise cloud strategy and leading AI initiatives. Collaborating on AI programs and defining cloud architecture best practices in a leadership role.
Engineering intern contributing to technical projects in the music tech industry. Building production - level systems and gaining exposure to business and industry outcomes.
AI/ML Engineer shaping the future of legal AI at Ironclad, using cutting - edge tools for contract management. Collaborating with product teams to enhance AI capabilities and user experiences.
Lead the AI vision for AEC Construction as a Distinguished AI Architect at Autodesk. Shape how AI transforms construction towards intelligent and autonomous systems.
Senior Developer crafting AI - powered banking solutions with React and backend services for FNBO. Join the GenAI team to innovate in financial services while collaborating with cross - functional teams.