About the mission
We are looking for a Senior AI Engineer to join our Digital Innovation / AI CoE team. This role involves building and maintaining complex AI services on our AI Platform, utilizing Azure and Kubernetes technologies. The successful candidate will deliver end-to-end AI solutions, manage pipelines, and ensure service quality and observability.
Read the full description
Context
We are building several employee- and customer-facing AI services, serving our customers and employees across the organization. The AI services are built and run on our AI Platform.Your role
We are recruiting a Senior AI Engineer to join the Digital Innovation / AI CoE team for the Build and hypercare phases of some of our most complex AI services. You will work alongside our internal AI Platform Architect, the other Senior AI Engineer (already on board), and the project teams (project manager, business analyst, solution architect), turning our AI projects into running, evaluated and maintainable services.The AI Platform runs on a hybrid operating model: managed Azure services (Azure AI Foundry with the OpenAI model family for LLM and embeddings, Azure AI Search, Azure API Management, Azure AI Content Safety) combined with self-hosted open-source components on AKS (agent orchestration in Python with LangChain, ingestion pipeline), with MLflow on Databricks for evaluation and tracing. The Digital Innovation / AI CoE team owns Infrastructure-as-Code for all application-scoped Azure resources, using Terraform and Azure DevOps pipelines.
What you will deliver
Activities will vary from project to project. Typically you will deliver:the RAG pipeline end-to-end, from retrieval strategy to answer generation;
the ingestion pipeline: connectors to source platforms, chunking, embedding, incremental refresh;
security trimming and ACL propagation;
agent orchestration, prompt templates and guardrails;
the evaluation and tracing setup: offline evaluation sets, retrieval and answer-quality metrics, end-to-end tracing of requests and agent steps;
the Terraform, Helm and Azure DevOps artefacts needed to deploy and operate the service;
Observability and cost control: instrumentation for latency, token consumption and run cost, plus quality regression detection after model or prompt changes;
Hypercare and early production: incident analysis, tuning, runbooks and documentation, and handover of the service to the engineer who will own the Run phase.
What you'll do
- Deliver the RAG pipeline end-to-end, from retrieval strategy to answer generation
- Develop the ingestion pipeline including connectors to source platforms, chunking, embedding, and incremental refresh
- Implement security trimming and ACL propagation
- Manage agent orchestration, prompt templates, and guardrails
- Set up evaluation and tracing including offline evaluation sets and retrieval metrics
- Create Terraform, Helm, and Azure DevOps artifacts for deployment
- Ensure observability and cost control through instrumentation
- Conduct hypercare and early production activities including incident analysis and documentation
What we're looking for
- Extensive experience with Azure DevOps
- Proficient in Azure Kubernetes Service (AKS)
- Experience with Azure OpenAI Service
- Knowledge of LangChain
- Familiarity with LLM / Large Language Models
- Strong Python programming skills
- Experience with Retrieval-Augmented Generation (RAG)
- Proficient in Terraform
- Experience with vector databases
Skills
- Azure DevOps
- Azure Kubernetes Service
- Azure OpenAI Service
- LangChain
- Python
- RAG
- Terraform
- Vector databases