
Senior AI DevOps Engineer – AI Agents & MCP (Onsite, Islamabad, PKR Salary)
HR POD - Hiring Talent Globally · Islamabad, Pakistan
- Professional Services
- 11–50 employees
- Hor Al Anz, Dubai
Strong hiring record · median 35 days open
- First seen
- 20 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
Requirements
- 9+ years of experience in DevOps, Site Reliability Engineering (SRE), or Platform Engineering, with at least 3 years of hands-on experience managing production Kubernetes environments, GitOps, and Infrastructure as Code (IaC).
- Practical experience deploying AI Agents, LLM infrastructure, or MCP servers in production environments.
- Proven experience deploying, managing, and scaling AI-driven solutions, vector databases, proxy gateways, and Model Context Protocol (MCP) servers in production environments.
- Strong expertise in CI/CD pipelines, GitOps-based deployments, and Kubernetes-hosted services.
- Hands-on experience with Terraform or equivalent IaC tools and cloud infrastructure operations, preferably Azure.
- Proficiency in Python scripting for pipeline tooling, release validation, operational automation, and AI evaluation SDK integration.
- Strong understanding of secrets management, container security, workload isolation, least-privilege access, and dynamic agent sandboxing.
- Experience with monitoring, alerting, and telemetry for delivery pipelines and runtime services using tools such as LangFuse, Phoenix/Arize, OpenTelemetry, Datadog, or Prometheus.
- Experience integrating automated testing and LLM evaluation results into enforceable CI/CD release gates.
- Knowledge of release strategies, including canary, blue/green, and progressive delivery for agent prompt changes and LLM versioning.
- Familiarity with LLM and agent evaluation frameworks such as DeepEval, Ragas, and LangSmith, including benchmark execution in CI.
- Understanding of software supply-chain security, artifact signing, and dependency and security scanning.
- Experience developing reusable CI/CD templates, automated quality and security gates, GitOps deployment definitions, tested rollback procedures, release observability, AI tracing, audit trails, and operational documentation.
- Ability to collaborate with Infrastructure, Agent Runtime, QA Automation, AI Test & Dataset Engineering, and service owners across multiple engineering pods.
Responsibilities
- Deploy, host, scale, and operationalize AI Agent frameworks, vector databases, and Model Context Protocol (MCP) servers across Kubernetes clusters.
- Design and maintain CI/CD pipelines for Python services, agent definitions, prompts, tools, MCP servers, and platform configurations.
- Implement GitOps-based Kubernetes deployments with environment-specific policies, controlled promotion, and reliable rollback mechanisms.
- Integrate automated unit, API, security, and LLM evaluation tests into release gates, covering prompt stability, tool-use accuracy, output safety, and latency and cost regressions.
- Implement secure secrets management, dynamic sandbox isolation for agent execution, and least-privilege deployment identities.
- Instrument pipelines and deployed services for agent-level observability, including token usage, tool invocation tracking, LLM latency, cost monitoring, distributed tracing, and health monitoring.
- Maintain reusable deployment templates for services, agents, and MCP tools, and guide engineering teams on CI/CD practices, release standards, and operational procedures.
Skills
- Model Context Protocol
- Kubernetes
- LLM
- Vector Databases
- Terraform
- Azure
- Python
- Langfuse
- Phoenix
- OpenTelemetry
- Datadog
- Prometheus
- LangSmith
More jobs at HR POD - Hiring Talent Globally
All 13- Software Development Engineer in Test (Hybrid, Lahore, PKR Salary)HR POD - Hiring Talent Globally · Lahore, Pakistantoday
- Senior Data Architect (Onsite, Islamabad, PKR Salary)HR POD - Hiring Talent Globally · Islamabad, Pakistantoday
- Senior Semantic Engineer - Knowledge Graphs (Hybrid, Islamabad)HR POD - Hiring Talent Globally · Islamabad, Pakistantoday
- Power BI Developer (Remote, Anywhere from Pakistan, USD Salary)HR POD - Hiring Talent Globally · Lahore, Pakistan4d ago
- Mulesoft/WSO2 Integration Developer (Remote, Anywhere from Pakistan, USD Salary)HR POD - Hiring Talent Globally · Lahore, Pakistan8d ago
Similar roles
- Senior Technical Support Engineer - SpanishMotive · Pakistanyesterday
- Senior IT Infrastructure Engineer IICareem · Karachi, Pakistanyesterday
- Devops Engineer - AWSNorthBay Solutions · Karachi2d ago
- Technical Support EngineerMotive · Islamabad · Lahore4d ago
- DevOps EngineerClustox · Lahore, Pakistan4d ago