
AI Platform Engineer - REMOTE **3 OPENINGS**
Steneral Consulting · Remote
Weak hiring record · median 127 days open
- First seen
- 18 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- 76% of this employer's openings are over 60 days old
- No location stated
In its favour
- Posted yesterday
- Still listed on the employer's own board
- Publishes a salary range
REMOTE (ANYWHERE)
LONG TERM CONTRACT
**ROPES ASSESSMENT WILL BE REQUIRED**
AI Platform Engineer
Role summary
Build and operate a production agentic AI platform
orchestration, model gateway, agent registry, retrieval, guardrails, evaluation and observability. You build the layer other engineers build on, and you own its reliability, security and cost.
Core technical skills
- LLM and agent orchestration: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or the Google Agent Development Kit (ADK), with production multi-agent orchestration, state management and retry/fallback design.
- Model serving and gateway: LiteLLM, Portkey, Kong AI Gateway, TrueFoundry, or Vertex AI Model Garden; routing, fallback, rate limiting and token/usage capture. Serving open-weight models (Llama, Mistral, Gemma, Qwen) via vLLM, TGI, Ollama or Vertex endpoints; fine-tuning and adapter techniques (LoRA/QLoRA).
- Retrieval-augmented generation: vector stores (Vertex Vector Search, Pinecone, Weaviate, pgvector, Elasticsearch), embedding models, chunking, hybrid and semantic search, reranking, and grounding-quality evaluation.
- Agent infrastructure: Model Context Protocol (MCP) and tool/function-calling contracts, agent registries, permission enforcement, and the separation of reasoning from acting agents.
- Evaluation and LLMOps: eval harness design with RAGAS, DeepEval, Promptfoo, or OpenAI Evals; offline and online evaluation, regression suites, drift and hallucination detection; experiment tracking with MLflow, LangSmith, Langfuse, Arize Phoenix or Braintrust.
- Guardrails and AI security: NeMo Guardrails, Guardrails AI, Model Armor, Lakera; prompt-injection, jailbreak and data-leakage defense; PII detection and redaction in prompt and response.
- Observability: OpenTelemetry-based tracing for LLM and agent calls, token and latency and cost telemetry, quality-signal monitoring feeding alerting.
- Cloud and runtime: Kubernetes and containers, GCP preferred (GKE, Vertex AI, Cloud Run), infrastructure-as-code (Terraform), CI/CD, and SRE practice for production AI services.
- Languages: strong Python; Go or Java useful for platform services.
Experience
Typically 6+ years in software or platform engineering, with hands-on production ownership of AI or ML infrastructure. Has personally built and operated agentic or LLM systems in production, not only prototyped them.
Skills
- Python
- Go
- Java
- Kubernetes
- GCP
- Terraform
- MLflow
- LangSmith
- Arize Phoenix
- Braintrust
- OpenTelemetry
- Vertex AI
- TrueFoundry
- Kong AI Gateway
- LangChain
- LangGraph
- LlamaIndex
- CrewAI
- AutoGen
- Vertex Vector Search
- Pinecone
- Weaviate
- pgvector
- Elasticsearch
- NeMo Guardrails
- Model Armor
- Lakera
- TGI
- Ollama
- vLLM
- LoRA
- QLoRA
- RAGAS
- DeepEval
- Promptfoo
- OpenAI Evals
- MLflow
- LangSmith
- Langfuse
- Arize Phoenix
- Braintrust
More jobs at Steneral Consulting
All 5,687- Lead Security Operations (SecOps) ManagerSteneral Consulting · Rockleigh, NJ, United States · USD 60–65/hrtoday
- System Integration EngineerSteneral Consulting · Albany, NY, United States · USD 60–65/hrtoday
- C / C++ - UNIX / AIX Developer – Appeals/DisputesSteneral Consulting · Remote · USD 55–60/hrtoday
- Senior Software Engineer (IC2) – Frontend EngineerSteneral Consulting · Fort Mill, SC, United States · USD 45–50/hrtoday
- Systems Engineer (Linux/RHEL)Steneral Consulting · Melbourne, FL, United States · USD 45–50/hrtoday
Similar roles
- SFCC Frontend DeveloperVML/WPP Enterprise Solutions · Mumbai, Indiatoday
- Full Stack .NET DeveloperSequoia Connect · Ciudad de México, CDMX, Mexicotoday
- Specialized Developer- Adv. Python & SAS programmingArtech · Chicago, IL · USD 70–80/hrtoday
- Senior Software Engineer, Operations FoundationsWolt - English · Berlin, Germanytoday
- Senior Software Engineer, GenAI PlatformDeliveroo · London, United Kingdom - Deliverootoday
- AI Software EngineerDeloitte · Haifa, North District, Israeltoday