
Lead Software Engineer- AI Agent Developer
Alumni · Bengaluru, Karnataka, India
Strong hiring record · median 1 days open
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
Join us to advance your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team.
We’re seeking a Lead Software Engineer (AI/ML) to build and operate scalable, low-latency autonomous agent systems in production. You’ll lead the design and delivery of agentic platforms that reliably serve 100K+ customers, combining strong software engineering fundamentals with deep hands-on expertise in foundation models and LLM-powered architectures.
Job responsibilities
- Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime).
- Design agentic architectures (planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution).
- Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
- Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching).
- Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis).
- Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response).
- Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency).
- Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence).
Required qualifications, capabilities and skills
- 8+ years of software engineering experience, including leading design and delivery of large-scale production systems.
- Demonstrated experience building and operating LLM/agentic systems in production with strict latency and reliability requirements.
- Strong understanding of foundation models, LLM behavior, prompting strategies, and tool-augmented generation patterns.
- Strong understanding of Knowledge graph (Neo4J preferred), Open Knowledge formats (OKFs)
- Proven expertise in context and memory engineering, model evaluation methodologies, and quality measurement.
- Experience implementing observability for distributed systems and AI applications (tracing/metrics/logs, dashboards, alerting, on-call readiness).
- Strong programming skills in one or more of: Python, Java, Go, or TypeScript; plus strong API and distributed-systems fundamentals.
- Familiarity with retrieval systems, vector databases, and hybrid search patterns.
Preferred qualifications, capabilities and skills
- Agentic AI architecture: planner/executor patterns, multi-agent orchestration, tool-use design, retrieval workflows
- LLM/foundation model expertise: prompting strategies, tool-augmented generation, model behavior understanding
- Context & memory engineering: short/long-term memory, summarization, retrieval grounding, caching strategies
- Knowledge graphs: Neo4J (preferred), Open Knowledge Formats (OKFs)
- Retrieval systems: vector databases, hybrid search patterns
Skills
- LLM
- Neo4j
- Python
- Java
- Go
- TypeScript
- Vector Databases
More jobs at Alumni
All 11- Director of Software Engineering - Machine Learning/AIAlumni · GLASGOW, LANARKSHIRE, United Kingdomtoday
- Senior Lead Software Engineer - Java / AWMAlumni · LONDON, United Kingdomtoday
- Technical Project Manager - Sr. Lead Software EngineerAlumni · Jersey City, NJ, United States · USD 175,750–260,000yesterday
- Sr Lead Software Engineer - Java, Python, AI/MLAlumni · Jersey City, NJ, United States · USD 175,750–260,000yesterday
- Principal Software Engineer - Java/Python, Data Platforms, CloudAlumni · Bengaluru, Karnataka, Indiayesterday
Similar roles
- Hiring || Salesforce Developer - New Delhi2coms · New Delhi, Delhi, Indiajust now
- Senior OT Security Platform Engineer - L3Varite India Private · Noida, UPjust now
- AI EngineerVarite India Private · Bangalore, KAjust now
- Sr. Manager Software EngineeringVertiv · Pune, Indiatoday
- Sr. Principal Engineer Software Engineering XIVVertiv · Pune, Indiatoday
- Fullstack Software EngineerFord Model-e U.S. · Indiatoday