Applied AI Engineer - Agent
The General Intelligence Company of New York- Location
- New York
- Workplace
- —
- Employment
- Full Time
- Salary
- —
Posted 11mo ago
We’re hiring an Applied AI Engineer to push the boundaries of our Cofounder agent.You’ll own core backend systems and applied
LLM work
advancing agent reliability and autonomy, building evaluation pipelines, and shipping techniques that measurably improve agent performance. This is a hands-on role with high ownership across research-to-production: prototyping, instrumenting, evaluating, and deploying improvements that show up directly in user outcomes.
What You’ll Do
- Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths
- Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)
- Productionize applied LLM techniques: function/tool-calling orchestration, self-reflection, retrieval/RAG, multi-agent handoffs, caching/embedding strategies, and hallucination reduction
- Improve core backend systems: reliable job orchestration, retries/backoff, idempotency, and auditability; scalable memory and context routing; data pipelines across Gmail, Slack, Notion, Linear, Google Workspace, etc.; observability and tracing for agent actions/outcomes
- Partner with product and infra to define success metrics and ship fast, safe iterations
- Write clean, well-tested code; document design decisions and runbooks
What You’ll Bring
- 4+ years backend engineering experience, preferably Python (we care about impact over years)
- Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design; you’ve shipped LLM features to production
- Track record building evaluation harnesses and using them to drive improvements (regression suites, task success metrics, cost/runtime tradeoffs)
- Solid distributed systems fundamentals: concurrency, reliability, performance, data modeling, lifecycle management
- Pragmatic experimentation: hypothesis → prototype → measured improvement → rollout
- Excellent debugging and instrumentation skills; you enjoy finding and fixing edge cases in the wild
Nice To Have
- Experience with agent frameworks, tool orchestration, and memory architectures
- RAG systems in production (chunking, retrieval quality, freshness strategies)
- Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs
- Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization
Why Join Us
- Mission: build autonomous agents that run entire businesses
- Impact: ship core agent improvements that users feel immediately
- Velocity: small, senior team; fast decision cycles; high ownership
- Stack: modern tooling across AI orchestration, integrations, and memory systems
Compensation
- Competitive salary and meaningful equity
- Comprehensive benefits and flexible work setup
Skills
- LLM
- Retrieval-Augmented Generation
- Slack
- Linear
- Google Workspace
- Python
- Prompt Engineering
- Embeddings
- Redis
- PostgreSQL
- Supabase
- Celery
- AWS SQS
- Datadog
- OpenTelemetry
More jobs at The General Intelligence Company of New York
Similar roles
Software Engineer II, Data Analytics & Engineering
Pinterest · San Francisco, CA, US · Remote, US · today
Software Engineer, Agent Delivery
Pallet · San Francisco · USD 135,000–180,000/yr · today
Manager II, Software Engineering, Infrastructure
Samsara · SF Bay Area · USD 154,700–260,000/yr · today
Intern, Software Engineer AI Agents (Fall 2026/Winter 2027)
Bot Auto · Houston, TX · today
Staff Software Engineer, Backend
Archer · San Jose, California, United States · today
Software Engineer, Sandbox & Agent Executor
Retool · San Francisco · USD 401–163,800/yr · today