AI Infra Engineer
AIT Global · United States · Remote
- First seen
- 9 November 2026
All reasons
In its favour
- Someone has already applied through it
Job Title: AI Infra Engineer
Location
Remote (US)
Job description
- 5+ years in software/ML infrastructure engineering
- Build full-stack internal GenAI tools (Python, FastAPI, Streamlit) that let non-engineering teams run LLM analysis over sensitive data, including scalable PII-masking pipelines.
- Design and maintain MCP servers/tools enabling teams to run workflows directly from AI chat clients, with strict identity and auth checks.
- Own and evolve labeling platform infrastructure (FastAPI, Celery, Redis, Labelbox), including large-scale data migrations, on-call support, and data-loss recovery.
- Migrate observability stacks from legacy tools to OpenTelemetry, building dashboards and ing as code.
- Build and maintain data/ML pipelines (Airflow, Spark, Hive, Trino) supporting multiple business units.
- Partner with product and engineering leads to turn ambiguous problems into shipped features with measurable efficiency gains.
Skills
Data Engineering, Python PySpark, Machine Learning, API, Streamlit
Skills
- Machine Learning
- Generative AI
- Python
- FastAPI
- Streamlit
- LLM
- Model Context Protocol
- Celery
- Redis
- Labelbox
- OpenTelemetry
- Airflow
- Spark
- Hive
- Trino
- PySpark
Similar roles
- Backend Software Engineer (Infra Engineer)IntelliPro Group · Palo Alto, CA · USD 160,000–180,000/yr17d ago
- Sr. Staff ML Infra Engineer - Offline Infra & TrainingCoupang · Mountain View, USA · USD 174,000–299,000/yrtoday
- Founding Senior Infra Engineer, Distributed InfraGoaly · Palo Alto, CA, USA2mo ago
- Lab Infra EngineerLorven technologies · Redmond, WA, United States · USD 54–55/hr1mo ago
- Engineering, InfraGreptile · San Francisco3mo ago
- Senior Software Engineer – ML InfraUber · Sunnyvale, CA, United States · San Francisco, CA, United States · Seattle, WA, United States · USD 202,000–224,000/yr3mo ago