
Backend Engineer _ AI Gateway
PALNAR · New Jersey · United States
Weak hiring record · median 370 days open
- First seen
- 10 November 2026
- Reposted
- Not since September 2026
- Last checked
- Today · still on the employer's board
All reasons
- Open 95 days
- 98% of this employer's openings are over 60 days old
In its favour
- Still listed on the employer's own board
Job Role: Backend Engineer _ AI Gateway
Location
Englewood Cliffs, NJ till September | October onward Plano, TX
Duration: Long Term Contract
What we are looking for,
- Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
- Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
- Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
- Fast API‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and Open API docs.
- Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
- Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
- PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus Hashi Corp Vault (dynamic secrets, transit encryption) for key management.
- Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let's Encrypt).
- IAC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.
Work experience desired
- Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
- IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
- AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
- API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
- Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).
Skills
- • Async Python
- Network Programming
- Large Payload Handling
- • Streaming
- • Fast API Based Backend
- • Cloud Networking & Security
- • IAC & CI/CD
- • AI/LLM Pipelines
More jobs at PALNAR
All 274- Sr. TIBCO Middleware AdministratorPALNAR · Portland, OR, United States4d ago
- Sr. SAP CRM Developer – CRM / Web UIPALNAR · Plano, TX, United States1mo ago
- Software Engineer in TestPALNAR · New Hampshire · United States · USD 65–70/hr1mo ago
- Software Engineer in Test - BackendPALNAR · Texas · United States · USD 65–70/hr1mo ago
- Software Engineer in Test - UI AutomationPALNAR · Texas · United States · USD 65–70/hr1mo ago
Similar roles
- Software Engineer, Agents for GoodJobgether · US · USD 87,700–114,200/yrtoday
- Principal Machine Learning Engineer, Vision AIJobgether · US · USD 230,000–368,000/yrtoday
- Senior Software Engineer, Public SectorClaroty · New York, NY, United States · USD 180,000–200,000/yrtoday
- Full Stack EngineerTrue Talent Solutions Partners · San Francisco · USD 230,000–300,000/yrtoday
- Senior Manager, Software EngineeringJobgether · UStoday
- Software Developer (Java)InterSources · Columbia, SCtoday