JobHabor
Menu

Backend Engineer _ AI Gateway

PALNAR · New Jersey · United States

Weak hiring record · median 370 days open

4444

Hiring signal

Stale

Open 96 days · Never reposted · Checked today · How we score

First seen
10 November 2026
Reposted
Not since September 2026
Last checked
Today · still on the employer's board
All reasons
  • Open 95 days
  • 98% of this employer's openings are over 60 days old

In its favour

  • Still listed on the employer's own board

Hide postings like this across the board

Did you apply?

Backend Engineer _ AI Gateway at PALNAR. We’ll keep it in your applied jobs, so you can see it later and be warned before applying to the same employer twice.

Job Role: Backend Engineer _ AI Gateway

Location

Englewood Cliffs, NJ till September | October onward Plano, TX

Duration: Long Term Contract

What we are looking for,

  • Async Python & Network Programming (3 + yrs) – Strong hands‑on experience with asyncio, aiohttp/anyio, low‑level TCP/UDP sockets, WebSocket & SSE servers, TLS handshake, connection‑pooling, keep‑alive, and zero‑copy buffering.
  • Streaming & Large‑Payload Handling – Ability to manage chunked transfer, bidirectional streaming, back‑pressure and high‑throughput data paths for real‑time LLM inference.
  • Protocol Knowledge – Working familiarity with HTTP/2 & HTTP/3 (multiplexing, HPACK), gRPC, and occasional custom protocol parsers.
  • Fast API‑Based Backend (3 + yrs) – Design, develop and test production‑grade REST/Streaming APIs; pragmatic use of Pydantic, dependency injection and Open API docs.
  • Containerization & Kubernetes – Docker, AKS/EKS/GKE deployment experience; HPA/VPA scaling, rolling updates, and service‑mesh (e.g., Istio/Envoy) basics.
  • Async Messaging & Event‑Driven Design – Production use of Redis Streams, RabbitMQ or Kafka for decoupled task queues, retries and back‑off logic.
  • PostgreSQL & Vault – Advanced query tuning, partitioning, PgBouncer pooling, plus Hashi Corp Vault (dynamic secrets, transit encryption) for key management.
  • Cloud Networking & Security – L4/L7 load balancing, TLS termination, reverse‑proxy (NGINX/Envoy), mTLS between services, and automated cert lifecycle (ACME/Let's Encrypt).
  • IAC & CI/CD – Terraform modules for multi‑env infra, plus GitHub Actions/GitLab CI pipelines with container image scanning and canary/blue‑green deployments.

Work experience desired

  • Enterprise Security Gateways – Integration with CASB/DLP/WSS or similar edge‑security platforms; centralized logging & audit trails.
  • IAM & SSO – Configuring Azure AD/Entra ID, Okta, SAML 2.0 or OIDC SSO flows; managing Conditional Access & SCIM provisioning.
  • AI/LLM Pipelines – Building prompt‑engineering workflows, PII anonymisation, and monitoring Azure OpenAI (or comparable) usage, rate limits & cost.
  • API‑Gateway Operations – Custom webhook/REST integrations, circuit‑breaker patterns, rate‑limiting, auto‑retry and health‑checking.
  • Observability & FinOps – End‑to‑end monitoring with Datadog, Prometheus/Grafana or Azure Monitor; proactive cost‑optimisation and 24/7 incident response (SLA/SLO).

Skills

  • • Async Python
  • Network Programming
  • Large Payload Handling
  • • Streaming
  • • Fast API Based Backend
  • • Cloud Networking & Security
  • • IAC & CI/CD
  • • AI/LLM Pipelines

More jobs at PALNAR

All 274

Similar roles