Python/PySpark Developer

Job Titles

Python/PySpark Developer

Location

Whippany, NJ (Hybrid)

Duration

Contract

Job Description

• Hands-on experience developing production-grade solutions using Python and PySpark.

Application Engineering

• Strong application engineering experience with the ability to design, develop, test, and deploy production-grade applications.
• Hands-on experience building REST APIs and microservices using languages/frameworks such as Python (FastAPI/Flask) or Java (Spring Boot).
• Good understanding of end-to-end application development, including API design, service integration, authentication/authorization, configuration, testing, CI/CD, observability, scalability, and production support.
• Experience integrating applications with cloud services, databases, messaging platforms, and external/internal APIs.

AWS & Cloud Architecture

• Strong understanding of AWS cloud architecture and cloud-native data/application solutions.
• Hands-on experience with Amazon S3, IAM, EC2, Lambda, EKS, RDS, CloudWatch, Secrets Manager, KMS, and VPC/networking.
• Strong understanding of IAM roles/policies, encryption, private connectivity, security groups, and cross-account access.
• Experience designing secure, scalable, and highly available applications on AWS.

Generative AI/LLM Engineering

• Experience deploying and operationalizing Large Language Models (LLMs) in production.
• Hands-on experience with LLM inference, model serving, prompt engineering, embeddings, RAG, and vector search.
• Experience integrating LLM capabilities into production applications and APIs.

Nice to Have

• Hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows/Jobs, MLflow, notebooks, clusters/compute, and SQL Warehouses.

Experience with containerized application deployment using Docker/Kubernetes/EKS and automated CI/CD pipelines.