Senior AWS Engineer

Senior AWS Engineer

Malvern PA (100% onsite)

About the Role

We are looking for a Senior AWS Engineer to extend our event-driven, serverless financial platform. The platform combines Python-based AWS Glue ETL pipelines with Node.js Lambda microservices.

What You'll Work On

• Design, build, and maintain independently deployable microservices (single-purpose AWS Lambda functions) within an event-driven architecture
• Develop and maintain Node.js (ES6+/async-await) Lambda microservices for file intake, validation, transformation, submission and acknowledgement handling of transaction files (JSON, XLSX, CSV)
• Build event-driven Node.js services triggered by S3 event notifications, EventBridge, SQS and API Gateway, with clear contracts between services
• Use the AWS SDK for Node.js (v3 preferred) to integrate with core AWS services such as S3, DynamoDB, SNS/SES, Secrets Manager and Step Functions.
• Manage dependencies, Lambda layers, bundling and cold start/memory/timeout tuning for Node.js functions
• Define clean service boundaries and contracts (event payloads, schemas, S3 formats) enabling independent development and deployment
• Maintain and extend AWS Glue ETL jobs (PySpark + native Oracle JDBC) that ingest, transform, and reconcile daily transaction history and position snapshot files
• Build and troubleshoot Step Functions workflows (ASL state machines) orchestrating multi-stage pipelines: file validation, ingestion, reconciliation, alerting
• Design and maintain Lambda functions (Python and Node.js) for lightweight orchestration, file validation, DynamoDB writes, and SNS/SES alerting
• Write and optimize Oracle SQL (native JDBC and Lambda-proxied) against a complex financial schema
• Manage DynamoDB data models for transaction history, reconciliation status, and fund-level summaries, including GSIs and TTL-based retention
• Implement robust error handling and transactional integrity (per-record commit/rollback, idempotency, duplicate-detection) for financial data where silent failures are unacceptable
• Apply retries, dead-letter queues and idempotency keys (for example, a file ID checked with DynamoDB conditional writes) so S3 events delivered more than once never cause duplicate processing
• Own unit, integration, and smoke test suites (pytest/unittest, Jest/Mocha, moto and aws-sdk-client-mock for AWS mocking) and maintain/improve code coverage
• Support CI/CD pipelines (Jenkins, AWS SAM/CloudFormation), including build, test, lint and packaging of Node.js services

Build and maintain observability

structured CloudWatch logging/metrics, Grafana dashboards, and metric registries for pipeline health

• Participate in security reviews (SOC2-aligned findings, SQL injection guards, least-privilege IAM, KMS encryption) and remediate findings, including Node.js dependency vulnerability management (npm audit)
• Produce and maintain technical documentation (architecture references, runbooks, deployment guides, changelogs)

Required Skills & Experience

• Python (3.12+) strong proficiency, including testable, well-structured ETL code
• Node.js (current LTS) has strong proficiency, including ES6+, async/await, and JavaScript or TypeScript for AWS Lambda microservices

Experience designing and operating microservices architectures

single-purpose services, loose coupling, independent deployment, event contracts and idempotency

• AWS Glue (PySpark, Glue 4.0, DynamicFrames) and AWS Lambda (Python and Node.js runtimes)
• AWS Step Functions (Amazon States Language) for workflow orchestration
• AWS SAM / CloudFormation infrastructure as code, multi-environment deployment
• Oracle SQL complex joins, DML across transactional schemas, stored procedure–like code patterns
• DynamoDB key design, GSIs, conditional writes, pagination
• S3 - event-driven architectures (EventBridge notifications), data lake patterns (Parquet)

Strong testing discipline

pytest/unittest, Jest/Mocha, mocking AWS services (moto, aws-sdk-client-mock), stubbing Spark/Glue runtime dependencies for offline unit tests

• Experience with financial/transactional data where correctness, auditability, and idempotency are critical
• CI/CD experience, ideally Jenkins, with multi-environment promotion gates
• Familiarity with CloudWatch metrics/logs, Grafana, and building operational dashboards