Sr. Data Pipeline Engineer - Python

DETAILS

SR DATA PIPELINE ENGINEER – PYTHON

Title

Sr. Data Pipelines Engineer – Python / MySQL / NoSQL

Compensation

The total compensation for this role will be 155k-170/year to start with a Base salary 130-140k + Bonus + Work life balance, strong culture, strong paid time off package with sick/vacation/personal time and Excellent benefits

Location

Hybrid Role (4 days in office/ 1 Remote ) Office is in Smyrna, TN (Suburb of Nashville)

OVERVIEW

SR DATA PIPELINE ENGINEER – PYTHON

This person will design, build, and optimize the systems to gather, ingested, store, analyze, transform, and distribute data. Design, build, and support data pipelines, from ingestion to the creation of Operational Data Stores (ODS). Act as the senior/lead technical programmer on the team. Works with the data architect, CI/CD architects, and other data engineers to build and deliver world-class data platforms.

RESPONSIBILITIES

SR DATA PIPELINE ENGINEER – PYTHON

• Pipeline Development: Design and implement robust ETL/ELT data pipelines using Apache Kafka for streaming and batch processing.
• Database Management: Architect and maintain both Relational (MySQL, SQL Server) and Non-relational (NoSQL) database environments to ensure high performance and scalability.
• SQL server related: Transact-SQL, ETL and Data warehousing, SQL server management studio, maintaining and optimizing stored procedures, maintaining and monitoring background jobs.
• ODS Architecture: Build and manage Operational Data Stores to integrate data from disparate sources for real-time and batched operational reporting.
• Data Handling: Write complex, optimized SQL queries, develop Python scripts using libraries like Pandas, NumPy, and PySpark, and integrate Kafka for sophisticated data transfer, manipulation and cleansing.
• System Optimization: Monitor and tune database performance, ensuring data integrity and security across all platforms.
• Lead and execute testing to ensure data validation and data integrity.
• Drives solutions and guides the work of others to provide full application development life cycle support including specifications, prototypes, development, quality assurance, and deployment.

MINIMUM REQUIREMENTS

SR DATA PIPELINE ENGINEER – PYTHON

• Education: Bachelor's or master's degree in computer science, Computer Engineering, IT, or a closely related technical field.
• 6+ years of professional experience in data engineering or a similar data-intensive role.
• Core Languages: Expert-level proficiency in SQL and Python.
• Databases: Deep experience with MySQL and at least one major NoSQL provider (e.g., MongoDB, Cassandra).
• Integration: Hands-on experience creating and deploying SSIS Packages.
• Streaming: Proven experience using Apache Kafka for event-driven architecture.
• Concepts: Strong understanding of data modeling, schema design, and distributed systems

Thorndale Partners, LLC

Your trusted talent acquisition partner working to provide a premium experience to both job seekers and hiring managers.

Please visit our Website to learn more and follow us on LinkedIn .