Data Engineer

Responsibilities

• Lead the architecture, design, and development of data warehousing solutions.
• Provide technical guidance and mentorship to the data engineering team.
• Ensure best practices in data warehousing, ETL / ELT processes, and data integration.
• Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.
• Ensure data accuracy, integrity, and consistency across data sources.
• Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.
• Implement and manage data warehousing solutions using Snowflake.
• Utilize AWS Glue for data integration and ETL / ELT tasks.
• Optimize data storage and retrieval processes to enhance performance.
• Apply AI/ML concepts to extract insights from large datasets.
• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
• Develop data solutions that address specific needs within these domains.
• Collaborate with stakeholders to gather and analyse business requirements

Requirement

• Overall, 3 to 5 years’ experience in which 2+ years of experience in Data Analytics and Digital solutions with exposure to Lake house architecture
• BTech in Computer Science or IT
• Technical expertise with data models, data mining, and segmentation techniques
• Knowledge of programming languages (e.g. Java and Python) and with hands-on experience with SQL database design
• Exposure to Cortex AI, AWS Bedrock, Copilot studio (good to have)
• Strong analytical and problem-solving skills. Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/ coach to internal team
• Should have exposure to Cloud ETL/ ELT, Cloud DWH, AI and ML tools
• Domain expertise in Finance, Accounts, and Manufacturing.
• Exposure to agile software development, and/or development management
• Positive attitude and motivation to deliver and ensure highest quality deliverables. Able to respond positively and calmly to shifting priorities, demands and timelines