Amazon Web Service(AWS) Cloud Computing~Digital : Snowflake

Job Title

Developer

Work Location

Hyderabad TS and Chennai TN

Skill Required

Digital

Amazon Web Service(AWS) Cloud Computing~Digital

Snowflake

Experience Range in Required Skills

10+ years

Job Description

• Technical skills - AWS Neptune Database, AWS Neptune Analytics, S3, Snowflake, Graph database, AWS CloudIdentify and select the data sources, Tables, Relationships between different entities in Snowflake.
• Establish a secure connection between Snowflake and AWS Neptune via AWS service stack by securing extracted data storing in S3 for transformation before loading into AWS Neptune.
• Collaborate with current platform team to understanding data structure to implement data extraction processes from Snowflake.Load the extracted data into AWS S3 for graph model transformation.
• Analyze the data, relationships, entities mappings to determine the necessary graph schema.Design nodes, edges, and properties for the graph schema using entities definitions.
• Implement the graph schema in AWS Neptune.
• Creating indexes to improve query performance
• Review and refine schema based on query patterns and performance based on mutually agreed design
• Define the transformation logic using DBT.
• Develop DBT models for data transformation.
• Schedule and automate the ELT pipeline using DBT and Snowflake.

Essential Skills

• Technical skills - AWS Neptune Database, AWS Neptune Analytics, S3, Snowflake, Graph database, AWS CloudIdentify and select the data sources, Tables, Relationships between different entities in Snowflake.
• Establish a secure connection between Snowflake and AWS Neptune via AWS service stack by securing extracted data storing in S3 for transformation before loading into AWS Neptune.
• Collaborate with current platform team to understanding data structure to implement data extraction processes from Snowflake.Load the extracted data into AWS S3 for graph model transformation.
• Analyze the data, relationships, entities mappings to determine the necessary graph schema.Design nodes, edges, and properties for the graph schema using entities definitions.
• Implement the graph schema in AWS Neptune.
• Creating indexes to improve query performance
• Review and refine schema based on query patterns and performance based on mutually agreed design
• Define the transformation logic using DBT.
• Develop DBT models for data transformation.
• Schedule and automate the ELT pipeline using DBT and Snowflake.