JobHabor
Menu

Data Engineer (Snowflake / Informatica)

inSync Staffing · Denver, CO

100100

Hiring signal

Actively hiring

Posted today · Never reposted · How we score

First seen
19 November 2026
Reposted
Not since September 2026
All reasons

In its favour

  • Posted yesterday
  • Still listed on the employer's own board

Did you apply?

Data Engineer (Snowflake / Informatica) at inSync Staffing. We’ll keep it in your applied jobs, so you can see it later and be warned before applying to the same employer twice.

Data Engineer (Snowflake / Informatica)

Statewide Longitudinal Data System (SLDS / COdata) – State of Colorado, Office of Information Technology (OIT)

Position Type

6-month contract, with possible extension based on project performance and state funding

Start

January 2027

Work Arrangement

Remote. Candidates must live in Colorado for the duration of the engagement; local / Denver Metro candidates are strongly preferred. Candidates must be local or willing to commute or relocate, and must be within 100 miles.

Overview

The Data Engineer turns the Data Architect's vision into working data pipelines built on Snowflake and Informatica. The role moves data from line-of-business, transactional and partner-agency source systems into analytical platforms, builds transformations, manages data cleansing and quality, and delivers structured data for analysts and data scientists.

The engineer joins the SLDS project team in January 2027 under a shared delivery model with a third-party implementation partner. The role follows a structured knowledge transfer (shadowing, co-running and checking), leads specific new source ingestions, and progressively takes over production operations and upkeep of the SLDS data foundation and analytics layer.

Key Responsibilities

  • Data ingestion and pipeline engineering: Design, develop, test and deploy automated ETL pipelines in Informatica and Snowflake to bring partner state agency and third-party data into the SLDS common data model.
  • Transformation and analytics layer: Implement transformation logic that turns raw agency feeds into harmonized, linked longitudinal records and analytics-layer data models, following the naming and modeling standards set with the Data Architect.
  • Record linkage and identity matching: Run SLDS matching logic to link newly ingested agency records to master longitudinal student and workforce profiles, and handle match exceptions and cross-agency reconciliations.
  • Production operations and incident response: Own scheduled feed runs: monitor jobs, resolve failures, reload late or corrected files, reconcile row counts and rebuild downstream objects.
  • Data quality and governance: Implement L1 (structure/format), L2 (completeness/de-duplication) and L3 (referential integrity/logic) validation checks, layout-change detection and audit trails. Enforce privacy, suppression and compliance standards (FERPA, COPPA, ADA and state statutes).
  • Performance optimization: Tune queries, warehouse compute and pipelines for cost and latency, and address heavily used models and performance hot spots in Snowflake.
  • QA, code review and promotion: Follow the release process across Development, Test, UAT and Production using Azure DevOps and Azure Test Plans; write and run test cases, perform peer code reviews and maintain release change logs.

Activities

A. Ingestion and pipeline development (OIT-led feeds)

  • CDHE courses data: Ingest and validate annual postsecondary course-level files from CDHE under data sharing agreements; build ETL mappings into the SLDS common data model from the implementation partner's design specifications; pair with the partner during ETL build, validation and promotion.
  • Postsecondary SES and disability data (conditional): Ingest and validate demographic, Pell Grant eligibility and disability classification codes; apply required privacy protections, cell suppression rules and permissible-use governance.
  • PSAT/SAT assessment data (conditional): Ingest, validate and map section/composite scores and grade levels from the College Board or CDE; match assessment records to existing longitudinal student profiles.

B. Knowledge transfer and operational transition (January–April 2027)

  • Shadowing and co-running (January–February 2027): Shadow partner engineers on existing feeds (e.g., NSC, K-3, CDEC and Phase 1 feeds); co-run live feed cycles, data loading, record matching and exception handling.
  • Readiness gate (target March 2027): Run two consecutive feed cycles unaided to earn formal operational hand-over sign-off.
  • Full production operations (March 2027 onward): Run recurring feed schedules, rebuild downstream objects, reconcile row counts against source files, triage failed jobs, and handle ad-hoc data and export requests from OIT leadership and partner agencies.

C. Data stabilization and analytics layer upkeep

  • Resolve data reliability defects, run variations and de-duplication issues carried over from the Phase 1 stabilization backlog.
  • From April 2027: apply object modeling standards, naming conventions and layout-change detection in the RAW layer; reconcile analytics-layer outputs across non-production and production; implement metric and calculation enhancements for downstream use cases (program participation, completion, equitable access and wage outcomes); profile and tune dashboard back-end models.

D. Cross-functional collaboration and testing

  • Write manual and automated test cases in Azure Test Plans, record execution evidence and resolve defects before promoting code.
  • Work with the Data Architect on physical and logical data models and pipeline designs.
  • Support the Data Scientist / Visualization Designer by integrating new sources for Tableau dashboard refreshes and preparing source tables for de-identified Institution of Higher Education (IHE) outcome files.
  • Coordinate with Operations Engineers on Snowflake compute management, warehouse auto-shutdown, user role permissions and CI/CD promotion pipelines.

Deliverables

  • Code and pipelines: Scheduled Informatica workflows and Snowflake SQL/transformation pipelines; L1–L3 cleansing and validation modules and layout-change detection; documented identity-matching scripts; analytics-layer views, tables and metric models; scripts that produce de-identified, suppressed IHE outcome files.
  • Documentation: ETL pipeline design documents; source-to-target mapping specifications; data lineage and dependency maps; operational runbooks and incident procedures.
  • Testing and operational reporting: Azure Test Plans with test suites, results and defect logs; release change logs linked to Azure DevOps work items; feed run logs, match summaries, reconciliation totals and data-quality summaries.

Required Qualifications

  • 5+ years building, orchestrating and optimizing complex ETL/ELT pipelines and transformation logic natively in Snowflake.
  • 1+ year of hands-on experience with Informatica Cloud Data Governance and Catalog (CDGC) for metadata management, data profiling, cataloging and automated data quality validation.
  • 1+ year using Terraform to provision, configure and maintain cloud infrastructure.
  • Proven experience implementing automated build, test and release pipelines in Azure DevOps.
  • Expert Git / version control skills (branching strategies, pull requests, automated merge checks, code reviews).
  • Must currently live in Colorado and remain a resident for the duration of the engagement.
  • Must be local, or willing to commute or relocate, and must be within 100 miles.

Preferred Qualifications

  • Experience with public sector, longitudinal education and workforce data systems (e.g., CDE, CDHE, CDLE, CDEC, National Student Clearinghouse).
  • Experience with record linkage, entity resolution and deterministic/probabilistic identity matching across public records.
  • Familiarity with federal and state student/workforce privacy regulations, including FERPA, COPPA and cell suppression standards.
  • Experience writing and running structured test plans in Azure Test Plans.

Additional Requirements

  • Information security training: Per Colorado Revised Statute 24-37.5-401, 403, 404, 405 and 406 and Colorado Information Security Policy (CISP) 002, the selected contractor must complete state information security training, including acknowledgment of the Acceptable Use of State Data and IT Resource Policy (CISP-018), within 30 days of the contract start date and annually after that.
  • Background check: Required upon selection, including state, county and federal criminal records checks (past 7 years), SSN name search and Global Monitor Check (formerly Patriot/OFAC/Terrorist). The agency may require additional checks.

More jobs at inSync Staffing

All 8

Similar roles