
Data Archival lead (26-04245) -
TechDigital · Location not stated
Strong hiring record · median 8 days open
All reasons
- No location stated
In its favour
- Posted today
- Still listed on the employer's own board
Role Overview
We are seeking experienced Data Archival professionals to lead the design and implementation of an enterprise-grade archival solution on Platform 3 (Archon). Product-specific training on Archon will be provided; the role demands strong foundations in enterprise data archival, ETL design, and data-platform architecture. Scope spans end-to-end delivery — from source-system discovery and retention-rule design, through platform setup, ETL build, archival execution, validation, and operational handover. Candidates will work across Production and Non-Production environments, deliver Warm and Cold archival tiers (with de-identification), and align the solution to enterprise security and compliance standards.
Key Responsibilities
Solution Architecture & Design
- Define end-to-end archival architecture on Platform 3 (Archon), including Archon Data Store (ADS), Archon ETL, and Archon Analyzer components.
- Design Warm Archive, Cold Archive (de-identified), and Data Bunker tiers in line with retention, legal-hold, and WORM compliance requirements.
- Translate business retention, privacy, and regulatory policies into archival rules, data classification, tier-mapping logic, and de-identification/tokenization strategies.
- Produce reference architecture, data flow, integration, and security design artifacts aligned to the customer's System Security Plan (SSP).
- Define retrieval patterns – predefined SQL/reports via the Archon UI, distributed query (Trino/Spark) and API-based access where required.
Implementation & Delivery
- Lead Platform 3 (Archon) setup and configuration across Production and Non-Production environments, including DR (and HA where in scope).
- Design and oversee build of archival ETL pipelines using Archon native ETL – extraction, transformation, indexing, and load into ADS.
- Drive source-system connectivity, schema discovery, and dependency mapping using Archon Analyzer.
- Own pilot execution on a defined data subset, then scale-up to full archival of in-scope source systems.
- Lead data validation, reconciliation, volumetric verification, and source-system archival sign-off.
Performance, Monitoring & Issue Resolution
- Develop monitoring dashboards and operational reports for archival jobs, ETL pipelines, and storage tiers.
- Troubleshoot and resolve issues across Archon ETL pipelines, archival workflows, source-system connectivity, and retrieval performance.
- Define SLAs, alerting thresholds, and run-book remediation steps for common failure modes; drive root-cause analysis for Sev1/Sev2 issues.
Governance, Compliance & Stakeholder Management
- Ensure archival design meets regulatory, audit, and information-governance requirements applicable to the customer's industry.
- Partner with customer Architecture, Security, Compliance, Database Administrators (DBAs), application owners, IT infrastructure teams, and SMEs; represent delivery in design and architecture reviews.
- Define monitoring, runbooks, documentation, and knowledge-transfer artifacts; support warranty and operational handover.
- Provide technical guidance and structured training to stakeholders – DBAs, application owners, operations, and business users – on archival processes, retrieval workflows, and post-archival access patterns.
- Identify and manage technical risks; drive Change Control where scope or assumptions shift.
Required Technical Skills
Note
Platform 3 (Archon) product training will be provided. Prior Archon experience is desirable but not mandatory; strong fundamentals in data archival, ETL, and lakehouse / data-platform architecture are essential.
Data, Cloud & Integration
- Strong SQL and relational database expertise – DB2, Oracle, SQL Server (and ideally mainframe / AS-400 data sources).
- Solid grounding in data warehousing, data lakehouse, and ELT/ETL design patterns; familiarity with Parquet/ORC, Iceberg/Delta, and metadata-driven ingestion.
- Experience with Azure cloud storage (Blob, ADLS Gen2) for archival workloads – tiering, lifecycle policies, and cost optimization; AWS S3 exposure is a plus.
- Working knowledge of authentication / authorization patterns (SSO, SAML/OIDC), encryption in transit and at rest (AES-256, KMS), and secure credential handling.
- Comfort with REST APIs, file-based and CDC-based extraction patterns, and integration with downstream consumers (e.g., MuleSoft, iPaaS).
Governance, Compliance & Security
- Strong understanding of data retention, legal hold, audit trails, and information lifecycle management.
- Working knowledge of regulatory frameworks relevant to archival – GLBA, SOX, HIPAA, GDPR, NAIC Model Regulation #672, state record-retention requirements, and PII/PHI handling.
- Experience implementing WORM compliance, chain-of-custody controls, and role-based access for archived data.
Prior Archival / Decommissioning Implementation Experience
Candidates must be able to demonstrate hands-on delivery on at least one – preferably multiple – prior archival or application decommissioning programs.
Specifically
- End-to-end delivery of one or more enterprise archival / decommissioning programs (preferably 2+ for Senior Architect).
- Experience archiving from at least two of the following source-system families: mainframe (AS/400, COBOL/DB2, VSAM), legacy ERP (SAP ECC, PeopleSoft, JD Edwards, Siebel, Lotus Notes), legacy policy administration / closed-block insurance systems, healthcare EHR, custom RDBMS-based applications.
- Demonstrable volume handled – ideally TB-scale archival, with clear evidence of volumetric estimation, throughput tuning, and reconciliation.
- Prior use of one or more archival tools – Archon / Platform 3 (strongly preferred), Informatica ILM, OpenText InfoArchive, Solix EDMS, Archive360, IBM Optim, or equivalent. Cross-tool experience (e.g., migrating off legacy archival tools onto Archon) is a strong plus.
- Experience defining and operationalising retention rule sets, legal-hold workflows, and de-identification rules in production.
- Track record of successful pilot-to-scale transitions, including go/no-go criteria, defect triage, and sign-off governance.
- Exposure to post-archival application retirement / decommissioning sequencing – including infrastructure shutdown, license recovery, and audit closure.
Soft Skills
- Strong written and verbal communication – able to author design documents, runbooks, and present to customer architecture forums.
- Stakeholder management across business, application, security, and compliance teams.
- Structured problem-solving with the ability to operate independently in ambiguous, multi-stakeholder environments.
Preferred Qualifications
- Hands-on or familiarity with Platform 3 (Archon) components – Archon Data Store (ADS) lakehouse, Archon native ETL, Archon Analyzer (source-system discovery), Archon Data Bunker (air-gapped isolation, tokenization), and Archon UI / Trino-Spark-based retrieval.
- Insurance domain experience, preferably Life & Annuity (L&A) and closed-block administration.
- Exposure to modern Life & Annuity policy administration platforms (e.g., Verisk FAST, Oracle OIPA, LifePRO) as archival source systems.
- Certification in Archon, Informatica ILM, or equivalent archival / ETL tooling.
- Exposure to Gartner-recognised archival platforms and broader information-governance tooling (Collibra, Alation) is a plus.
Skills
- ETL
- SQL
- Trino
- Spark
- DB2
- Oracle Database
- SQL Server
- ELT
- Parquet
- Apache Iceberg
- Azure
- Google Cloud Storage
- S3
- SSO
- SAML
- OpenID Connect
- KMS
- MuleSoft
- HIPAA
- GDPR
- COBOL
- Informatica
More jobs at TechDigital
All 98Similar roles
- Lead Data Engineer - Data Archival - BangalorePhoton · India4mo ago
- Senior SAP ECC/CRM Data Archiving LeadProcomconsultantsgroup · Milwaukee, WI, United States10y ago
- ETL SPECIALIST — JIRA DATA MIGRATION / SNOWFLAKE ARCHIVALGlint Tech Solutions · Location not stated
- PaaS - Cloud Solutions Operationalization Engineer - Data archivalKrg Technology · Fort Worth, TX, United States10y ago
- SAP Data Archiving Analyst on contractSquircle It Consulting Services Pvt. · Hyderabad, Telangana, India10y ago