Data Engineer (Clickhouse)
Diverse Lynx · Bellevue, WA · Onsite
Strong hiring record · median 3 days open
All reasons
In its favour
- Posted today
- Still listed on the employer's own board
Role
Data Engineer ( Clickhouse)
Experience
8+ Year
Job Type
6+ Months Contract
Location
Bellevue, WA- Onsite
Rate
$50/hr W2 and $60/hr(C2C)
JD
Mandatory Primary Skills
Hadoop, Python, Databricks, Clickhouse DB , ADLS, SQL + Azure cloud technologies above all with Azure (such as ADF, Databricks, Log Analytics, Logic App, Key Vault, Blob Storage, ADLS, etc.)
Secondary Skills
; Snowflake ,
Detailed JD as below.
Data Engineer
We run a near real-time analytics platform for mobile network data, ingesting billions of rows a day from Azure Data Lake/HDFS into ClickHouse and serving subscriber-level queries back to internal APIs in tens of milliseconds. We are expanding the platform footprint to support additional use cases by adding more datasets
Data Engineer would work on
extending the Python ingestion framework that loads from Azure Data Lake/HDFS; table design covering partitioning, sort keys, TTL and materialized views; operational diagnosis of merge behaviour, part counts and replication lag; and integration with Snowflake and Databricks Iceberg alongside the primary feeds.
We need strong analytical SQL and experience with a columnar or MPP database — ClickHouse, BigQuery, Redshift or similar. Python sufficient to own a production ingestion framework rather than write scripts. Comfort at hundreds of billions of rows, since the failure modes differ from smaller systems. Cloud object storage and Parquet. Enough Kubernetes to tell whether a problem is the database or the platform underneath it.
Strongly preferred
direct ClickHouse experience, particularly MergeTree engines and aggregate function states, and telecom data such as DNS , IPFIX, etc. ClickHouse specifically is uncommon, and we would rather have a strong engineer from an adjacent system than a weak one with the exact keyword.
Skills
- ClickHouse
- Hadoop
- Python
- Databricks
- SQL
- Azure
- Azure Log Analytics
- Azure Key Vault
- Azure Blob Storage
- Snowflake
- HDFS
- Apache Iceberg
- BigQuery
- Redshift
- Parquet
- Kubernetes
- DNS
More jobs at Diverse Lynx
All 169- Network Security Engineer (Palo Alto Firewalls)Diverse Lynx · Remote, NY · USD 40–42/hrtoday
- Postgres DBADiverse Lynx · Sunnyvale, CA · USD 60–70/hrtoday
- Cloud Governance EngineerDiverse Lynx · Stamford · USD 50–55/hrtoday
- Airflow Architect – Big Data SystemsDiverse Lynx · Austin, TX · USD 60/hrtoday
- Mongo DBADiverse Lynx · Sunnyvale, CA · USD 50–65/hrtoday
Similar roles
- Enterprise Data AnalystMP Materials · Las Vegas, NV, United Statestoday
- Applied Data ScientistVi · Boston, MAtoday
- Senior Data EngineerHunter Industries Brand · United Statestoday
- Data Analyst (Hybrid)CompQsoft Inc. - ACTIVE · KITTERY, ME · USD 10,000–105,000today
- Staff Technical Program Manager, Data EngineeringPinterest · San Francisco, CA, US · Remote, UStoday
- Airflow Architect – Big Data SystemsDiverse Lynx · Austin, TX · USD 60/hrtoday