Job Description
Insight Global is seeking a Data Platform Engineer to aid in building and operating a high‑volume observability data platform that ingests, stores, and queries massive‑scale telemetry data (logs, metrics, traces) in real time. This role focuses on self‑hosting ClickHouse on Kubernetes to support petabyte‑scale workloads, powering observability across distributed systems.

What You'll Do:
-Design and operate end‑to‑end data pipelines for high‑throughput telemetry ingestion and querying
-Deploy, manage, and optimize self‑hosted ClickHouse clusters running on Kubernetes
-Architect and tune distributed systems handling very large data volumes (partitioning, sharding, replication)
-Build and maintain infrastructure as code using Terraform
-Work across the platform stack with teammates focused on ingestion, storage, and infrastructure
-Monitor and improve system health using tools like Prometheus
Optimize performance, reliability, and cost for ...