Description
ONSITE

Seeking a Data Engineer to build and optimize scalable data pipelines and platforms supporting enterprise analytics, reporting, and AI initiatives.
Responsibilities

+ Build ETL/ELT pipelines (batch & streaming)

+ Design scalable data architectures (Lakehouse, warehouse)

+ Ensure data quality, governance, and security

+ Optimize performance, cost, and reliability

+ Partner with analytics, BI, and engineering teams

Requirements
Skills

Data Platforms

+ Apache Spark (DataFrames, SQL, RDDs, streaming, tuning, Catalyst/Tungsten)

+ Delta Lake (ACID, MERGE, OPTIMIZE, Z-ORDER, CDC, time travel)

+ Databricks SQL (queries, views, UDFs)

+ Delta Live Tables (DLT), Jobs, Workflows

Architecture & Ingestion

+ Lakehouse (Medallion, partitioning, clustering, data contracts)

+ Auto Loader / Lakeflow (batch & streaming ingestion, CDC)